00000001:00080000:2.0F:1788872505.234060:0:75620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411434 is committed 00000100:00100000:1.0F:1788872505.242628:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:83274:x1875765327585280:12345-0@lo:1000:osp_up1-0.0 Request processed in 22749us (28072us total) trans 77309411434 rc 0/0 00000100:00100000:1.0:1788872505.242651:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00000004:00080000:3.0F:1788872505.244892:0:83274:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 77309411434 committed transno 77309411434 00000100:00100000:3.0:1788872505.244912:0:83274:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411434 gen 2 00000100:00100000:3.0:1788872505.244936:0:83274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f544ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:83274:1875765327585280:0@lo:1000:osp_up1-0.0 00000400:00080000:0.0F:1788872505.317596:0:83704:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1788872505.83291 00010000:02000000:2.0:1788872505.317718:0:83291:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:06, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:3.0:1788872505.356137:0:83291:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb002c869fe10 00100000:10000000:3.0:1788872505.356153:0:83291:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1788872505.366855:0:83277:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:2.0:1788872505.366904:0:83277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9eec97800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83277:1875765327585408:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788872505.366969:0:83277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788872505.367406:0:83279:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:1.0:1788872505.367427:0:83279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83279:1875765327585536:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788872505.369889:0:83279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872505.370015:0:83279:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c4e68180 going to sleep for 20 seconds 00000100:00100000:3.0:1788872505.371081:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327585408 00000100:00100000:3.0:1788872505.371093:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327585408 00000100:00100000:3.0:1788872505.371352:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327585536 00000100:00100000:3.0:1788872505.371356:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327585536 00000100:00100000:3.0:1788872505.371392:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5919 00000100:00100000:3.0:1788872505.371403:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eec94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:83277:x1875765327585408:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:3.0:1788872505.371411:0:26190:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1788872505.371443:0:26190:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -529 00002000:02000040:3.0:1788872505.371448:0:26190:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:705) 00000100:00100000:2.0:1788872505.373444:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5920 00000100:00100000:2.0:1788872505.373488:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:83279:x1875765327585536:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:2.0:1788872505.373498:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:2.0:1788872505.373534:0:8438:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -31 00002000:02000040:2.0:1788872505.373566:0:8438:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:705) 00002000:00010000:3.0:1788872505.380875:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.380890:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d92c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.380908:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c1:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.380912:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.380918:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d92c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.380935:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d92c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.380946:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d92c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.380975:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d92c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.381152:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872505.381375:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.381381:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d92c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.381390:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c0:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.381393:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.381396:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d92c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.381405:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d92c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.381413:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d92c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.381420:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d92c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.385383:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872505.385404:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d92c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.385423:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.385430:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d92c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.385443:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d92c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.385478:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d92c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.385486:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d92c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.385514:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.385518:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d92c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.385524:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.385527:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d92c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.385534:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d92c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.385585:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d92c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.385595:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.385596:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.385598:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872505.389145:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788872505.389164:0:26190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d92c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872505.389369:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.389377:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d92cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389391:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bf:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.389395:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.389402:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d92cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389416:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d92cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389426:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d92cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389435:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d92cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389470:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872505.389486:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872505.389493:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d92cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389503:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872505.389507:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d92cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389523:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d92cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389540:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d92cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389582:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d92cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389598:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872505.389600:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872505.389602:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872505.389616:0:83277:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7436c00 going to sleep for 20 seconds 00002000:00010000:3.0:1788872505.389673:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.389678:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d92d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389686:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2be:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.389689:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.389693:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d92d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389701:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d92d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389708:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d92d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389720:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d92d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.389732:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.389926:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.389933:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d92d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.389941:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.389944:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d92d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.389952:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d92d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.389964:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d92d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.389971:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d92d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.389986:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.389988:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.389989:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.390002:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872505.393073:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.393087:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032639e62/0xe4e6e89fb01d92dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393105:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bd:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.393111:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.393118:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032639e62/0xe4e6e89fb01d92dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393132:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032639e62/0xe4e6e89fb01d92dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393142:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032639e62/0xe4e6e89fb01d92dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393151:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032639e62/0xe4e6e89fb01d92dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393174:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872505.393237:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.393243:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d994b14/0xe4e6e89fb01d92e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393259:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bc:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.393263:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.393267:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d994b14/0xe4e6e89fb01d92e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393276:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d994b14/0xe4e6e89fb01d92e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393284:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d994b14/0xe4e6e89fb01d92e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393290:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d994b14/0xe4e6e89fb01d92e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393319:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788872505.393364:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.393369:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f621d1d/0xe4e6e89fb01d92eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393376:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bb:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.393379:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.393383:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f621d1d/0xe4e6e89fb01d92eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393390:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f621d1d/0xe4e6e89fb01d92eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393407:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f621d1d/0xe4e6e89fb01d92eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393413:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f621d1d/0xe4e6e89fb01d92eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393425:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788872505.393471:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.393476:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029816cf9/0xe4e6e89fb01d92f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393486:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ba:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.393488:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.393491:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029816cf9/0xe4e6e89fb01d92f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393499:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029816cf9/0xe4e6e89fb01d92f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393505:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029816cf9/0xe4e6e89fb01d92f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393512:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029816cf9/0xe4e6e89fb01d92f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393534:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788872505.393593:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.393598:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f339b461/0xe4e6e89fb01d92f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393606:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b9:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.393609:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.393613:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f339b461/0xe4e6e89fb01d92f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393622:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f339b461/0xe4e6e89fb01d92f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393629:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f339b461/0xe4e6e89fb01d92f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393636:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f339b461/0xe4e6e89fb01d92f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393644:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788872505.393672:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.393676:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e680a1/0xe4e6e89fb01d9300 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393683:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b8:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.393691:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.393695:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e680a1/0xe4e6e89fb01d9300 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393704:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e680a1/0xe4e6e89fb01d9300 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393712:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e680a1/0xe4e6e89fb01d9300 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393719:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022e680a1/0xe4e6e89fb01d9300 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.393726:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788872505.396989:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.397006:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9307 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.397023:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b7:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.397029:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.397035:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9307 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.397049:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9307 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.397059:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9307 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.397081:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9307 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.397092:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788872505.397194:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.397200:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f237e439/0xe4e6e89fb01d930e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.397208:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b6:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.397211:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.397215:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f237e439/0xe4e6e89fb01d930e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.397224:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f237e439/0xe4e6e89fb01d930e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.397232:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f237e439/0xe4e6e89fb01d930e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397353:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788872505.397361:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032639e62/0xe4e6e89fb01d92dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397369:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.397373:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032639e62/0xe4e6e89fb01d92dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397382:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032639e62/0xe4e6e89fb01d92dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397397:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032639e62/0xe4e6e89fb01d92dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397405:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032639e62/0xe4e6e89fb01d92dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397424:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788872505.397428:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d994b14/0xe4e6e89fb01d92e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397445:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.397448:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d994b14/0xe4e6e89fb01d92e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397469:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d994b14/0xe4e6e89fb01d92e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397489:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d994b14/0xe4e6e89fb01d92e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397496:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d994b14/0xe4e6e89fb01d92e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397509:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788872505.397512:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f621d1d/0xe4e6e89fb01d92eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397518:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9cc00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.397521:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f621d1d/0xe4e6e89fb01d92eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397527:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f621d1d/0xe4e6e89fb01d92eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397534:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f621d1d/0xe4e6e89fb01d92eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397546:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f621d1d/0xe4e6e89fb01d92eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397571:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788872505.397574:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029816cf9/0xe4e6e89fb01d92f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397580:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9dc00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.397583:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029816cf9/0xe4e6e89fb01d92f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397589:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029816cf9/0xe4e6e89fb01d92f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397597:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029816cf9/0xe4e6e89fb01d92f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397603:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029816cf9/0xe4e6e89fb01d92f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397611:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872505.397613:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f339b461/0xe4e6e89fb01d92f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397618:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.397629:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f339b461/0xe4e6e89fb01d92f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397635:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f339b461/0xe4e6e89fb01d92f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397644:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f339b461/0xe4e6e89fb01d92f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397652:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f339b461/0xe4e6e89fb01d92f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397663:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872505.397666:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022e680a1/0xe4e6e89fb01d9300 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397673:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.397676:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e680a1/0xe4e6e89fb01d9300 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397682:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e680a1/0xe4e6e89fb01d9300 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397690:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022e680a1/0xe4e6e89fb01d9300 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397697:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e680a1/0xe4e6e89fb01d9300 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397715:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872505.397718:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9307 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397726:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.397729:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9307 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397736:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9307 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397746:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9307 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397753:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9307 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.397777:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.397779:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.397780:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872505.397906:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f237e439/0xe4e6e89fb01d930e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.397927:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872505.397984:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.397990:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c74f5103/0xe4e6e89fb01d9315 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398005:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b5:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.398008:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.398012:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c74f5103/0xe4e6e89fb01d9315 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398021:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c74f5103/0xe4e6e89fb01d9315 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398028:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c74f5103/0xe4e6e89fb01d9315 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398034:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c74f5103/0xe4e6e89fb01d9315 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398042:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788872505.398084:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.398089:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d931c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398096:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b4:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.398099:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.398103:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d931c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398111:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d931c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398131:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d931c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398138:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d931c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398146:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788872505.398184:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.398190:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d9323 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398197:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b3:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.398200:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.398203:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d9323 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398211:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d9323 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398219:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d9323 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.398226:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d9323 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398359:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788872505.398367:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f237e439/0xe4e6e89fb01d930e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398375:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.398379:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f237e439/0xe4e6e89fb01d930e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398386:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f237e439/0xe4e6e89fb01d930e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398398:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f237e439/0xe4e6e89fb01d930e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398405:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f237e439/0xe4e6e89fb01d930e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398421:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872505.398424:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c74f5103/0xe4e6e89fb01d9315 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398430:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.398434:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c74f5103/0xe4e6e89fb01d9315 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398441:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c74f5103/0xe4e6e89fb01d9315 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398471:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c74f5103/0xe4e6e89fb01d9315 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398478:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c74f5103/0xe4e6e89fb01d9315 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398492:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.398495:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d931c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398501:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.398504:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d931c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398510:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d931c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398518:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d931c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398525:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d931c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398535:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.398536:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.398543:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.398570:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.398576:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.398596:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.398602:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044054a64/0xe4e6e89fb01d932a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398610:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c1:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.398613:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.398617:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044054a64/0xe4e6e89fb01d932a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398629:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044054a64/0xe4e6e89fb01d932a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398637:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044054a64/0xe4e6e89fb01d932a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398645:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044054a64/0xe4e6e89fb01d932a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398661:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.398667:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.398670:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044054a64/0xe4e6e89fb01d932a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398677:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98f400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.398680:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044054a64/0xe4e6e89fb01d932a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398694:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044054a64/0xe4e6e89fb01d932a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398705:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044054a64/0xe4e6e89fb01d932a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398713:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044054a64/0xe4e6e89fb01d932a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398728:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.398729:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.398731:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.398818:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.398823:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1c5a128/0xe4e6e89fb01d9331 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398830:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c0:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.398833:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.398838:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1c5a128/0xe4e6e89fb01d9331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398846:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1c5a128/0xe4e6e89fb01d9331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398854:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1c5a128/0xe4e6e89fb01d9331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398868:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1c5a128/0xe4e6e89fb01d9331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398881:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.398888:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.398892:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1c5a128/0xe4e6e89fb01d9331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398899:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98f200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.398902:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1c5a128/0xe4e6e89fb01d9331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398909:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1c5a128/0xe4e6e89fb01d9331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398920:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1c5a128/0xe4e6e89fb01d9331 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398926:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1c5a128/0xe4e6e89fb01d9331 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.398939:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.398941:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.398942:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.398985:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.398997:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011dc3d0d/0xe4e6e89fb01d9338 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399006:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bf:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.399009:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.399012:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011dc3d0d/0xe4e6e89fb01d9338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399022:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011dc3d0d/0xe4e6e89fb01d9338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399029:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011dc3d0d/0xe4e6e89fb01d9338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399036:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011dc3d0d/0xe4e6e89fb01d9338 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399049:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.399057:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.399061:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011dc3d0d/0xe4e6e89fb01d9338 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399068:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98ec00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.399071:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011dc3d0d/0xe4e6e89fb01d9338 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399079:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011dc3d0d/0xe4e6e89fb01d9338 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399097:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011dc3d0d/0xe4e6e89fb01d9338 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399104:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011dc3d0d/0xe4e6e89fb01d9338 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399116:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.399118:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.399119:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.399163:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.399168:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01d933f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399175:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2be:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.399178:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.399182:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01d933f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399190:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01d933f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399198:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01d933f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399204:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01d933f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399228:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.399247:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.399250:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01d933f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399257:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98f000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.399260:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01d933f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399267:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01d933f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399278:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01d933f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399284:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01d933f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399296:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.399298:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.399299:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.399341:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.399346:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000253e557e/0xe4e6e89fb01d9346 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399354:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bd:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.399363:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.399368:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000253e557e/0xe4e6e89fb01d9346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399377:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000253e557e/0xe4e6e89fb01d9346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399385:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000253e557e/0xe4e6e89fb01d9346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399392:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000253e557e/0xe4e6e89fb01d9346 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399405:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.399412:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.399416:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000253e557e/0xe4e6e89fb01d9346 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399422:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.399425:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000253e557e/0xe4e6e89fb01d9346 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399431:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000253e557e/0xe4e6e89fb01d9346 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399440:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000253e557e/0xe4e6e89fb01d9346 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399469:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000253e557e/0xe4e6e89fb01d9346 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399482:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.399484:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.399485:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.399534:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.399539:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d934d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399546:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bc:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.399573:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.399577:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d934d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399586:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d934d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399593:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d934d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399601:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d934d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399612:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.399618:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.399626:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d934d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399633:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.399636:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d934d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399643:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d934d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399654:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d934d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399661:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d934d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399671:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.399672:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.399674:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.399708:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.399712:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9354 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399719:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bb:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.399721:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.399724:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399741:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399747:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399754:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399765:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.399771:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.399775:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399781:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.399783:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399790:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9354 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399798:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9354 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399803:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9354 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399821:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.399822:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.399824:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.399858:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.399863:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e83d969/0xe4e6e89fb01d935b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399870:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ba:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.399873:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.399877:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e83d969/0xe4e6e89fb01d935b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399886:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e83d969/0xe4e6e89fb01d935b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399894:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e83d969/0xe4e6e89fb01d935b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399900:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e83d969/0xe4e6e89fb01d935b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399910:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.399915:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.399918:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e83d969/0xe4e6e89fb01d935b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399934:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.399938:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e83d969/0xe4e6e89fb01d935b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399945:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e83d969/0xe4e6e89fb01d935b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399956:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e83d969/0xe4e6e89fb01d935b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399963:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e83d969/0xe4e6e89fb01d935b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.399974:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.399975:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.399977:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.400010:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.400015:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01d9362 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400021:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b9:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.400023:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.400026:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01d9362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400033:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01d9362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400046:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01d9362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400052:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01d9362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400065:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.400071:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.400074:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01d9362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400081:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.400084:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01d9362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400091:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01d9362 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400102:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01d9362 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400109:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01d9362 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400121:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.400128:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.400130:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.400169:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.400174:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9369 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400182:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b8:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.400185:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.400189:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400197:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400204:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400211:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400223:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.400229:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.400233:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400239:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.400242:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400261:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9369 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400271:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9369 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400279:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9369 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400291:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.400293:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.400295:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.400335:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.400340:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3b79680/0xe4e6e89fb01d9370 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400347:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b7:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.400349:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.400353:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b79680/0xe4e6e89fb01d9370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400362:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3b79680/0xe4e6e89fb01d9370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400368:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3b79680/0xe4e6e89fb01d9370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400382:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b79680/0xe4e6e89fb01d9370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400393:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.400400:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.400404:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3b79680/0xe4e6e89fb01d9370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400411:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.400414:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3b79680/0xe4e6e89fb01d9370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400421:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3b79680/0xe4e6e89fb01d9370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400433:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3b79680/0xe4e6e89fb01d9370 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400439:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3b79680/0xe4e6e89fb01d9370 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400464:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.400466:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.400467:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.400509:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.400520:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9377 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400527:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b6:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.400530:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.400534:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400543:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400573:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400580:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400591:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.400597:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.400601:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400607:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.400610:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400618:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400634:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9377 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400642:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9377 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400654:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.400656:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.400657:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.400693:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.400697:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af913952/0xe4e6e89fb01d937e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400705:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b5:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.400708:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.400712:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af913952/0xe4e6e89fb01d937e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400721:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af913952/0xe4e6e89fb01d937e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400728:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af913952/0xe4e6e89fb01d937e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400736:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af913952/0xe4e6e89fb01d937e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400757:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.400762:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.400766:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af913952/0xe4e6e89fb01d937e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400773:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.400776:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af913952/0xe4e6e89fb01d937e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400784:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af913952/0xe4e6e89fb01d937e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400794:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af913952/0xe4e6e89fb01d937e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400801:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af913952/0xe4e6e89fb01d937e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400812:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.400814:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.400815:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.400849:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.400854:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094990c99/0xe4e6e89fb01d9385 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400862:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b4:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.400869:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.400873:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094990c99/0xe4e6e89fb01d9385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400883:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094990c99/0xe4e6e89fb01d9385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400891:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094990c99/0xe4e6e89fb01d9385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400897:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094990c99/0xe4e6e89fb01d9385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400907:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.400913:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.400916:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094990c99/0xe4e6e89fb01d9385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400921:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.400925:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094990c99/0xe4e6e89fb01d9385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400932:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094990c99/0xe4e6e89fb01d9385 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400942:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094990c99/0xe4e6e89fb01d9385 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400958:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094990c99/0xe4e6e89fb01d9385 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.400970:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.400972:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.400973:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.401006:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.401010:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d938c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.401018:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b3:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.401021:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.401025:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d938c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.401034:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d938c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.401041:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d938c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.401048:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d938c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.401058:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872505.401063:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872505.401070:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d938c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.401077:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872505.401080:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d938c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.401087:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d938c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.401097:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d938c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.401104:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d938c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.401117:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.401119:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.401120:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.401152:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.401157:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01d9393 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.401164:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b2:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.401167:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.401171:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01d9393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401387:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872505.401436:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.401442:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9392df5/0xe4e6e89fb01d939a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401460:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b2:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.401463:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.401467:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9392df5/0xe4e6e89fb01d939a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401477:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9392df5/0xe4e6e89fb01d939a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401485:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9392df5/0xe4e6e89fb01d939a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401493:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9392df5/0xe4e6e89fb01d939a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401505:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788872505.401537:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.401541:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce028ae/0xe4e6e89fb01d93a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401560:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b1:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.401568:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.401573:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce028ae/0xe4e6e89fb01d93a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401582:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce028ae/0xe4e6e89fb01d93a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401590:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce028ae/0xe4e6e89fb01d93a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401597:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ce028ae/0xe4e6e89fb01d93a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401608:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788872505.401638:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.401643:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d93a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401650:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b0:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.401652:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.401656:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d93a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401665:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d93a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401672:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d93a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401684:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d93a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401692:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788872505.401718:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.401723:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d93af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401730:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2af:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.401732:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.401736:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d93af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.401745:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d93af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.402314:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d93af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.402324:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d93af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.402334:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788872505.402383:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.402388:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d93b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.402858:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788872505.402866:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d9323 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.402875:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872505.402879:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d9323 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.402888:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d9323 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.402902:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d9323 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.402908:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d9323 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.402940:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788872505.402944:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9392df5/0xe4e6e89fb01d939a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.402950:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9de00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872505.402953:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9392df5/0xe4e6e89fb01d939a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.402960:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9392df5/0xe4e6e89fb01d939a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.402969:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9392df5/0xe4e6e89fb01d939a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.402975:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9392df5/0xe4e6e89fb01d939a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.402987:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788872505.402990:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ce028ae/0xe4e6e89fb01d93a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.402996:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ce00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872505.403000:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce028ae/0xe4e6e89fb01d93a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.403016:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce028ae/0xe4e6e89fb01d93a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.403025:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ce028ae/0xe4e6e89fb01d93a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.403037:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce028ae/0xe4e6e89fb01d93a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.403048:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788872505.403051:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d93a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.403057:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872505.403060:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d93a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.403068:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d93a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.403076:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d93a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.403168:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872505.403174:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d93af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.403181:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ca00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.403192:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d93af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.403199:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d93af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.403210:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d93af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.403217:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d93af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.403230:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.403232:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.403244:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.403257:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.403265:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872505.404044:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ae:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.404048:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.404054:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d93b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.404066:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d93b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.404076:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d93b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.404083:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d93b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872505.404476:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d93a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.404581:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.404584:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.404586:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.408053:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01d9393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408067:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01d9393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408075:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01d9393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408122:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872505.408249:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.408256:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007749c67f/0xe4e6e89fb01d93bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408268:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b1:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.408274:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.408279:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007749c67f/0xe4e6e89fb01d93bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408288:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007749c67f/0xe4e6e89fb01d93bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408295:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007749c67f/0xe4e6e89fb01d93bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408313:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007749c67f/0xe4e6e89fb01d93bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408337:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788872505.408373:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.408378:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000772cb814/0xe4e6e89fb01d93c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408385:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b0:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.408387:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.408391:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000772cb814/0xe4e6e89fb01d93c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408399:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000772cb814/0xe4e6e89fb01d93c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408406:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000772cb814/0xe4e6e89fb01d93c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408413:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000772cb814/0xe4e6e89fb01d93c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408424:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788872505.408465:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.408470:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3c71153/0xe4e6e89fb01d93cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408483:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2af:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.408486:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.408490:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c71153/0xe4e6e89fb01d93cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408498:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3c71153/0xe4e6e89fb01d93cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408505:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3c71153/0xe4e6e89fb01d93cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408512:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c71153/0xe4e6e89fb01d93cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408524:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788872505.408583:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.408587:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85956f2/0xe4e6e89fb01d93d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408593:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ae:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.408596:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.408599:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85956f2/0xe4e6e89fb01d93d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408607:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e85956f2/0xe4e6e89fb01d93d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408622:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85956f2/0xe4e6e89fb01d93d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408628:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e85956f2/0xe4e6e89fb01d93d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408635:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788872505.408666:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.408671:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d93d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408677:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ad:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.408680:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.408684:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d93d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408693:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d93d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408700:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d93d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408707:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d93d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.408725:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788872505.408903:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788872505.408912:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01d9393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.408922:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.408926:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01d9393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.408947:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01d9393 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.408966:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01d9393 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.408973:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01d9393 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409004:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788872505.409007:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007749c67f/0xe4e6e89fb01d93bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409013:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.409016:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007749c67f/0xe4e6e89fb01d93bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409023:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007749c67f/0xe4e6e89fb01d93bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409032:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007749c67f/0xe4e6e89fb01d93bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409038:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007749c67f/0xe4e6e89fb01d93bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409060:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788872505.409064:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000772cb814/0xe4e6e89fb01d93c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409070:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.409073:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000772cb814/0xe4e6e89fb01d93c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409081:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000772cb814/0xe4e6e89fb01d93c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409091:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000772cb814/0xe4e6e89fb01d93c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409098:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000772cb814/0xe4e6e89fb01d93c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409111:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872505.409114:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3c71153/0xe4e6e89fb01d93cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409122:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.409125:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3c71153/0xe4e6e89fb01d93cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409144:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3c71153/0xe4e6e89fb01d93cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409153:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3c71153/0xe4e6e89fb01d93cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409160:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3c71153/0xe4e6e89fb01d93cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409171:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872505.409174:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e85956f2/0xe4e6e89fb01d93d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409179:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.409182:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85956f2/0xe4e6e89fb01d93d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409188:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85956f2/0xe4e6e89fb01d93d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409196:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e85956f2/0xe4e6e89fb01d93d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409203:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e85956f2/0xe4e6e89fb01d93d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409225:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872505.409228:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d93d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409235:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58afe00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.409238:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d93d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409245:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d93d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409256:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d93d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409263:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d93d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.409274:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.409276:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.409278:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.409287:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.409293:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872505.409369:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.409983:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.409992:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01d93e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.410004:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ac:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.410008:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.410014:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01d93e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.410027:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01d93e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.410034:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01d93e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.410041:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01d93e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.410857:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872505.410945:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.410952:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01d93e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.410964:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ab:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.410980:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.410985:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01d93e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.410997:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01d93e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.411006:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01d93e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.411013:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01d93e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413228:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872505.413254:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01d93e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413287:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.413292:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01d93e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413303:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01d93e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413324:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01d93e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413332:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01d93e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413351:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872505.413354:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01d93e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413360:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.413364:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01d93e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413371:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01d93e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413380:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01d93e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413395:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872505.413400:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d93b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413407:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9da00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.413410:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d93b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413416:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d93b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413428:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d93b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.413436:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.413437:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.413439:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.415609:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788872505.415626:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01d93e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.415912:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872505.416000:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.416007:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01d93ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416021:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2aa:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.416026:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.416033:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01d93ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416047:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01d93ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416070:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01d93ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416077:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01d93ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416099:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872505.416145:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.416150:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01d93f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416158:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a9:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.416161:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.416164:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01d93f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416172:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01d93f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416179:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01d93f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416186:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01d93f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416261:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788872505.416304:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.416310:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d93fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416318:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a8:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.416321:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.416325:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d93fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416334:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d93fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416342:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d93fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416349:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d93fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416364:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788872505.416403:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.416408:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01d9403 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416415:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a7:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.416424:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.416429:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01d9403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416437:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01d9403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416445:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01d9403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416463:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01d9403 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416476:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788872505.416522:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.416526:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01d940a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416534:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a6:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.416537:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.416541:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01d940a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416574:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01d940a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416583:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01d940a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416597:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01d940a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416605:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788872505.416644:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.416649:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9411 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416657:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a5:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.416660:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.416664:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9411 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416672:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9411 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416679:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9411 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416687:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9411 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416695:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788872505.416727:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.416732:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01d9418 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416744:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a4:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.416747:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.416771:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01d9418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416781:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01d9418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416790:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01d9418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416797:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01d9418 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416806:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788872505.416845:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872505.416849:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01d941f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416856:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a3:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788872505.416858:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872505.416862:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01d941f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416869:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01d941f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416891:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01d941f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416897:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01d941f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872505.416905:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00080000:0.0:1788872505.416933:0:8438:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00000100:00100000:0.0:1788872505.417043:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:83279:x1875765327585536:12345-0@lo:5:osp-pre-1-0.0 Request processed in 43571us (47153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872505.417053:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5920 00000100:00100000:0.0:1788872505.417106:0:83279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83279:1875765327585536:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788872505.417123:0:83279:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2c1:0x0] from OST, last_created [0x2c0000401:0x2c1:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:0.0:1788872505.417190:0:83279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d013a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83279:1875765327585792:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788872505.417226:0:83279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872505.417250:0:83279:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c665ff00 going to sleep for 20 seconds 00000100:00100000:0.0:1788872505.417266:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d0139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327585664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872505.417289:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872505.417325:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327585792 00000100:00100000:0.0:1788872505.417331:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327585792 00000100:00100000:0.0:1788872505.417364:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5921 00000100:00100000:0.0:1788872505.417371:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:83279:x1875765327585792:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:0.0:1788872505.417377:0:8436:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1788872505.417415:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 706 00010000:00010000:1.0:1788872505.419405:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788872505.419418:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01d93ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419431:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aee00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.419436:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01d93ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419474:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01d93ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419495:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01d93ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419503:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01d93ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419526:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788872505.419530:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01d93f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419537:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.419540:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01d93f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419565:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01d93f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419577:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01d93f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419585:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01d93f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419610:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788872505.419614:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d93fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419621:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aea00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.419624:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d93fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419632:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d93fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419641:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d93fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419647:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d93fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419658:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788872505.419662:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01d9403 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419668:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58afa00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.419671:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01d9403 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419690:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01d9403 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419701:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01d9403 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419709:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01d9403 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419727:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788872505.419730:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01d940a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419737:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.419740:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01d940a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419747:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01d940a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419775:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01d940a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419782:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01d940a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419808:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872505.419812:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9411 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419818:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.419821:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9411 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419828:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9411 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419838:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9411 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419845:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9411 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419857:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872505.419860:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01d9418 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419866:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.419869:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01d9418 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419886:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01d9418 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419897:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01d9418 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419905:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01d9418 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419919:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872505.419923:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01d941f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419930:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.419933:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01d941f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419941:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01d941f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419950:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01d941f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419957:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01d941f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.419981:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.419983:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.419985:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.419996:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.420003:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872505.420044:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327585664 00000100:00100000:1.0:1788872505.420053:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327585664 00000100:00100000:1.0:1788872505.420105:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:1.0:1788872505.420115:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327585664:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:1.0:1788872505.420121:0:24262:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788872505.420142:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8654144 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872505.420225:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327585664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (2934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872505.420246:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00100000:1.0:1788872505.420325:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d0139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327585664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788872505.420888:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872505.420930:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788872505.420939:0:26190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d93b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872505.421078:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.421084:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9426 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421096:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ad:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.421100:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.421106:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9426 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421128:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9426 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421136:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9426 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421142:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9426 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421162:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872505.421199:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.421204:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d942d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421211:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ac:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.421214:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.421218:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d942d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421226:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d942d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.421310:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872505.421316:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9426 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.421323:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.421328:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9426 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.421335:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9426 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.421358:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9426 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.421364:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9426 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.421379:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.421381:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.421382:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872505.421418:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d942d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421435:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d942d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421464:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872505.421508:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.421513:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9434 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421521:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ab:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.421524:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.421529:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9434 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421538:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9434 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421585:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9434 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421594:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9434 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421605:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788872505.421643:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.421648:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d943b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421662:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2aa:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.421665:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.421669:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d943b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421678:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d943b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421686:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d943b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421694:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d943b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.421703:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788872505.421743:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.421747:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc66bda/0xe4e6e89fb01d9442 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.421926:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872505.421932:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d942d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.421940:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.421944:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d942d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.421953:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d942d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.421966:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d942d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.421973:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d942d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.422001:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872505.422005:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9434 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.422011:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.422015:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9434 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.422024:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9434 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.422034:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9434 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.422042:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9434 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.422054:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872505.422057:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d943b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.422063:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.422067:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d943b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.422086:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d943b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.422097:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d943b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.422104:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d943b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.422114:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.422116:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.422118:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.422123:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.422127:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872505.422166:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a9:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.422169:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.422173:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc66bda/0xe4e6e89fb01d9442 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.422182:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fc66bda/0xe4e6e89fb01d9442 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.422199:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc66bda/0xe4e6e89fb01d9442 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.422206:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fc66bda/0xe4e6e89fb01d9442 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.422918:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872505.422985:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.422992:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047495f25/0xe4e6e89fb01d9449 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.423002:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a8:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.423004:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.423008:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047495f25/0xe4e6e89fb01d9449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.423017:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047495f25/0xe4e6e89fb01d9449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.423024:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047495f25/0xe4e6e89fb01d9449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.423031:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047495f25/0xe4e6e89fb01d9449 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872505.423121:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:83279:x1875765327585792:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5745us (5890us total) trans 4294969447 rc 0/0 00000100:00100000:0.0:1788872505.423131:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5921 00000100:00100000:0.0:1788872505.423194:0:83279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d013a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83279:1875765327585792:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788872505.423210:0:83279:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2c1:0x0]-[0x2c0000401:0x2e1:0x0] 00010000:00010000:1.0:1788872505.423922:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872505.423931:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fc66bda/0xe4e6e89fb01d9442 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.423941:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deac00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.423946:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc66bda/0xe4e6e89fb01d9442 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.423954:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc66bda/0xe4e6e89fb01d9442 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.423971:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fc66bda/0xe4e6e89fb01d9442 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.423989:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fc66bda/0xe4e6e89fb01d9442 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.424009:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872505.424013:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047495f25/0xe4e6e89fb01d9449 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.424020:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.424023:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047495f25/0xe4e6e89fb01d9449 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.424030:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047495f25/0xe4e6e89fb01d9449 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.424040:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047495f25/0xe4e6e89fb01d9449 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.424046:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.424048:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.424049:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872505.424097:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788872505.424103:0:26190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047495f25/0xe4e6e89fb01d9449 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872505.424185:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.424190:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cff00f6/0xe4e6e89fb01d9450 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424200:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a7:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.424204:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.424209:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cff00f6/0xe4e6e89fb01d9450 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424218:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cff00f6/0xe4e6e89fb01d9450 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424225:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cff00f6/0xe4e6e89fb01d9450 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424311:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cff00f6/0xe4e6e89fb01d9450 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424367:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872505.424412:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.424417:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004123d2a6/0xe4e6e89fb01d9457 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424432:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a6:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.424435:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.424439:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004123d2a6/0xe4e6e89fb01d9457 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424448:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004123d2a6/0xe4e6e89fb01d9457 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424468:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004123d2a6/0xe4e6e89fb01d9457 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424474:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004123d2a6/0xe4e6e89fb01d9457 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424485:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788872505.424527:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.424531:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ddbbd28/0xe4e6e89fb01d945e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424539:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a5:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.424541:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.424545:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ddbbd28/0xe4e6e89fb01d945e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424575:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ddbbd28/0xe4e6e89fb01d945e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424594:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ddbbd28/0xe4e6e89fb01d945e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424601:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ddbbd28/0xe4e6e89fb01d945e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424609:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788872505.424647:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.424652:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9465 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424660:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a4:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.424663:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.424666:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9465 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424675:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9465 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424683:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9465 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424690:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9465 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424710:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788872505.424745:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.424910:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058949a39/0xe4e6e89fb01d946c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424920:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a3:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.424923:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.424927:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058949a39/0xe4e6e89fb01d946c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424936:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058949a39/0xe4e6e89fb01d946c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424945:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058949a39/0xe4e6e89fb01d946c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424952:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058949a39/0xe4e6e89fb01d946c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.424961:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788872505.424999:0:26190:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872505.425005:0:26190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9473 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.425013:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a2:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788872505.425022:0:26190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872505.425026:0:26190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9473 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.425034:0:26190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9473 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.425041:0:26190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9473 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.425048:0:26190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9473 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872505.425057:0:26190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788872505.425947:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788872505.425957:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cff00f6/0xe4e6e89fb01d9450 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.425968:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deba00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.425981:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cff00f6/0xe4e6e89fb01d9450 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.425991:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cff00f6/0xe4e6e89fb01d9450 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426007:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cff00f6/0xe4e6e89fb01d9450 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426014:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cff00f6/0xe4e6e89fb01d9450 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426038:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788872505.426043:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004123d2a6/0xe4e6e89fb01d9457 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426049:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5dea000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.426052:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004123d2a6/0xe4e6e89fb01d9457 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426059:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004123d2a6/0xe4e6e89fb01d9457 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426067:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004123d2a6/0xe4e6e89fb01d9457 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426074:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004123d2a6/0xe4e6e89fb01d9457 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426097:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788872505.426100:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ddbbd28/0xe4e6e89fb01d945e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426106:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deaa00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.426108:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ddbbd28/0xe4e6e89fb01d945e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426115:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ddbbd28/0xe4e6e89fb01d945e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426124:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ddbbd28/0xe4e6e89fb01d945e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426130:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ddbbd28/0xe4e6e89fb01d945e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426141:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872505.426144:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9465 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426150:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deae00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.426153:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9465 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426175:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9465 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426186:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9465 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426192:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9465 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426205:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872505.426209:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058949a39/0xe4e6e89fb01d946c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426214:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.426218:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058949a39/0xe4e6e89fb01d946c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426224:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058949a39/0xe4e6e89fb01d946c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426245:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058949a39/0xe4e6e89fb01d946c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426252:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058949a39/0xe4e6e89fb01d946c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426277:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872505.426280:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9473 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426286:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5dea800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872505.426289:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9473 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426297:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9473 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426307:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9473 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426313:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9473 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872505.426323:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.426325:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.426327:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872505.426336:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872505.426498:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872505.428052:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788872505.431861:0:26190:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:3.0:1788872505.431971:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eec94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:83277:x1875765327585408:12345-0@lo:5:osp-pre-0-0.0 Request processed in 60566us (64998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872505.431982:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5919 00000100:00100000:0.0:1788872505.432082:0:83277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9eec97800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83277:1875765327585408:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788872505.432100:0:83277:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2c1:0x0] from OST, last_created [0x280000401:0x2c1:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:2.0:1788872505.432192:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327585920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872505.432311:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872505.432387:0:83277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83277:1875765327586048:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788872505.432415:0:83277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872505.432461:0:83277:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c665ff00 going to sleep for 20 seconds 00000100:00100000:0.0:1788872505.432483:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327586048 00000100:00100000:0.0:1788872505.432489:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327586048 00000100:00100000:0.0:1788872505.432532:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5922 00000100:00100000:0.0:1788872505.432540:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:83277:x1875765327586048:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:0.0:1788872505.432568:0:26183:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1788872505.432605:0:26183:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 706 00000100:00100000:3.0:1788872505.432922:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327585920 00000100:00100000:3.0:1788872505.432927:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327585920 00000100:00100000:3.0:1788872505.432952:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:3.0:1788872505.432959:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eec94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327585920:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:3.0:1788872505.432964:0:61068:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788872505.432974:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216384 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872505.434866:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:83277:x1875765327586048:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2320us (2443us total) trans 4294969448 rc 0/0 00000100:00100000:0.0:1788872505.434877:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5922 00000100:00100000:0.0:1788872505.434948:0:83277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83277:1875765327586048:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788872505.434963:0:83277:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2c1:0x0]-[0x280000401:0x2e1:0x0] 00000100:00100000:3.0:1788872505.435588:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eec94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327585920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2626us (3273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872505.435597:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00100000:0.0:1788872505.435871:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327585920:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788872505.595530:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872506.042308:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327586176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872506.042382:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872506.042481:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327586176 00000100:00100000:0.0:1788872506.042502:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327586176 00000100:00100000:0.0:1788872506.042574:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:0.0:1788872506.042582:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327586176:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:0.0:1788872506.042588:0:24262:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788872506.042608:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872506.042669:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327586176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872506.042676:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000100:00100000:3.0:1788872506.042834:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327586176:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788872506.044217:0:23717:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a9eec97480 x1875765327584128/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1788872515 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872506.044327:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eec97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327584128:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1007064us (1007207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872506.044336:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:2.0:1788872506.044449:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327586304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872506.044501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788872506.045215:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1788872506.045224:0:3643:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff98a9eec96a00 x1875765327584128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872535 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872506.045235:0:3643:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff98a9eec96a00 x1875765327584128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872535 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872506.045258:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788872506.045283:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788872506.045851:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327586304 00000100:00100000:0.0:1788872506.045860:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327586304 00000100:00100000:0.0:1788872506.045914:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906 00000100:00100000:0.0:1788872506.045923:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eec97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327586304:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:0.0:1788872506.045930:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788872506.045950:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872506.046021:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eec97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327586304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872506.046027:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906 00000100:00100000:2.0:1788872506.048106:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327586304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872506.048868:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872506.048888:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9eec94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327586432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872506.048956:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872506.048997:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327586432 00000100:00100000:3.0:1788872506.049004:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327586432 00000100:00100000:3.0:1788872506.049052:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:3.0:1788872506.049061:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327586432:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:3.0:1788872506.049067:0:8447:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1788872506.049111:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445113856 avail 1298874368 00000100:00100000:3.0:1788872506.049168:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327586432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872506.049176:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00000100:00100000:3.0:1788872506.049216:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9eec94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327586432:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788872506.070592:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002022a445): req@ffff98a8c5af5880 x1875765327498624/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872320 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872506.070627:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9eec96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327584128:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1788872506.072376:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872506.073035:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327498624 00000100:00100000:1.0:1788872506.073045:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327498624 00000100:00100000:1.0:1788872506.073107:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:1.0:1788872506.073117:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327498624:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:1.0:1788872506.073125:0:30614:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1788872506.073167:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445113856 avail 1298874368 00000100:00100000:1.0:1788872506.073229:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327498624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872506.073235:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:3.0:1788872506.073437:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327498624:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788872506.617694:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872507.641029:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872508.089436:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872508.089473:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327586560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872508.089581:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872508.091741:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327586560 00000100:00100000:2.0:1788872508.091758:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327586560 00000100:00100000:2.0:1788872508.091845:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:2.0:1788872508.091856:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327586560:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:2.0:1788872508.091864:0:8447:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1788872508.091916:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872508.092006:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327586560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (2424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872508.092013:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00100000:1.0:1788872508.092198:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327586560:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788872508.664805:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872509.689382:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872510.136913:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327587072:0@lo:400:kworker.0 00000100:00100000:1.0:1788872510.136988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872510.137021:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327587584:0@lo:400:kworker.0 00000100:00100000:0.0:1788872510.137244:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327586944:0@lo:400:kworker.0 00000100:00100000:0.0:1788872510.137274:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872510.137307:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327587456:0@lo:400:kworker.0 00000100:00100000:0.0:1788872510.137331:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872510.137380:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327587968:0@lo:400:kworker.0 00000100:00100000:0.0:1788872510.137403:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872510.137448:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327587456 00000100:00100000:0.0:1788872510.137455:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327587456 00000100:00100000:0.0:1788872510.137502:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327587968 00000100:00100000:0.0:1788872510.137505:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327587968 00000100:00100000:0.0:1788872510.137538:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00100000:0.0:1788872510.137581:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327587456:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788872510.137589:0:9961:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788872510.137641:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327587456:12345-0@lo:400:kworker.0 Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872510.137648:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000100:00100000:0.0:1788872510.137666:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375 00000100:00100000:0.0:1788872510.137672:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327587968:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788872510.137675:0:9961:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788872510.137703:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327587968:12345-0@lo:400:kworker.0 Request processed in 32us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872510.137709:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375 00000100:00100000:0.0:1788872510.137749:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327587456:0@lo:400:kworker.0 00000100:00100000:0.0:1788872510.137760:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327587968:0@lo:400:kworker.0 00000100:00100000:0.0:1788872510.137864:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327587072 00000100:00100000:0.0:1788872510.137868:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327587072 00000100:00100000:0.0:1788872510.137894:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327586944 00000100:00100000:0.0:1788872510.137896:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327586944 00000100:00100000:0.0:1788872510.137914:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1788872510.137920:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327587072:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788872510.137925:0:66190:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788872510.137967:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327587072:12345-0@lo:400:kworker.0 Request processed in 47us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872510.137975:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1788872510.137988:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:0.0:1788872510.137993:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327586944:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788872510.137996:0:66190:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788872510.138210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872510.138239:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327588096:0@lo:400:kworker.0 00000100:00100000:1.0:1788872510.138263:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872510.138294:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327587072:0@lo:400:kworker.0 00000100:00100000:1.0:1788872510.138319:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327587584 00000100:00100000:1.0:1788872510.138322:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327587584 00000100:00100000:1.0:1788872510.138347:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327588096 00000100:00100000:1.0:1788872510.138351:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327588096 00000100:00100000:1.0:1788872510.138383:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376 00000100:00100000:1.0:1788872510.138390:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327587584:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788872510.138394:0:26188:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788872510.138427:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327587584:12345-0@lo:400:kworker.0 Request processed in 38us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872510.138433:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376 00000100:00100000:1.0:1788872510.138443:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377 00000100:00100000:1.0:1788872510.138449:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327588096:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788872510.138452:0:26188:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788872510.138476:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327588096:12345-0@lo:400:kworker.0 Request processed in 28us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872510.138482:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377 00000100:00100000:1.0:1788872510.138510:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327587584:0@lo:400:kworker.0 00000100:00100000:1.0:1788872510.138520:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327588096:0@lo:400:kworker.0 00000100:00100000:1.0:1788872510.138587:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327586944:0@lo:400:kworker.0 00000100:00100000:0.0:1788872510.138992:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327586944:12345-0@lo:400:kworker.0 Request processed in 37us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872510.139001:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1788872510.139204:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327586688:0@lo:400:kworker.0 00000100:00100000:3.0:1788872510.139249:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872510.139289:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327587200:0@lo:400:kworker.0 00000100:00100000:3.0:1788872510.139316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872510.139341:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327587712:0@lo:400:kworker.0 00000100:00100000:3.0:1788872510.139373:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872510.139395:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d0139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327588224:0@lo:400:kworker.0 00000100:00100000:3.0:1788872510.139431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872510.139452:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788872510.139459:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327586816:0@lo:400:kworker.0 00000100:00100000:3.0:1788872510.139481:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872510.139498:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327587328:0@lo:400:kworker.0 00000100:00100000:3.0:1788872510.139520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872510.139538:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327587840:0@lo:400:kworker.0 00000100:00100000:0.0:1788872510.139868:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327587200 00000100:00100000:0.0:1788872510.139876:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327587200 00000100:00100000:0.0:1788872510.139913:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327587712 00000100:00100000:0.0:1788872510.139916:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327587712 00000100:00100000:0.0:1788872510.139925:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327588224 00000100:00100000:0.0:1788872510.139928:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327588224 00000100:00100000:0.0:1788872510.139936:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327586816 00000100:00100000:0.0:1788872510.139939:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327586816 00000100:00100000:0.0:1788872510.139954:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1788872510.139961:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327587200:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788872510.139967:0:83669:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788872510.140019:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327587200:12345-0@lo:400:kworker.0 Request processed in 58us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872510.140026:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1788872510.140173:0:83264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327586688 00000100:00100000:1.0:1788872510.140177:0:83264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327586688 00000100:00100000:1.0:1788872510.140208:0:83264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788872510.140215:0:83264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327586688:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788872510.140228:0:83264:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788872510.140271:0:83264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327586688:12345-0@lo:400:kworker.0 Request processed in 56us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872510.140278:0:83264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788872510.140385:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788872510.140425:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872510.140426:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327586688:0@lo:400:kworker.0 00000100:00080000:2.0:1788872510.140432:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872510.140437:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788872510.140440:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872510.140449:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327587200:0@lo:400:kworker.0 00000100:00100000:1.0:1788872510.140710:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1788872510.140719:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327587712:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788872510.140723:0:66190:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788872510.140758:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327587712:12345-0@lo:400:kworker.0 Request processed in 41us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872510.140764:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1788872510.140925:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1788872510.140936:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327588224:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788872510.140941:0:66193:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788872510.140973:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327588224:12345-0@lo:400:kworker.0 Request processed in 40us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872510.140979:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1788872510.141013:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1788872510.141021:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327586816:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788872510.141025:0:66190:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788872510.141198:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327586816:12345-0@lo:400:kworker.0 Request processed in 178us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872510.141204:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1788872510.141249:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327587328 00000100:00100000:3.0:1788872510.141255:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327587328 00000100:00100000:3.0:1788872510.141281:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327587840 00000100:00100000:3.0:1788872510.141283:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327587840 00000100:00100000:3.0:1788872510.141303:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:3.0:1788872510.141308:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327587328:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788872510.141312:0:30614:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788872510.141344:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327587328:12345-0@lo:400:kworker.0 Request processed in 36us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872510.141373:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000100:00100000:3.0:1788872510.141387:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:3.0:1788872510.141393:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327587840:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788872510.141397:0:30614:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788872510.141424:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327587840:12345-0@lo:400:kworker.0 Request processed in 31us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872510.141430:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00100000:3.0:1788872510.141462:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327586816:0@lo:400:kworker.0 00000100:00100000:3.0:1788872510.141473:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327587328:0@lo:400:kworker.0 00000100:00100000:3.0:1788872510.141481:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327587840:0@lo:400:kworker.0 00000100:00100000:3.0:1788872510.141493:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327587712:0@lo:400:kworker.0 00000100:00100000:3.0:1788872510.141502:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d0139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327588224:0@lo:400:kworker.0 00000100:00100000:0.0:1788872510.219482:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872510.219540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872510.219611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872510.219642:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872510.219672:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311119360 00000100:00100000:0.0:1788872510.219681:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311119360 00000100:00100000:0.0:1788872510.219754:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2378 00000100:00100000:0.0:1788872510.219764:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311119360:12345-192.168.204.39@tcp:400:kworker.0 00000020:02000000:0.0:1788872510.219790:0:26189:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788872510.219869:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311119360:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 106us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872510.219877:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2378 00000100:00080000:2.0:1788872510.220327:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872510.220353:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311119104 00000100:00100000:2.0:1788872510.220358:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311119104 00000100:00100000:2.0:1788872510.220400:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311119232 00000100:00100000:2.0:1788872510.220403:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311119232 00000100:00100000:2.0:1788872510.220453:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 993 00000100:00100000:2.0:1788872510.220461:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311119232:12345-192.168.204.39@tcp:400:kworker.0 00000020:02000000:2.0:1788872510.220466:0:66193:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788872510.220502:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311119232:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 43us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872510.220508:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 993 00000100:00100000:2.0:1788872510.220522:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1011 00000100:00100000:2.0:1788872510.220526:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875765311119104:12345-192.168.204.39@tcp:38:kworker.0 00000020:02000000:2.0:1788872510.220530:0:66193:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:2.0:1788872510.220578:0:66193:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp t94489280513 exp 0000000000000000 cur 3447 last 0 00000020:00000080:2.0:1788872510.220622:0:66193:0:(genops.c:1406:class_connect()) connect: client 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3, cookie 0xe4e6e89fb01d947a 00000004:00100000:2.0:1788872510.220647:0:66193:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788872510.220669:0:83269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311118976 00000100:00100000:1.0:1788872510.220676:0:83269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311118976 00000100:00100000:1.0:1788872510.220713:0:83269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 152 00000100:00100000:1.0:1788872510.220724:0:83269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311118976:12345-192.168.204.39@tcp:400:kworker.0 00000020:02000000:1.0:1788872510.220729:0:83269:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00080000:2.0:1788872510.220756:0:66193:0:(import.c:65:import_set_state_nolock()) ffff98a9cb5ef800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872510.220764:0:83269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311118976:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 41us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872510.220796:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311119104:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 266us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872510.220803:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1011 00000100:00100000:1.0:1788872510.220867:0:83269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 152 00000100:00080000:2.0:1788872510.220869:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872510.260677:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872510.260971:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311119488 00000100:00100000:1.0:1788872510.260982:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311119488 00000100:00100000:1.0:1788872510.261059:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1012 00000100:00100000:1.0:1788872510.261069:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64086:x1875765311119488:12345-192.168.204.39@tcp:41:lfs.0 00000020:02000000:1.0:1788872510.261077:0:83669:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1788872510.261111:0:83669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872510.261201:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64086:x1875765311119488:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 132us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872510.261208:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1012 00000100:00100000:2.0:1788872510.272721:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872510.273531:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311119616 00000100:00100000:1.0:1788872510.273544:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311119616 00000100:00100000:1.0:1788872510.273635:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5923 00000100:00100000:1.0:1788872510.273645:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eec96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2403:x1875765311119616:12345-192.168.204.39@tcp:8:lfs.0 00000020:02000000:1.0:1788872510.273652:0:26194:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:1.0:1788872510.273687:0:26194:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp t0 exp 0000000000000000 cur 3447 last 0 00000020:00000080:1.0:1788872510.273716:0:26194:0:(genops.c:1406:class_connect()) connect: client 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3, cookie 0xe4e6e89fb01d9481 00002000:00100000:1.0:1788872510.273728:0:26194:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3/ffff98a9e99ab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788872510.273744:0:26194:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788872510.273809:0:26194:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788872510.273841:0:26194:0:(import.c:65:import_set_state_nolock()) ffff98a8c67ef000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872510.273978:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eec96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311119616:12345-192.168.204.39@tcp:8:lfs.0 Request processed in 332us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872510.273987:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5923 00000100:00100000:3.0:1788872510.280234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872510.280390:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311119744 00000100:00100000:0.0:1788872510.280400:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311119744 00000100:00100000:0.0:1788872510.280463:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1907 00000100:00100000:0.0:1788872510.280474:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64086:x1875765311119744:12345-192.168.204.39@tcp:13:lfs.0 00000020:02000000:0.0:1788872510.280480:0:24262:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788872510.280502:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872510.280597:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64086:x1875765311119744:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 125us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872510.280605:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1907 00000100:00100000:2.0:1788872510.282948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872510.283043:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311119872 00000100:00100000:0.0:1788872510.283053:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311119872 00000100:00100000:0.0:1788872510.283112:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1908 00000100:00100000:0.0:1788872510.283123:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eec94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64086:x1875765311119872:12345-192.168.204.39@tcp:13:lfs.0 00000020:02000000:0.0:1788872510.283130:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788872510.283170:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872510.283246:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eec94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64086:x1875765311119872:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 124us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872510.283253:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1908 00000100:00100000:0.0:1788872510.649633:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327588352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872510.649723:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872510.649828:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327588352 00000100:00100000:0.0:1788872510.649848:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327588352 00000100:00100000:0.0:1788872510.649896:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:0.0:1788872510.649906:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327588352:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:0.0:1788872510.649913:0:24262:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788872510.649935:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872510.649982:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327588352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872510.649989:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:0.0:1788872510.650037:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327588352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872510.650101:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327588480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872510.650125:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872510.650707:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327588480 00000100:00100000:3.0:1788872510.650713:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327588480 00000100:00100000:3.0:1788872510.650743:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:3.0:1788872510.650751:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327588480:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:3.0:1788872510.650755:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788872510.650766:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872510.650818:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327588480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872510.650826:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00100000:1.0:1788872510.652433:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327588480:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788872510.658599:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969447 is committed 00000001:00100000:1.0:1788872510.659089:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00080000:1.0:1788872510.659100:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969448 is committed 00010000:00010000:1.0:1788872510.715671:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872511.161032:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327588608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872511.161109:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872511.161226:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327588608 00000100:00100000:0.0:1788872511.161234:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327588608 00000100:00100000:0.0:1788872511.161290:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:0.0:1788872511.161298:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9d0139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327588608:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:0.0:1788872511.161306:0:24262:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788872511.161326:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872511.161858:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9d0139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327588608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 558us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872511.161880:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00100000:2.0:1788872511.162148:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872511.162177:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327588736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872511.162236:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327588608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872511.162245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872511.162293:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327588736 00000100:00100000:2.0:1788872511.162298:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327588736 00000100:00100000:2.0:1788872511.162367:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:2.0:1788872511.162376:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fbfc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327588736:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1788872511.162397:0:30614:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1788872511.162436:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:2.0:1788872511.162488:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fbfc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327588736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872511.169517:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872511.169564:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327588864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872511.169738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872511.169875:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327588736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872511.170029:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327588864 00000100:00100000:1.0:1788872511.170056:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327588864 00000100:00100000:1.0:1788872511.170104:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:1.0:1788872511.170116:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327588864:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:1.0:1788872511.170123:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788872511.170146:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872511.170209:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327588864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872511.170216:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:1.0:1788872511.170251:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327588864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872511.170454:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000001:00100000:2.0:1788872511.676395:0:83259:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00010000:00010000:2.0:1788872511.737389:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872512.329283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872512.331490:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311120000 00000100:00100000:1.0:1788872512.331507:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311120000 00000100:00100000:1.0:1788872512.331604:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1013 00000100:00100000:1.0:1788872512.331695:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:64191:x1875765311120000:12345-192.168.204.39@tcp:101:lfs.0 00000020:02000000:1.0:1788872512.331703:0:66193:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:1.0:1788872512.331724:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872512.331754:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9488 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fadca expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788872512.340698:0:66193:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8619us 00010000:00010000:1.0:1788872512.361158:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01d948f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872512.361183:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01d948f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872512.361199:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01d948f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872512.361264:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788872512.361278:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1788872512.361335:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01d948f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872512.361380:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9488 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadca expref: 7 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872512.361401:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01d948f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadca expref: 6 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872512.361410:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d24aa100) 00010000:00010000:1.0:1788872512.361413:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788872512.361416:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8400, rc 0) 00000100:00100000:1.0:1788872512.361491:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64191:x1875765311120000:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 29801us (32219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872512.361500:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1013 00000100:00100000:2.0:1788872512.371246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872512.371331:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311120128 00000100:00100000:1.0:1788872512.371343:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311120128 00000100:00100000:1.0:1788872512.371406:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1014 00000100:00100000:1.0:1788872512.371416:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64191:x1875765311120128:12345-192.168.204.39@tcp:41:lfs.0 00000020:02000000:1.0:1788872512.371424:0:66190:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1788872512.371460:0:66190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:1.0:1788872512.371673:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64191:x1875765311120128:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 256us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872512.371681:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1014 00000100:00100000:2.0:1788872512.373493:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872512.373611:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311120256 00000100:00100000:1.0:1788872512.373620:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311120256 00000100:00100000:1.0:1788872512.373685:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1015 00000100:00100000:1.0:1788872512.373697:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64191:x1875765311120256:12345-192.168.204.39@tcp:41:lfs.0 00000020:02000000:1.0:1788872512.373722:0:83669:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1788872512.373769:0:83669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872512.373834:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64191:x1875765311120256:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 140us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872512.373842:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1015 00000100:00080000:2.0:1788872512.373983:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872512.384279:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872512.384362:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311120384 00000100:00100000:0.0:1788872512.384383:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311120384 00000100:00100000:0.0:1788872512.384438:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1913 00000100:00100000:0.0:1788872512.384450:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:64191:x1875765311120384:12345-192.168.204.39@tcp:13:lfs.0 00000020:02000000:0.0:1788872512.384475:0:24262:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788872512.384506:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872512.384607:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:64191:x1875765311120384:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 159us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872512.384616:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1913 00000100:00100000:0.0:1788872512.390076:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872512.390358:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311120512 00000100:00100000:1.0:1788872512.390368:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311120512 00000100:00100000:1.0:1788872512.390436:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1914 00000100:00100000:1.0:1788872512.390447:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64191:x1875765311120512:12345-192.168.204.39@tcp:13:lfs.0 00000020:02000000:1.0:1788872512.390454:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788872512.390483:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872512.390589:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64191:x1875765311120512:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 143us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872512.390597:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1914 00000100:00080000:2.0:1788872512.390935:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872512.433877:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872512.433976:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311120640 00000100:00100000:3.0:1788872512.433987:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311120640 00000100:00100000:3.0:1788872512.434051:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1016 00000100:00100000:3.0:1788872512.434062:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:63693:x1875765311120640:12345-192.168.204.39@tcp:101:multiop.0 00000020:02000000:3.0:1788872512.434070:0:66979:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1788872512.434087:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872512.434120:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9496 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fadd1 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434187:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d949d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434202:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d949d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434213:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d949d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434227:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d94a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434249:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d94a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434256:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d94a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434429:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d94ab lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434438:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d94ab lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434445:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d94ab lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872512.434546:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:3.0:1788872512.434649:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1788872512.434698:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d94ab lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434712:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d94ab lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434723:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d949d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434730:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d949d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434736:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d949d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434752:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d949d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434758:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872512.434761:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d949d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434768:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d949d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434780:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d24aa100) 00010000:00010000:3.0:1788872512.434783:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872512.434787:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d949d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.434794:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d949d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.435194:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d94a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.435202:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d94a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.435207:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d94a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.435211:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872512.435214:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d94a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.435231:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d94a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.435241:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff98a8ca779200) 00010000:00010000:3.0:1788872512.435243:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872512.435695:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d94a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.435703:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d94a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.435754:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9496 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadd1 expref: 8 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.435769:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d94ab lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadd1 expref: 7 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872512.435777:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff98a8ca779c00) 00010000:00010000:3.0:1788872512.435779:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788872512.435781:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5deb600, rc 0) 00000100:00100000:3.0:1788872512.436544:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:63693:x1875765311120640:12345-192.168.204.39@tcp:101:multiop.0 Request processed in 2478us (2676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872512.436583:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1016 00010000:00010000:0.0:1788872512.764985:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872513.208728:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327588992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872513.208806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872513.208940:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327588992 00000100:00100000:0.0:1788872513.208949:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327588992 00000100:00100000:0.0:1788872513.209014:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:0.0:1788872513.209024:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327588992:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:0.0:1788872513.209032:0:8447:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1788872513.209065:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:0.0:1788872513.209141:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327588992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872513.209148:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00100000:1.0:1788872513.209336:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327588992:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788872513.790681:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872514.809774:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872515.270002:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327589376:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.270213:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327589120:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.270290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872515.270337:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327589632:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.270365:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872515.270386:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327590144:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.270409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872515.270426:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327590656:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.270463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872515.270490:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788872515.270496:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327589504:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.270529:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872515.270569:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327590016:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.270595:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872515.270614:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327590528:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.270633:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872515.270662:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327589248:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.270685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872515.270703:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327589760:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.270724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872515.270758:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327590272:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.270782:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872515.270819:0:83264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327589120 00000100:00100000:1.0:1788872515.270828:0:83264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327589120 00000100:00100000:1.0:1788872515.270875:0:83264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788872515.270884:0:83264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327589120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.270939:0:83264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327589120:12345-0@lo:400:kworker.0 Request processed in 56us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872515.270945:0:83264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788872515.270982:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327589632 00000100:00100000:1.0:1788872515.270986:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327589632 00000100:00100000:1.0:1788872515.271021:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327590144 00000100:00100000:1.0:1788872515.271024:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327590144 00000100:00100000:1.0:1788872515.271037:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327590656 00000100:00100000:2.0:1788872515.271310:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872515.271326:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327589888:0@lo:400:kworker.0 00000100:00100000:2.0:1788872515.271350:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872515.271368:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327590400:0@lo:400:kworker.0 00000100:00100000:2.0:1788872515.271391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872515.271423:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327589760 00000100:00100000:2.0:1788872515.271427:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327589760 00000100:00100000:2.0:1788872515.271460:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327590272 00000100:00100000:2.0:1788872515.271464:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327590272 00000100:00100000:2.0:1788872515.271484:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:2.0:1788872515.271491:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327589760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872515.271542:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327589760:12345-0@lo:400:kworker.0 Request processed in 52us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872515.271566:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00100000:2.0:1788872515.271584:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:2.0:1788872515.271591:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9d0139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327590272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872515.271620:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9d0139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327590272:12345-0@lo:400:kworker.0 Request processed in 30us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872515.271626:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000100:00100000:1.0:1788872515.271695:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327590656 00000100:00100000:1.0:1788872515.271718:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327589504 00000100:00100000:1.0:1788872515.271721:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327589504 00000100:00100000:1.0:1788872515.271886:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327589248 00000100:00100000:1.0:1788872515.271890:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327589248 00000100:00100000:1.0:1788872515.271903:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327589376 00000100:00100000:1.0:1788872515.271906:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327589376 00000100:00100000:1.0:1788872515.271920:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:1.0:1788872515.271926:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327589632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.271963:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327589632:12345-0@lo:400:kworker.0 Request processed in 37us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872515.271969:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:1.0:1788872515.271982:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1788872515.271988:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327590144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.272295:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327590144:12345-0@lo:400:kworker.0 Request processed in 28us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872515.272303:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1788872515.272318:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1788872515.272325:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327590656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.272359:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327590656:12345-0@lo:400:kworker.0 Request processed in 35us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872515.272365:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1788872515.272376:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1788872515.272381:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327589504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.272408:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327589504:12345-0@lo:400:kworker.0 Request processed in 26us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872515.272413:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1788872515.272435:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:1.0:1788872515.272441:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327589248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.272469:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327589248:12345-0@lo:400:kworker.0 Request processed in 28us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872515.272474:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:1.0:1788872515.272484:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1788872515.272490:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa77f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327589376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.272538:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa77f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327589376:12345-0@lo:400:kworker.0 Request processed in 47us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872515.272544:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1788872515.272603:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327590016 00000100:00100000:1.0:1788872515.272607:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327590016 00000100:00100000:1.0:1788872515.272641:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327590528 00000100:00100000:1.0:1788872515.272644:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327590528 00000100:00100000:1.0:1788872515.272664:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327589888 00000100:00100000:1.0:1788872515.272667:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327589888 00000100:00100000:1.0:1788872515.272683:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327590400 00000100:00100000:1.0:1788872515.272686:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327590400 00000100:00100000:1.0:1788872515.272700:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379 00000100:00100000:1.0:1788872515.272706:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327590016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872515.272880:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:0.0:1788872515.272889:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327590528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872515.272943:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327590528:12345-0@lo:400:kworker.0 Request processed in 56us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872515.272950:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:0.0:1788872515.272964:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381 00000100:00100000:0.0:1788872515.272970:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327589888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872515.273026:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327589888:12345-0@lo:400:kworker.0 Request processed in 49us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872515.273032:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381 00000100:00100000:0.0:1788872515.273223:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382 00000100:00100000:0.0:1788872515.273231:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327590400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872515.273275:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327590400:12345-0@lo:400:kworker.0 Request processed in 35us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872515.273281:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382 00000100:00100000:1.0:1788872515.273863:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327590016:12345-0@lo:400:kworker.0 Request processed in 1154us (3265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872515.273873:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379 00000100:00080000:1.0:1788872515.273917:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872515.273922:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872515.273925:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872515.273927:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872515.273977:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327589248:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.274008:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327589760:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.274032:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327590272:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.274094:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327589504:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.274106:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327590016:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.274116:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969447 gen 2 00000100:00100000:1.0:1788872515.274128:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327590528:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.274138:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327589120:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.274150:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327589632:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.274161:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327590144:0@lo:400:kworker.0 00000100:00100000:1.0:1788872515.274173:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327590656:0@lo:400:kworker.0 00000100:00100000:2.0:1788872515.276399:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327589376:0@lo:400:kworker.0 00000100:00100000:2.0:1788872515.276419:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327589888:0@lo:400:kworker.0 00000100:00100000:2.0:1788872515.276431:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 2 00000100:00100000:2.0:1788872515.276447:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327590400:0@lo:400:kworker.0 00000100:00100000:3.0:1788872515.339541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872515.339613:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872515.339644:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872515.339724:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311121024 00000100:00100000:2.0:1788872515.339734:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311121024 00000100:00100000:2.0:1788872515.339819:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1000 00000100:00100000:2.0:1788872515.339831:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311121024:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872515.339904:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311121024:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 75us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872515.339913:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1000 00000100:00080000:2.0:1788872515.339937:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872515.341686:0:83269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311120768 00000100:00100000:1.0:1788872515.341698:0:83269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311120768 00000100:00100000:1.0:1788872515.341755:0:83269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 154 00000100:00100000:1.0:1788872515.341765:0:83269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311120768:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872515.341836:0:83269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311120768:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 72us (2306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872515.341844:0:83269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 154 00000100:00100000:2.0:1788872515.344468:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872515.344513:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872515.344568:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311120896 00000100:00100000:1.0:1788872515.344577:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311120896 00000100:00100000:1.0:1788872515.344636:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1001 00000100:00100000:1.0:1788872515.344655:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311120896:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872515.344744:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311120896:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 99us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872515.344752:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1001 00000100:00100000:0.0:1788872515.347712:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311121280 00000100:00100000:0.0:1788872515.347728:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311121280 00000100:00100000:0.0:1788872515.347868:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2383 00000100:00100000:0.0:1788872515.347878:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311121280:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872515.347960:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311121280:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 82us (8314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872515.347967:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2383 00000100:00100000:2.0:1788872515.349715:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311121152 00000100:00100000:2.0:1788872515.349725:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311121152 00000100:00100000:2.0:1788872515.349793:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2384 00000100:00100000:2.0:1788872515.349803:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311121152:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872515.349881:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311121152:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 78us (5365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872515.349888:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2384 00000100:00080000:3.0:1788872515.353120:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872515.710442:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872515.710532:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311121536 00000100:00100000:1.0:1788872515.710542:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311121536 00000100:00100000:1.0:1788872515.710644:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1017 00000100:00100000:1.0:1788872515.710656:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:64309:x1875765311121536:12345-192.168.204.39@tcp:36:rm.0 00010000:00010000:1.0:1788872515.710760:0:66193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788872515.710791:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d94ab lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadd1 expref: 7 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.710809:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff98a8ca779c00) 00010000:00010000:1.0:1788872515.710836:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01d948f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadca expref: 6 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.710847:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d24aa100) 00010000:00010000:1.0:1788872515.710854:0:66193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872515.710877:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d94b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.710999:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d94b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711010:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d94b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711025:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711115:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711124:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711211:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d94c0 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711219:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d94c0 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711226:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d94c0 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788872515.711495:0:66193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].2, 64 off8320 00000004:00080000:1.0:1788872515.711507:0:66193:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3452837956695ns, next at 3453837953445ns, rc = 0 00010000:00010000:1.0:1788872515.711589:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d94c7 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711598:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d94c7 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711605:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d94c7 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711612:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d94c7 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711617:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d94c7 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711633:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d94c7 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711655:0:66193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872515.711687:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d94c0 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711694:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d94c0 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711700:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d94c0 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711706:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872515.711713:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d94c0 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711720:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d94c0 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711729:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff98a9d24aab00) 00010000:00010000:1.0:1788872515.711732:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788872515.711736:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d94c0 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711742:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d94c0 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711760:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d94b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711766:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d94b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711778:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d94b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711783:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d94b2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711788:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872515.711791:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d94b2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711797:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d94b2 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711805:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d24aa300) 00010000:00010000:1.0:1788872515.711808:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872515.711811:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d94b2 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.711816:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d94b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872515.712587:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872515.712597:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d94c7 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872515.712605:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872515.712609:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d94c7 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872515.712615:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d94c7 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872515.712627:0:14981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff98a9d24aab00) 00010000:00010000:0.0:1788872515.712630:0:14981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788872515.712633:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d94c7 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872515.712649:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d94c7 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872515.712700:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000acf07bf7 reply state 0000000057b8810f transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.712713:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872515.712720:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff98a9d24aa400) 00010000:00010000:1.0:1788872515.712722:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872515.712725:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872515.712824:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:64309:x1875765311121536:12345-192.168.204.39@tcp:36:rm.0 Request processed in 2167us (2387us total) trans 98784247809 rc 0/0 00000100:00100000:1.0:1788872515.712850:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1017 00000100:00080000:2.0:1788872515.713561:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788872515.719843:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872515.719852:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872515.719855:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872515.774963:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327590784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872515.775036:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872515.775090:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327590784 00000100:00100000:1.0:1788872515.775097:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327590784 00000100:00080000:2.0:1788872515.775138:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872515.775356:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:1.0:1788872515.775371:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9d013bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327590784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872515.775494:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872515.777035:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9d013bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327590784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1664us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872515.777046:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:0.0:1788872515.777696:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d0138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327590912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872515.777738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872515.777809:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327590912 00000100:00100000:0.0:1788872515.777816:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327590912 00000100:00100000:0.0:1788872515.777854:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:0.0:1788872515.777861:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327590912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872515.777886:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872515.777920:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327590912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872515.777925:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00080000:0.0:1788872515.777942:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872515.777973:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d0138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327590912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872515.779159:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327590784:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788872515.832748:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872516.280920:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327591168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872516.281001:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872516.281049:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872516.281056:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327591040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872516.281082:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872516.281164:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327591040 00000100:00100000:0.0:1788872516.281172:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327591040 00000100:00100000:0.0:1788872516.281220:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:0.0:1788872516.281230:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327591040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872516.281288:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:0.0:1788872516.281369:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327591040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872516.281375:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00100000:1.0:1788872516.281621:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327591040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872516.281723:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327591168 00000100:00100000:2.0:1788872516.281729:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327591168 00000100:00100000:2.0:1788872516.281779:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:2.0:1788872516.281794:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327591168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872516.281809:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872516.281852:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327591168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872516.281858:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:2.0:1788872516.281894:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327591168:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788872516.281994:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872516.282201:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872516.282214:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327591296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872516.282265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872516.282429:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327591296 00000100:00100000:3.0:1788872516.282434:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327591296 00000100:00100000:3.0:1788872516.282483:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:3.0:1788872516.282491:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327591296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872516.282503:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872516.282539:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327591296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872516.282545:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:3.0:1788872516.282601:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327591296:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788872516.284867:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788872516.857023:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872517.880740:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872518.328935:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327591424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872518.329029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872518.329181:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327591424 00000100:00100000:0.0:1788872518.329190:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327591424 00000100:00100000:0.0:1788872518.329261:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00000100:00100000:0.0:1788872518.329271:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327591424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788872518.329310:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:0.0:1788872518.329382:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327591424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872518.329389:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00000100:00100000:0.0:1788872518.329436:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327591424:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788872518.904721:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872519.928938:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872520.381388:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d0139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327591552:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.381497:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.381537:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327592064:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.381583:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.381603:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327592576:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.381816:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.381837:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327593088:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.381861:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.381885:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788872520.381892:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d0138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327591680:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.381914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.381964:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d0138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327592192:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.382008:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.382029:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327592704:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.382050:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.382084:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d013aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327591808:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.382110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.382128:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327592320:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.382179:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.382199:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327592832:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.382220:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.382241:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788872520.382248:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d013b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327591936:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.382269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.382285:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327592448:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.382306:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.382323:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327592960:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.382343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.382376:0:83264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327591552 00000100:00100000:1.0:1788872520.382384:0:83264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327591552 00000100:00100000:1.0:1788872520.382431:0:83264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788872520.382439:0:83264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327591552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.383101:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327592064 00000100:00100000:0.0:1788872520.383109:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327592064 00000100:00100000:0.0:1788872520.383152:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327592576 00000100:00100000:0.0:1788872520.383155:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327592576 00000100:00100000:0.0:1788872520.383178:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327593088 00000100:00100000:0.0:1788872520.383181:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327593088 00000100:00100000:0.0:1788872520.383194:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1788872520.383202:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327592064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872520.387668:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327591680 00000100:00100000:3.0:1788872520.387687:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327591680 00000100:00100000:3.0:1788872520.387771:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327591808 00000100:00100000:3.0:1788872520.387774:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327591808 00000100:00100000:3.0:1788872520.387788:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327591936 00000100:00100000:3.0:1788872520.387791:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327591936 00000100:00100000:3.0:1788872520.387813:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1788872520.387824:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327592576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.394479:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327592064:12345-0@lo:400:kworker.0 Request processed in 11265us (12882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.394500:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1788872520.394540:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1788872520.394583:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327593088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.394674:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327593088:12345-0@lo:400:kworker.0 Request processed in 95us (12813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.394681:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1788872520.394693:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1788872520.394701:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327591680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.394735:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327591680:12345-0@lo:400:kworker.0 Request processed in 36us (12820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.394741:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1788872520.394754:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1788872520.394760:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327591808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.394800:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327591808:12345-0@lo:400:kworker.0 Request processed in 40us (12688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.394806:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1788872520.394818:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1788872520.394825:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327591936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.394857:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327591936:12345-0@lo:400:kworker.0 Request processed in 32us (12587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.394863:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1788872520.394894:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327592192 00000100:00100000:0.0:1788872520.394902:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327592192 00000100:00100000:0.0:1788872520.394940:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327592704 00000100:00100000:0.0:1788872520.394943:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327592704 00000100:00100000:0.0:1788872520.395385:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:0.0:1788872520.395394:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327592192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.395437:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327592192:12345-0@lo:400:kworker.0 Request processed in 45us (13429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.395451:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000100:00100000:0.0:1788872520.395464:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:0.0:1788872520.395469:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327592704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.395503:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327592704:12345-0@lo:400:kworker.0 Request processed in 34us (13453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.395511:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00000100:00080000:0.0:1788872520.395544:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872520.395576:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872520.395771:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327592320 00000100:00100000:0.0:1788872520.395776:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327592320 00000100:00100000:0.0:1788872520.395871:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327592832 00000100:00100000:0.0:1788872520.395875:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327592832 00000100:00100000:0.0:1788872520.395893:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327592448 00000100:00100000:0.0:1788872520.395896:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327592448 00000100:00100000:0.0:1788872520.395925:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327592960 00000100:00100000:0.0:1788872520.395928:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327592960 00000100:00100000:0.0:1788872520.395947:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385 00000100:00100000:0.0:1788872520.396323:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327592320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.396381:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327592320:12345-0@lo:400:kworker.0 Request processed in 428us (14211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.396387:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385 00000100:00100000:0.0:1788872520.396401:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:0.0:1788872520.396407:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327592832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.396437:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327592832:12345-0@lo:400:kworker.0 Request processed in 30us (14215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.396443:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00100000:0.0:1788872520.396453:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387 00000100:00100000:0.0:1788872520.396469:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f544c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327592448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.396502:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f544c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327592448:12345-0@lo:400:kworker.0 Request processed in 34us (14195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.396508:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387 00000100:00100000:0.0:1788872520.396519:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388 00000100:00100000:0.0:1788872520.396525:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327592960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.396581:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327592960:12345-0@lo:400:kworker.0 Request processed in 56us (14236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.396586:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388 00000100:00080000:0.0:1788872520.398094:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872520.398103:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872520.398197:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d0138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327591680:0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.398213:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d0138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327592192:0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.398224:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327592704:0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.398235:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327592064:0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.398247:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327593088:0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.398303:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d013b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327591936:0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.398315:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327592448:0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.398324:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327592960:0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.398334:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d013aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327591808:0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.398344:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327592320:0@lo:400:kworker.0 00000100:00100000:0.0:1788872520.398367:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327592832:0@lo:400:kworker.0 00000100:00100000:1.0:1788872520.407486:0:83264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327591552:12345-0@lo:400:kworker.0 Request processed in 25036us (25978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872520.407504:0:83264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788872520.407660:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d0139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327591552:0@lo:400:kworker.0 00000100:00100000:3.0:1788872520.410291:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327592576:12345-0@lo:400:kworker.0 Request processed in 22460us (28465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872520.410321:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1788872520.410461:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327592576:0@lo:400:kworker.0 00000100:00100000:3.0:1788872520.457851:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872520.457908:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872520.457943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872520.457978:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872520.458003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872520.458080:0:83269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311121664 00000100:00100000:2.0:1788872520.458092:0:83269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311121664 00000100:00100000:2.0:1788872520.458180:0:83269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 156 00000100:00100000:2.0:1788872520.458191:0:83269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311121664:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872520.458272:0:83269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311121664:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 83us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872520.458279:0:83269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 156 00000100:00100000:0.0:1788872520.460138:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311121920 00000100:00100000:0.0:1788872520.460151:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311121920 00000100:00100000:0.0:1788872520.460477:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311121792 00000100:00100000:0.0:1788872520.460482:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311121792 00000100:00100000:0.0:1788872520.460514:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1008 00000100:00100000:0.0:1788872520.460524:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311121920:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872520.460669:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311121920:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 146us (2760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.460677:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1008 00000100:00100000:0.0:1788872520.460695:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1009 00000100:00100000:0.0:1788872520.460701:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311121792:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872520.460727:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311121792:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 26us (2748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.460733:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1009 00000100:00100000:0.0:1788872520.460754:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311122176 00000100:00100000:0.0:1788872520.460758:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311122176 00000100:00100000:0.0:1788872520.460785:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311122048 00000100:00100000:0.0:1788872520.460788:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311122048 00000100:00100000:0.0:1788872520.460811:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2389 00000100:00100000:0.0:1788872520.460818:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311122176:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872520.460843:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311122176:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.460849:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2389 00000100:00100000:0.0:1788872520.460871:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2390 00000100:00100000:0.0:1788872520.460876:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311122048:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872520.460902:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311122048:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 26us (2898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872520.460909:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2390 00000100:00080000:2.0:1788872520.465929:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872520.465939:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872520.465943:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788872520.465946:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788872520.888917:0:83279:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3458015365136ns, next at 3459015362496ns, rc = 0 00000100:00100000:1.0:1788872520.888947:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872520.888968:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327593216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872520.889050:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872520.893945:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327593216 00000100:00100000:3.0:1788872520.893967:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327593216 00000100:00100000:3.0:1788872520.894111:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:3.0:1788872520.894122:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327593216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872520.894168:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872520.894261:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327593216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (5211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872520.894269:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00100000:0.0:1788872520.895843:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327593216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872520.901657:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872520.901686:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327593344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872520.901788:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872520.901840:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327593344 00000100:00100000:1.0:1788872520.901848:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327593344 00000100:00100000:1.0:1788872520.901895:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:1.0:1788872520.901904:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327593344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872520.901934:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000004:00080000:3.0:1788872520.903142:0:83259:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788872520.903186:0:83259:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247809 is committed 00000004:00080000:3.0:1788872520.903191:0:83259:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788872520.903217:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872520.903229:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872520.903237:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872520.903244:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872520.903249:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872520.903263:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872520.903280:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff98a9d24aa400) 00010000:00010000:3.0:1788872520.903284:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872520.903288:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94b9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872520.903295:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94b9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872520.903519:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872520.903532:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327593472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788872520.903618:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872520.903686:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327593472 00000100:00100000:0.0:1788872520.903692:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327593472 00000100:00100000:0.0:1788872520.903728:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5924 00000100:00100000:0.0:1788872520.903735:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327593472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788872520.903760:0:14545:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:674 count 1 00010000:00010000:0.0:1788872520.903781:0:14545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.903800:0:14545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d906e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fada7 expref: 5 pid: 26192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.903809:0:14545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=219s v=(0 0) 00010000:00010000:0.0:1788872520.903813:0:14545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872520.903819:0:14545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.903844:0:14545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d906e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fada7 expref: 5 pid: 26192 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.903865:0:14545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d906e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fada7 expref: 5 pid: 26192 timeout: 3558 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872520.903877:0:14545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14545:1875765327593600:192.168.204.39@tcp:104: 00000100:00100000:0.0:1788872520.903931:0:14545:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9eedbc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788872520.905110:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327593344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3198us (3314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872520.905121:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00100000:0.0:1788872520.905597:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327593344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872520.914210:0:14545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14545:1875765327593600:192.168.204.39@tcp:104: 00010000:00010000:0.0:1788872520.914245:0:14545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872520.926339:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872520.930024:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311122304 00000100:00100000:2.0:1788872520.930039:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311122304 00010000:00010000:2.0:1788872520.930088:0:26198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d906e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fada7 expref: 6 pid: 26192 timeout: 3558 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872520.930133:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2549 00000100:00100000:2.0:1788872520.930145:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311122304:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788872520.931739:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872520.931759:0:26198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d906e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fada7 expref: 6 pid: 26192 timeout: 3558 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872520.931844:0:26198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d906e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fada7 expref: 6 pid: 26192 timeout: 3558 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872520.931874:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d906e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fada7 expref: 6 pid: 26192 timeout: 3558 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872520.931892:0:26198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872520.931897:0:26198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872520.931903:0:26198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872520.931913:0:26198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872520.931969:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872520.932035:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311122304:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 1891us (5706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872520.932045:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2549 00010000:00010000:0.0:1788872520.932235:0:14545:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.932246:0:14545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.932257:0:14545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.932265:0:14545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.932297:0:14545:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788872520.932534:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327593472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28798us (28915us total) trans 4294969448 rc 0/0 00000100:00100000:0.0:1788872520.932544:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5924 00010000:00010000:0.0:1788872520.932587:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872520.932594:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.932603:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aea00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872520.932607:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.932616:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.932630:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.932638:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01d94ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872520.932655:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872520.932657:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872520.932658:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788872520.936094:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98a9f5b36680/2, rc 0, transno 4294969448 00000100:00100000:2.0:1788872520.936115:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327593472:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788872520.955623:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872521.400880:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327593728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872521.400988:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872521.401040:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872521.401047:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327593856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872521.401080:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872521.401238:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327593728 00000100:00100000:0.0:1788872521.401263:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327593728 00000100:00100000:0.0:1788872521.401323:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:0.0:1788872521.401333:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327593728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872521.401372:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:0.0:1788872521.401447:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327593728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872521.401455:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00000100:00100000:1.0:1788872521.401713:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327593728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872521.403241:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872521.403266:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327593984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872521.403340:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872521.403437:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327593856 00000100:00100000:0.0:1788872521.403446:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327593856 00000100:00100000:0.0:1788872521.403495:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327593984 00000100:00100000:0.0:1788872521.403498:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327593984 00000100:00100000:0.0:1788872521.403518:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:0.0:1788872521.403526:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327593856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872521.403643:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872521.403658:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:2.0:1788872521.403674:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327593984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872521.403687:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872521.404051:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327593856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 524us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872521.404059:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:1.0:1788872521.404128:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327593856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872521.410108:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327593984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6432us (6756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872521.410125:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:1.0:1788872521.410715:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327593984:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788872521.977288:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872523.000966:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788872523.381381:0:84004:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 09:02:02 (1788872522) 00000100:00100000:3.0:1788872523.448981:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872523.449009:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327594112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872523.449141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872523.451276:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327594112 00000100:00100000:0.0:1788872523.451301:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327594112 00000100:00100000:0.0:1788872523.452339:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:0.0:1788872523.452358:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327594112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788872523.452438:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:0.0:1788872523.452610:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327594112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 248us (3457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872523.452619:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00000100:00100000:2.0:1788872523.452635:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327594112:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788872524.024977:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788872524.736869:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969448 is committed 00000100:00100000:0.0:1788872524.787206:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872524.787319:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311122432 00000100:00100000:3.0:1788872524.787331:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311122432 00000100:00100000:3.0:1788872524.787430:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1018 00000100:00100000:3.0:1788872524.787443:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:64898:x1875765311122432:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872524.787469:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872524.787497:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d94d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fadd8 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872524.787621:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d94dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872524.787637:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d94dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872524.787665:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d94dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872524.787713:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872524.787718:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1788872524.787740:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d94dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788872524.787879:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788872524.788061:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d94d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadd8 expref: 7 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872524.788083:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d94dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadd8 expref: 6 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872524.788104:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a8ca779900) 00010000:00010000:3.0:1788872524.788107:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872524.788112:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5debc00, rc 0) 00000100:00100000:3.0:1788872524.788185:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64898:x1875765311122432:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 745us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872524.788193:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1018 00000100:00100000:3.0:1788872524.792679:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872524.792956:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311122560 00000100:00100000:1.0:1788872524.792968:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311122560 00000100:00100000:1.0:1788872524.793115:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1019 00000100:00100000:1.0:1788872524.793125:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64898:x1875765311122560:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:1.0:1788872524.793165:0:66979:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:1.0:1788872524.793242:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64898:x1875765311122560:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 118us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872524.793250:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1019 00000100:00100000:0.0:1788872524.796242:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872524.796344:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311122688 00000100:00100000:2.0:1788872524.796355:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311122688 00000100:00100000:2.0:1788872524.796436:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1020 00000100:00100000:2.0:1788872524.796455:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64898:x1875765311122688:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:2.0:1788872524.796504:0:68674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872524.796906:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64898:x1875765311122688:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 459us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872524.796914:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1020 00000100:00080000:0.0:1788872524.797245:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872524.800286:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872524.800380:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311122816 00000100:00100000:0.0:1788872524.800391:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311122816 00000100:00100000:0.0:1788872524.800463:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1923 00000100:00100000:0.0:1788872524.800474:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:64898:x1875765311122816:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:0.0:1788872524.800512:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872524.800608:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:64898:x1875765311122816:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 134us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872524.800615:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1923 00000100:00080000:3.0:1788872524.801494:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872524.806592:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872524.806823:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311122944 00000100:00100000:1.0:1788872524.806835:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311122944 00000100:00100000:1.0:1788872524.806906:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1924 00000100:00100000:1.0:1788872524.806917:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:64898:x1875765311122944:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:1.0:1788872524.806951:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788872524.806977:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872524.807020:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:64898:x1875765311122944:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 104us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872524.807027:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1924 00000100:00100000:0.0:1788872524.870752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872524.872531:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311123072 00000100:00100000:2.0:1788872524.872563:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311123072 00000100:00100000:1.0:1788872524.873143:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 12 00000100:00100000:1.0:1788872524.873157:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64905:x1875765311123072:12345-192.168.204.39@tcp:700:mcreate.0 00000100:00100000:1.0:1788872524.873268:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64905:x1875765311123072:12345-192.168.204.39@tcp:700:mcreate.0 Request processed in 114us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872524.873277:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 12 00000100:00100000:2.0:1788872524.876402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872524.876442:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311123328 00000100:00100000:2.0:1788872524.876453:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311123328 00000100:00100000:2.0:1788872524.876513:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1021 00000100:00100000:2.0:1788872524.876524:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64905:x1875765311123328:12345-192.168.204.39@tcp:36:mcreate.0 00010000:00010000:2.0:1788872524.876841:0:66192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872524.876941:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d94dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadd8 expref: 6 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.876959:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a8ca779900) 00010000:00010000:2.0:1788872524.876972:0:66192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872524.877156:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01d94e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.877170:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01d94e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.877180:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01d94e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.877192:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01d94ea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.877199:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01d94ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.877206:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01d94ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.878216:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01d94e3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.878241:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01d94e3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.878248:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01d94e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.878254:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01d94e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.878260:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872524.878265:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01d94e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.878272:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01d94e3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.878284:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c5d37e00) 00010000:00010000:2.0:1788872524.878286:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872524.878290:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01d94e3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.878295:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01d94e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872524.878312:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000018099aac reply state 00000000fc012df9 transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01d94ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.878322:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01d94ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.878328:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5d37600) 00010000:00010000:2.0:1788872524.878336:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872524.878339:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872524.878449:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:64905:x1875765311123328:12345-192.168.204.39@tcp:36:mcreate.0 Request processed in 1923us (2053us total) trans 98784247810 rc 0/0 00000100:00100000:2.0:1788872524.878457:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1021 00000100:00100000:1.0:1788872524.901497:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872524.901644:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311123456 00000100:00100000:0.0:1788872524.901658:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311123456 00000100:00100000:0.0:1788872524.901824:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1022 00000100:00100000:0.0:1788872524.901836:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:64908:x1875765311123456:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:0.0:1788872524.901858:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872524.901882:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d94f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faddf expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.901957:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01d94f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.901971:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01d94f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.901984:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01d94f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872524.902050:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788872524.902055:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1788872524.902078:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01d94f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.902115:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d94f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faddf expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.902135:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01d94f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faddf expref: 8 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.902144:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c77cdd00) 00010000:00010000:0.0:1788872524.902147:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788872524.902151:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58ae400, rc 0) 00000100:00100000:0.0:1788872524.902220:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:64908:x1875765311123456:12345-192.168.204.39@tcp:101:rm.0 Request processed in 387us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872524.902227:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1022 00000100:00100000:0.0:1788872524.904399:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872524.904500:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311123584 00000100:00100000:1.0:1788872524.904511:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311123584 00000100:00100000:1.0:1788872524.904731:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1023 00000100:00100000:1.0:1788872524.904743:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:64908:x1875765311123584:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:1.0:1788872524.904765:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872524.904789:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fade6 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.904858:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9506 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.904884:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9506 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.904896:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9506 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.904909:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d950d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.904917:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d950d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.904924:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d950d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905027:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d9514 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905037:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d9514 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905055:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d9514 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872524.905114:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x1:0x0]: returning size 0 00000004:00200000:1.0:1788872524.905119:0:66190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1788872524.905138:0:66190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d9514 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905152:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d9514 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905161:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9506 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905168:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9506 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905175:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9506 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905182:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9506 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905188:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872524.905192:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9506 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905199:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9506 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905211:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c77cdd00) 00010000:00010000:1.0:1788872524.905214:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872524.905224:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9506 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905231:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9506 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905243:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d950d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905249:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d950d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905254:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d950d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905260:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872524.905263:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d950d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905269:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d950d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905277:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5d37600) 00010000:00010000:1.0:1788872524.905279:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872524.905282:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d950d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905288:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d950d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905313:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01d94ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fade6 expref: 10 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905339:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d9514 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fade6 expref: 9 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872524.905346:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff98a9d24aa300) 00010000:00010000:1.0:1788872524.905349:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872524.905351:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8c00, rc 0) 00000100:00100000:1.0:1788872524.905421:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:64908:x1875765311123584:12345-192.168.204.39@tcp:101:rm.0 Request processed in 681us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872524.905429:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1023 00000100:00100000:1.0:1788872524.912251:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872524.912511:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311123840 00000100:00100000:0.0:1788872524.912521:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311123840 00000100:00100000:0.0:1788872524.912598:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1024 00000100:00100000:0.0:1788872524.912610:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:64908:x1875765311123840:12345-192.168.204.39@tcp:36:rm.0 00010000:00010000:0.0:1788872524.912673:0:66192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788872524.912702:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01d9514 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fade6 expref: 9 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.912720:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff98a9d24aa300) 00010000:00010000:0.0:1788872524.912745:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01d94f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faddf expref: 8 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.912755:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c77cdd00) 00010000:00010000:0.0:1788872524.912761:0:66192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872524.912798:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d951b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.912811:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d951b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.912820:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d951b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.912831:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9522 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.912837:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9522 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.912843:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9522 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.912977:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01d9529 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.912987:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01d9529 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.912993:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01d9529 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913201:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01d9530 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913216:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01d9530 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913224:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01d9530 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913231:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01d9530 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913237:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01d9530 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913244:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01d9530 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913263:0:66192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872524.913280:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01d9529 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913287:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01d9529 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913292:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01d9529 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913298:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872524.913302:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01d9529 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913309:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01d9529 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913328:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff98a9c77cd200) 00010000:00010000:0.0:1788872524.913330:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788872524.913334:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01d9529 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913340:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01d9529 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913358:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d951b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913364:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d951b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913371:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d951b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913376:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d951b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913381:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872524.913384:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d951b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913390:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d951b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913397:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c77cda00) 00010000:00010000:0.0:1788872524.913399:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872524.913402:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d951b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913415:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01d951b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872524.913428:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000732b8570 reply state 00000000d91b398d transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9522 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913439:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9522 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872524.913446:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5d37600) 00010000:00010000:0.0:1788872524.913448:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872524.913451:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788872524.913530:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:64908:x1875765311123840:12345-192.168.204.39@tcp:36:rm.0 Request processed in 921us (1289us total) trans 98784247811 rc 0/0 00000100:00100000:0.0:1788872524.913538:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1024 00010000:00010000:2.0:1788872524.915326:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872524.915338:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01d9530 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.915349:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aee00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872524.915354:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01d9530 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.915362:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01d9530 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.915378:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff98a9c77cd200) 00010000:00010000:2.0:1788872524.915381:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788872524.915385:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01d9530 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.915391:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01d9530 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872524.915410:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872524.915412:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872524.915414:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872525.048960:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872525.512378:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327594240:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.512459:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872525.512508:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327594752:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.512536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872525.512590:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d013aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327595264:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.512614:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872525.512693:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d0138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327595776:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.512720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872525.512749:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788872525.512757:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327594368:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.512782:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872525.512800:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327594880:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.512840:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872525.512872:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d013b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327595392:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.512895:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872525.513136:0:83265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327594240 00000100:00100000:1.0:1788872525.513148:0:83265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327594240 00000100:00100000:1.0:1788872525.514065:0:83265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788872525.514088:0:83265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327594240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872525.514487:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327594496:0@lo:400:kworker.0 00000100:00100000:2.0:1788872525.515847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872525.515956:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327595008:0@lo:400:kworker.0 00000100:00100000:2.0:1788872525.515997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872525.516020:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327595520:0@lo:400:kworker.0 00000100:00100000:2.0:1788872525.516046:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872525.516157:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788872525.516165:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327594624:0@lo:400:kworker.0 00000100:00100000:2.0:1788872525.516189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872525.516207:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d0139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327595136:0@lo:400:kworker.0 00000100:00100000:2.0:1788872525.516227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872525.516242:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d0138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327595648:0@lo:400:kworker.0 00000100:00100000:2.0:1788872525.516268:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872525.516302:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327594752 00000100:00100000:2.0:1788872525.516309:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327594752 00000100:00100000:2.0:1788872525.516363:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327595264 00000100:00100000:2.0:1788872525.516367:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327595264 00000100:00100000:0.0:1788872525.516381:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327595008 00000100:00100000:0.0:1788872525.516384:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327595008 00000100:00100000:2.0:1788872525.516385:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327595776 00000100:00100000:2.0:1788872525.516387:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327595776 00000100:00100000:2.0:1788872525.516396:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327594368 00000100:00100000:2.0:1788872525.516398:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327594368 00000100:00100000:2.0:1788872525.516408:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327594496 00000100:00100000:2.0:1788872525.516410:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327594496 00000100:00100000:0.0:1788872525.516410:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327595520 00000100:00100000:0.0:1788872525.516412:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327595520 00000100:00100000:2.0:1788872525.516422:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327594624 00000100:00100000:2.0:1788872525.516424:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327594624 00000100:00100000:0.0:1788872525.516426:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327595136 00000100:00100000:0.0:1788872525.516429:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327595136 00000100:00100000:2.0:1788872525.516439:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1788872525.516442:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327595648 00000100:00100000:0.0:1788872525.516444:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327595648 00000100:00100000:2.0:1788872525.516446:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327594752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872525.516459:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00100000:0.0:1788872525.516464:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eec96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327595008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872525.516494:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327594752:12345-0@lo:400:kworker.0 Request processed in 48us (3957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872525.516501:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1788872525.516513:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eec96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327595008:12345-0@lo:400:kworker.0 Request processed in 49us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872525.516517:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1788872525.516519:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00100000:2.0:1788872525.516531:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327595264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872525.516536:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392 00000100:00100000:0.0:1788872525.516541:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eec97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327595520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872525.516591:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eec97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327595520:12345-0@lo:400:kworker.0 Request processed in 48us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872525.516597:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392 00000100:00100000:0.0:1788872525.516608:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393 00000100:00100000:0.0:1788872525.516614:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327595136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872525.516644:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327595136:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872525.516650:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393 00000100:00100000:0.0:1788872525.516659:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394 00000100:00100000:0.0:1788872525.516664:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327595648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872525.516692:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327595648:12345-0@lo:400:kworker.0 Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872525.516697:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394 00000100:00100000:0.0:1788872525.516938:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d0139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327595136:0@lo:400:kworker.0 00000100:00100000:0.0:1788872525.516948:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 2 00000004:00080000:0.0:1788872525.516953:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98a9f5b36680, transno 4294969448 00000100:00100000:0.0:1788872525.516966:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d0138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327595648:0@lo:400:kworker.0 00000100:00100000:0.0:1788872525.516978:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327595008:0@lo:400:kworker.0 00000100:00100000:0.0:1788872525.516987:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327595520:0@lo:400:kworker.0 00000100:00080000:3.0:1788872525.517343:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872525.517349:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872525.517352:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872525.517363:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872525.518043:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1788872525.518056:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327595776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872525.518145:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327595776:12345-0@lo:400:kworker.0 Request processed in 93us (5423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872525.518152:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1788872525.519738:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1788872525.519752:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327594368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872525.519830:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327594368:12345-0@lo:400:kworker.0 Request processed in 84us (7046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872525.519837:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1788872525.519852:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1788872525.519859:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eec96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327594496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872525.519961:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eec96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327594496:12345-0@lo:400:kworker.0 Request processed in 102us (4116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872525.519968:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1788872525.519982:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1788872525.519988:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327594624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872525.520020:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327594624:12345-0@lo:400:kworker.0 Request processed in 32us (3830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872525.520025:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1788872525.520181:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327595264:12345-0@lo:400:kworker.0 Request processed in 3650us (7564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872525.520189:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1788872525.520984:0:83265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327594240:12345-0@lo:400:kworker.0 Request processed in 6903us (8518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872525.520997:0:83265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788872525.521060:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327594880 00000100:00100000:1.0:1788872525.521069:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327594880 00000100:00100000:1.0:1788872525.521118:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327595392 00000100:00100000:1.0:1788872525.521122:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327595392 00000100:00100000:1.0:1788872525.521148:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:1.0:1788872525.521167:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c355d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327594880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.521216:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c355d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327594880:12345-0@lo:400:kworker.0 Request processed in 61us (8375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872525.521221:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00000100:00100000:1.0:1788872525.521233:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00000100:00100000:1.0:1788872525.521239:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c355ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327595392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.521267:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c355ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327595392:12345-0@lo:400:kworker.0 Request processed in 28us (8371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872525.521272:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00000100:00100000:1.0:1788872525.521478:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327594368:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.521492:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327594880:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.521502:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d013b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327595392:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.521524:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327594240:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.521537:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327594752:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.521577:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d013aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327595264:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.521591:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d0138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327595776:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.521693:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327594624:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.521704:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327594496:0@lo:400:kworker.0 00000100:00100000:1.0:1788872525.580865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872525.580911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872525.580982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872525.581010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872525.581059:0:83269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311123968 00000100:00100000:2.0:1788872525.581080:0:83269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311123968 00000100:00100000:2.0:1788872525.581142:0:83269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 158 00000100:00100000:2.0:1788872525.581155:0:83269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311123968:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872525.581234:0:83269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311123968:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 83us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872525.581241:0:83269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 158 00000100:00100000:0.0:1788872525.586647:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311124480 00000100:00100000:0.0:1788872525.586664:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311124480 00000100:00100000:0.0:1788872525.586725:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2395 00000100:00100000:0.0:1788872525.586745:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311124480:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872525.586835:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311124480:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 93us (5852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872525.586842:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2395 00000100:00100000:1.0:1788872525.592510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872525.592576:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311124352 00000100:00100000:1.0:1788872525.592588:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311124352 00000100:00100000:1.0:1788872525.592638:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2396 00000100:00100000:1.0:1788872525.592648:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311124352:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872525.592728:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311124352:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872525.592735:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2396 00000100:00100000:3.0:1788872525.594937:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311124224 00000100:00100000:3.0:1788872525.594954:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311124224 00000100:00100000:2.0:1788872525.596030:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311124096 00000100:00100000:2.0:1788872525.596038:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311124096 00000100:00100000:2.0:1788872525.596069:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1016 00000100:00100000:2.0:1788872525.596092:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c355d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311124224:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872525.596489:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1017 00000100:00100000:1.0:1788872525.596502:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:2405:x1875765311124096:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872525.596747:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c355d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311124224:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 657us (15833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872525.596756:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1016 00000100:00100000:1.0:1788872525.610392:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:2405:x1875765311124096:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 13880us (29366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872525.610431:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1017 00000100:00100000:2.0:1788872526.009726:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872526.009726:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872526.009753:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327596032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872526.009753:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327595904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872526.022108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872526.022227:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327596032 00000100:00100000:3.0:1788872526.022237:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327596032 00000100:00100000:3.0:1788872526.022299:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:3.0:1788872526.022311:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327596032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872526.022358:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872526.022414:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327596032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872526.022422:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:2.0:1788872526.024118:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327596032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872526.026498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872526.026837:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327595904 00000100:00100000:2.0:1788872526.026857:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327595904 00000100:00100000:2.0:1788872526.026921:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:2.0:1788872526.026933:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9d0138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327595904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872526.026981:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872526.027075:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9d0138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327595904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872526.027084:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:0.0:1788872526.028238:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327595904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788872526.079314:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872526.522174:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9d013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327596160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872526.522256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872526.523233:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327596288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872526.523279:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872526.523381:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327596160 00000100:00100000:1.0:1788872526.523390:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327596160 00000100:00100000:1.0:1788872526.523439:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327596288 00000100:00100000:1.0:1788872526.523442:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327596288 00000100:00100000:1.0:1788872526.523470:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:1.0:1788872526.523479:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9d0139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327596160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872526.523503:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872526.523583:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9d0139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327596160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872526.523591:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:1.0:1788872526.523608:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:1.0:1788872526.523615:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9d0138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327596288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872526.523626:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872526.523656:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9d0138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327596288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872526.523663:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:0.0:1788872526.523924:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327596288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872526.523959:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9d013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327596160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872526.526503:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788872526.528717:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327596416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872526.528807:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872526.529422:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327596416 00000100:00100000:0.0:1788872526.529432:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327596416 00000100:00100000:0.0:1788872526.529489:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:0.0:1788872526.529499:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327596416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872526.529572:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00010000:00000080:0.0:1788872526.529590:0:8447:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4530e00 x1875765327596416/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:452/0 lens 224/368 e 0 to 0 dl 1788872537 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872526.529660:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327596416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872526.529680:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000100:00100000:3.0:1788872526.529901:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327596416:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788872527.098246:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872528.120899:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872528.572318:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872528.572359:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327596544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872528.572471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872528.572545:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327596544 00000100:00100000:2.0:1788872528.572574:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327596544 00000100:00100000:2.0:1788872528.572656:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:2.0:1788872528.572669:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327596544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872528.572731:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872528.572786:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327596544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872528.572794:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:2.0:1788872528.572858:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327596544:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788872529.144795:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872530.173749:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872530.622534:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327597056:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.622653:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.622691:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327597568:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.622744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.622764:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327598080:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.622786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.622814:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788872530.622820:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327596672:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.622867:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.622895:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327597184:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.622920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.622936:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327597696:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.622971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.623001:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327598208:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.623022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.623048:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327596800:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.623072:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.623088:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327597312:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.623131:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.623148:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327597824:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.623166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.623184:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788872530.623189:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327596928:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.623211:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.623226:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327597440:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.623263:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.623280:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327597952:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.623300:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872530.623349:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327597056 00000100:00100000:1.0:1788872530.623357:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327597056 00000100:00100000:1.0:1788872530.623407:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327597184 00000100:00100000:1.0:1788872530.623410:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327597184 00000100:00100000:1.0:1788872530.623420:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327597696 00000100:00100000:1.0:1788872530.623428:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327597696 00000100:00100000:1.0:1788872530.623440:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327598208 00000100:00100000:1.0:1788872530.623441:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327598208 00000100:00100000:1.0:1788872530.623448:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327596800 00000100:00100000:1.0:1788872530.623450:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327596800 00000100:00100000:1.0:1788872530.623465:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327596928 00000100:00100000:1.0:1788872530.623468:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327596928 00000100:00100000:1.0:1788872530.623482:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:1.0:1788872530.623489:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327597056:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788872530.623511:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9df5ad500 x1875765327597056/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:456/0 lens 224/224 e 0 to 0 dl 1788872541 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872530.623566:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327597056:12345-0@lo:400:kworker.0 Request processed in 58us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872530.623573:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:1.0:1788872530.623588:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:1.0:1788872530.623593:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327597184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.623617:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327597184:12345-0@lo:400:kworker.0 Request processed in 24us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872530.623623:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:1.0:1788872530.623631:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:1.0:1788872530.623637:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327597696:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788872530.623647:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f663f480 x1875765327597696/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:456/0 lens 224/224 e 0 to 0 dl 1788872541 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872530.623667:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327597696:12345-0@lo:400:kworker.0 Request processed in 32us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872530.623672:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:1.0:1788872530.623681:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:1.0:1788872530.623691:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327598208:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788872530.623700:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f663c000 x1875765327598208/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:456/0 lens 224/224 e 0 to 0 dl 1788872541 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872530.623721:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327598208:12345-0@lo:400:kworker.0 Request processed in 31us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872530.623725:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:1.0:1788872530.623734:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:1.0:1788872530.623739:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327596800:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788872530.623746:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f663c700 x1875765327596800/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:456/0 lens 224/224 e 0 to 0 dl 1788872541 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872530.623770:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327596800:12345-0@lo:400:kworker.0 Request processed in 31us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872530.623775:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:1.0:1788872530.623786:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1788872530.623791:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327596928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.623817:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327596928:12345-0@lo:400:kworker.0 Request processed in 26us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872530.623823:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1788872530.623841:0:83265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327596672 00000100:00100000:1.0:1788872530.623845:0:83265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327596672 00000100:00100000:1.0:1788872530.623869:0:83265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788872530.623874:0:83265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327596672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.623903:0:83265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327596672:12345-0@lo:400:kworker.0 Request processed in 28us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872530.623910:0:83265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1788872530.623971:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872530.623991:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788872530.624026:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327596928:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.624039:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327596800:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.624070:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327596672:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.624080:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327597184:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.624089:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327597696:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.624098:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327598208:0@lo:400:kworker.0 00000100:00100000:1.0:1788872530.624107:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327597056:0@lo:400:kworker.0 00000100:00100000:2.0:1788872530.624705:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327597312 00000100:00100000:2.0:1788872530.624713:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327597312 00000100:00100000:2.0:1788872530.624753:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327597824 00000100:00100000:2.0:1788872530.624756:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327597824 00000100:00100000:2.0:1788872530.624778:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000100:00100000:2.0:1788872530.624786:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327597312:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788872530.624802:0:30614:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f663ed80 x1875765327597312/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:456/0 lens 224/224 e 0 to 0 dl 1788872541 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872530.624863:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327597312:12345-0@lo:400:kworker.0 Request processed in 78us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872530.624868:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00100000:2.0:1788872530.624883:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:2.0:1788872530.624889:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327597824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872530.624912:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327597824:12345-0@lo:400:kworker.0 Request processed in 24us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872530.624916:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00100000:2.0:1788872530.624974:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327597312:0@lo:400:kworker.0 00000100:00100000:2.0:1788872530.625005:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327597824:0@lo:400:kworker.0 00000100:00100000:3.0:1788872530.625603:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327597568 00000100:00100000:3.0:1788872530.625609:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327597568 00000100:00100000:3.0:1788872530.625674:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327598080 00000100:00100000:3.0:1788872530.625677:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327598080 00000100:00100000:3.0:1788872530.625696:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327597440 00000100:00100000:3.0:1788872530.625699:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327597440 00000100:00100000:3.0:1788872530.625716:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327597952 00000100:00100000:3.0:1788872530.625719:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327597952 00000100:00100000:3.0:1788872530.625739:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397 00000100:00100000:3.0:1788872530.625747:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327597568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872530.625802:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327597568:12345-0@lo:400:kworker.0 Request processed in 56us (3058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872530.625809:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397 00000100:00100000:3.0:1788872530.625822:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:3.0:1788872530.625828:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327598080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872530.625856:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327598080:12345-0@lo:400:kworker.0 Request processed in 28us (3068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872530.625862:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00100000:3.0:1788872530.625872:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399 00000100:00100000:3.0:1788872530.625885:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327597440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872530.625919:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327597440:12345-0@lo:400:kworker.0 Request processed in 34us (2655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872530.625925:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399 00000100:00100000:3.0:1788872530.625936:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2400 00000100:00100000:3.0:1788872530.625942:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f098bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327597952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872530.626002:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f098bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327597952:12345-0@lo:400:kworker.0 Request processed in 52us (2692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872530.626009:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2400 00000100:00100000:3.0:1788872530.626049:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327597568:0@lo:400:kworker.0 00000100:00100000:3.0:1788872530.626061:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327598080:0@lo:400:kworker.0 00000100:00100000:2.0:1788872530.626318:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327597440:0@lo:400:kworker.0 00000100:00100000:2.0:1788872530.626331:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327597952:0@lo:400:kworker.0 00000100:00080000:1.0:1788872530.626409:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872530.626414:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872530.703920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872530.704212:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872530.704255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872530.704281:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872530.704311:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872530.704347:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311124992 00000100:00100000:0.0:1788872530.704358:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311124992 00000100:00100000:0.0:1788872530.704416:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311125120 00000100:00100000:0.0:1788872530.704420:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311125120 00000100:00100000:0.0:1788872530.704446:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2401 00000100:00100000:0.0:1788872530.704456:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9d013aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311124992:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872530.704530:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9d013aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311124992:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 75us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872530.704538:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2401 00000100:00100000:0.0:1788872530.704576:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2402 00000100:00100000:0.0:1788872530.704583:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa77f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311125120:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872530.704608:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa77f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311125120:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872530.704614:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2402 00000100:00100000:0.0:1788872530.704634:0:83269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311124608 00000100:00100000:0.0:1788872530.704638:0:83269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311124608 00000100:00100000:0.0:1788872530.704663:0:83269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 160 00000100:00100000:0.0:1788872530.704670:0:83269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311124608:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872530.704707:0:83269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311124608:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 37us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872530.704714:0:83269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 160 00000100:00100000:0.0:1788872530.704743:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311124736 00000100:00100000:0.0:1788872530.704747:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311124736 00000100:00100000:0.0:1788872530.704857:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311124864 00000100:00100000:0.0:1788872530.704861:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311124864 00000100:00100000:0.0:1788872530.704891:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1024 00000100:00100000:0.0:1788872530.704896:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9d013a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:2405:x1875765311124736:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000080:0.0:1788872530.704913:0:66193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9d013a680 x1875765311124736/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:456/0 lens 224/224 e 0 to 0 dl 1788872541 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872530.704939:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9d013a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:2405:x1875765311124736:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 42us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872530.704944:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1024 00000100:00100000:0.0:1788872530.708209:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1025 00000100:00100000:0.0:1788872530.708233:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9d013b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311124864:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872530.708319:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9d013b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311124864:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 97us (4036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872530.708328:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1025 00000100:00080000:0.0:1788872530.708384:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872530.708389:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872530.708392:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872530.708395:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872531.129359:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327598336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872531.129467:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872531.129578:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327598336 00000100:00100000:0.0:1788872531.129586:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327598336 00000100:00100000:0.0:1788872531.129632:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:0.0:1788872531.129641:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa77fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327598336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872531.129672:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872531.129719:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa77fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327598336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872531.129726:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:0.0:1788872531.129787:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327598336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872531.143173:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872531.143197:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327598464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872531.143276:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872531.143331:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327598464 00000100:00100000:1.0:1788872531.143340:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327598464 00000100:00100000:1.0:1788872531.143395:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:1.0:1788872531.143403:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327598464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872531.143435:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872531.143804:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327598464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 400us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872531.143813:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00100000:0.0:1788872531.143939:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327598464:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788872531.193781:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788872531.621003:0:83259:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247811 is committed 00010000:00010000:1.0:1788872531.621047:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01d94ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621065:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01d94ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621074:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01d94ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621080:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872531.621084:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01d94ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621092:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01d94ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621110:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5d37600) 00010000:00010000:1.0:1788872531.621113:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872531.621118:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01d94ea lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621124:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01d94ea lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621139:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9522 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621145:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9522 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621150:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9522 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621155:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aea00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872531.621162:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9522 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621168:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9522 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621176:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5d37600) 00010000:00010000:1.0:1788872531.621178:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872531.621181:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9522 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872531.621186:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9522 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872531.640917:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327598720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872531.641016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872531.641038:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327598592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872531.641079:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872531.641146:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327598720 00000100:00100000:1.0:1788872531.641155:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327598720 00000100:00100000:3.0:1788872531.641169:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327598592 00000100:00100000:3.0:1788872531.641174:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327598592 00000100:00100000:1.0:1788872531.641213:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:1.0:1788872531.641224:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efcca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327598720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872531.641251:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872531.641301:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efcca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327598720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872531.641309:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:1.0:1788872531.641574:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:1.0:1788872531.641582:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327598592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872531.641608:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872531.641663:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327598592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872531.641670:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:0.0:1788872531.642787:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327598592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872531.643984:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327598848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872531.644170:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872531.644472:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327598848 00000100:00100000:2.0:1788872531.644482:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327598848 00000100:00100000:2.0:1788872531.644538:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:2.0:1788872531.644562:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327598848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872531.644714:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00010000:00000080:2.0:1788872531.644732:0:30614:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6524380 x1875765327598848/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:457/0 lens 224/368 e 0 to 0 dl 1788872542 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872531.644779:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327598848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 233us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872531.644795:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00000100:00100000:2.0:1788872531.644871:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327598720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872531.644909:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327598848:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788872532.217229:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788872533.010471:0:84399:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1788872533.146046:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872533.146319:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311125248 00000100:00100000:1.0:1788872533.146328:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311125248 00000100:00100000:1.0:1788872533.146392:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1025 00000100:00100000:1.0:1788872533.146404:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:64975:x1875765311125248:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:1.0:1788872533.146424:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872533.146446:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01d9537 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faded expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872533.146511:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d953e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872533.146526:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d953e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872533.146539:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d953e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872533.146603:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788872533.146607:0:68674:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1788872533.146625:0:68674:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d953e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872533.146649:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01d9537 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faded expref: 7 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872533.146667:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d953e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faded expref: 6 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872533.146690:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd098c00) 00010000:00010000:1.0:1788872533.146693:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788872533.146697:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9e00, rc 0) 00010000:00000080:1.0:1788872533.146705:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9fa77d180 x1875765311125248/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:459/0 lens 576/688 e 0 to 0 dl 1788872544 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872533.146781:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64975:x1875765311125248:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 380us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872533.146788:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1025 00000100:00080000:0.0:1788872533.147852:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788872533.157286:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872533.157369:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311125376 00000100:00100000:0.0:1788872533.157379:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311125376 00000100:00100000:0.0:1788872533.157434:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1026 00000100:00100000:0.0:1788872533.157443:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64975:x1875765311125376:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:0.0:1788872533.157463:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872533.157483:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01d9545 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fadf4 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157542:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01d954c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157584:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01d954c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157608:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01d954c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157623:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9553 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157630:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157636:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157677:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01d954c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157685:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01d954c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157691:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01d954c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157696:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01d954c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157702:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872533.157706:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01d954c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157713:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01d954c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157724:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd098c00) 00010000:00010000:0.0:1788872533.157733:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872533.157739:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01d954c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157745:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01d954c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157769:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157775:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9553 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157781:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9553 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157785:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aea00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872533.157788:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9553 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157793:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9553 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157801:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff98a8ca1a0b00) 00010000:00010000:0.0:1788872533.157804:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872533.157806:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9553 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157811:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01d9553 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157841:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01d9545 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadf4 expref: 7 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157859:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd098c00) 00010000:00010000:0.0:1788872533.157861:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872533.157865:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01d9545 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadf4 expref: 7 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.157875:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58aec00, rc 0) 00010000:00000080:0.0:1788872533.157882:0:66193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6525880 x1875765311125376/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:459/0 lens 592/584 e 0 to 0 dl 1788872544 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872533.157958:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64975:x1875765311125376:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 516us (686us total) trans 0 rc 301/301 00000100:00100000:0.0:1788872533.157965:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1026 00000100:00100000:3.0:1788872533.171415:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872533.172199:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311125632 00000100:00100000:0.0:1788872533.172213:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311125632 00000100:00100000:0.0:1788872533.172286:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1027 00000100:00100000:0.0:1788872533.172297:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:64975:x1875765311125632:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:0.0:1788872533.172322:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872533.172326:0:66979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788872533.172357:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d953e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faded expref: 6 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.172385:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd098c00) 00010000:00010000:0.0:1788872533.172400:0:66979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872533.172420:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01d955a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fadfb expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.172580:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01d9561 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.172594:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01d9561 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.172605:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01d9561 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.172618:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01d9568 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.172625:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01d9568 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.172632:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01d9568 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.173842:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01d956f lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.173860:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01d956f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.173869:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01d956f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872533.173881:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788872533.173911:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01d9561 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.173920:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01d9561 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.173946:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01d9561 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.173952:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01d9561 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.173957:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872533.173962:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01d9561 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.173970:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01d9561 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.173982:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a8ca1a0400) 00010000:00010000:0.0:1788872533.173986:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872533.173990:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01d9561 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.173995:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01d9561 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872533.174007:0:66979:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e169417 reply state 00000000c5f846e1 transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01d9568 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.174017:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01d9568 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.174023:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff98a8ca1a0000) 00010000:00010000:0.0:1788872533.174026:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872533.174029:0:66979:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788872533.174063:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01d955a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadfb expref: 8 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.174104:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01d956f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadfb expref: 7 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.174112:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff98a8ca1a0500) 00010000:00010000:0.0:1788872533.174114:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872533.174117:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58af600, rc 0) 00010000:00000080:0.0:1788872533.174130:0:66979:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4530700 x1875765311125632/t98784247812(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:459/0 lens 536/608 e 0 to 0 dl 1788872544 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872533.174219:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:64975:x1875765311125632:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 1923us (2816us total) trans 98784247812 rc 0/0 00000100:00100000:0.0:1788872533.174227:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1027 00000100:00100000:3.0:1788872533.183107:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872533.183254:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311125888 00000100:00100000:1.0:1788872533.183264:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311125888 00000100:00100000:1.0:1788872533.183327:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1028 00000100:00100000:1.0:1788872533.183340:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:64975:x1875765311125888:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:1.0:1788872533.183365:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872533.183389:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01d957d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae02 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872533.183499:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872533.183516:0:68674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01d956f lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadfb expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872533.183525:0:68674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872533.183623:0:68674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01d956f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadfb expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872533.183638:0:68674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01d956f lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadfb expref: 9 pid: 66979 timeout: 3570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872533.183652:0:68674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68674:1875765327598976:192.168.204.39@tcp:104: 00000100:00100000:1.0:1788872533.183729:0:68674:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9eedbc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788872533.190311:0:68674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68674:1875765327598976:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788872533.190343:0:68674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872533.191005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872533.191725:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311126016 00000100:00100000:0.0:1788872533.191735:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311126016 00010000:00010000:0.0:1788872533.191781:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01d956f lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadfb expref: 10 pid: 66979 timeout: 3570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872533.191819:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2550 00000100:00100000:0.0:1788872533.191829:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2404:x1875765311126016:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788872533.191845:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872533.191853:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01d956f lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadfb expref: 10 pid: 66979 timeout: 3570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.191865:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01d956f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadfb expref: 10 pid: 66979 timeout: 3570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.191900:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01d956f lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadfb expref: 10 pid: 66979 timeout: 3570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.191916:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff98a8ca1a0500) 00010000:00010000:0.0:1788872533.191921:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.191941:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.191948:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872533.191975:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872533.192028:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:2404:x1875765311126016:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 200us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872533.192035:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2550 00010000:00010000:2.0:1788872533.195717:0:68674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872533.195738:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872533.195875:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788872533.196150:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872533.196160:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872533.196167:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872533.196174:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872533.196180:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872533.196187:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872533.196205:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff98a8ca1a0500) 00010000:00010000:2.0:1788872533.196208:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788872533.196213:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872533.196233:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9584 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872533.196300:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01d957d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae02 expref: 9 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872533.196312:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd098800) 00010000:00010000:2.0:1788872533.196315:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788872533.196319:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01d957d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae02 expref: 9 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872533.196331:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8400, rc 0) 00010000:00000080:2.0:1788872533.196342:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4531880 x1875765311125888/t98784247813(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:459/0 lens 712/824 e 0 to 0 dl 1788872544 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872533.196423:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:64975:x1875765311125888:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 13085us (13326us total) trans 98784247813 rc 301/301 00000100:00100000:2.0:1788872533.196432:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1028 00000100:00100000:3.0:1788872533.200200:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872533.200367:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311126272 00000100:00100000:2.0:1788872533.200378:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311126272 00000100:00100000:2.0:1788872533.200443:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 213 00000100:00100000:2.0:1788872533.200454:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:64975:x1875765311126272:12345-192.168.204.39@tcp:35:lfs.0 00010000:00000080:2.0:1788872533.200663:0:80566:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4532300 x1875765311126272/t98784247814(0) o35->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:459/0 lens 392/456 e 0 to 0 dl 1788872544 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872533.200724:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:64975:x1875765311126272:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 272us (534us total) trans 98784247814 rc 0/0 00000100:00100000:2.0:1788872533.200742:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 213 00000100:00100000:1.0:1788872533.222134:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872533.224074:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311126528 00000100:00100000:3.0:1788872533.224096:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311126528 00000100:00100000:3.0:1788872533.224179:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 214 00000100:00100000:3.0:1788872533.224190:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:64975:x1875765311126528:12345-192.168.204.39@tcp:35:lfs.0 00010000:00000080:3.0:1788872533.224388:0:66194:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6524a80 x1875765311126528/t98784247815(0) o35->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:459/0 lens 392/456 e 0 to 0 dl 1788872544 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872533.224469:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:64975:x1875765311126528:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 281us (2344us total) trans 98784247815 rc 0/0 00000100:00100000:3.0:1788872533.224477:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 214 00010000:00010000:2.0:1788872533.240745:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872533.690875:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327599104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872533.690961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872533.691126:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327599104 00000100:00100000:2.0:1788872533.691135:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327599104 00000100:00100000:2.0:1788872533.691198:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:2.0:1788872533.691209:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327599104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872533.691244:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872533.694099:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327599104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2880us (3125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872533.694115:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:0.0:1788872533.696369:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327599104:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788872534.272583:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788872535.056912:0:84496:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788872535.056963:0:84496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2000/0xe4e6e89fb01d918d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9194 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872535.056979:0:84496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2000/0xe4e6e89fb01d918d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9194 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872535.056986:0:84496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2000/0xe4e6e89fb01d918d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9194 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872535.056993:0:84496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2000/0xe4e6e89fb01d918d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9194 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872535.057011:0:84496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788872535.057015:0:84496:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788872535.057043:0:84496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788872535.057047:0:84496:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788872535.057065:0:84496:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788872535.057088:0:84496:0:(import.c:65:import_set_state_nolock()) ffff98a8c2796800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788872535.057599:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872535.057607:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2000/0xe4e6e89fb01d918d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9194 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.057615:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872535.057619:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2000/0xe4e6e89fb01d918d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9194 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.057628:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2000/0xe4e6e89fb01d918d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d9194 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872535.057643:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2000/0xe4e6e89fb01d918d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d9194 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872535.057649:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788872535.057652:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788872535.057655:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788872535.057682:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2000/0xe4e6e89fb01d918d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9194 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.057689:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872535.057713:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2000/0xe4e6e89fb01d918d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9194 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.057720:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2000/0xe4e6e89fb01d918d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9194 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.057732:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872535.057733:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872535.057735:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872535.057751:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327599360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872535.057822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872535.058479:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327599232:0@lo:39:umount.0 00000100:00100000:1.0:1788872535.058524:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872535.059186:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327599360 00000100:00100000:1.0:1788872535.059193:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327599360 00000100:00100000:0.0:1788872535.059204:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327599232 00000100:00100000:0.0:1788872535.059208:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327599232 00000100:00100000:1.0:1788872535.059240:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1788872535.059240:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1788872535.059248:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327599360:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872535.059248:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875765327599232:12345-0@lo:39:umount.0 00010000:00010000:1.0:1788872535.059261:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:0.0:1788872535.059270:0:66193:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d92ac 00010000:00010000:1.0:1788872535.059278:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98ea00/0xe4e6e89fb01d9194 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d918d expref: 24 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788872535.059279:0:66193:0:(import.c:65:import_set_state_nolock()) ffff98a9c45ca800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788872535.059290:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00000080:0.0:1788872535.059305:0:66193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6527480 x1875765327599232/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:461/0 lens 224/224 e 0 to 0 dl 1788872546 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872535.059329:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3646:x1875765327599360:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872535.059336:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1788872535.059347:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1875765327599232:12345-0@lo:39:umount.0 Request processed in 101us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872535.059353:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000020:00000080:0.0:1788872535.059361:0:66193:0:(genops.c:906:class_export_put()) final put ffff98a9e99a4800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1788872535.059412:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c2796800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788872535.059425:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327599232:0@lo:39:umount.0 00000100:00100000:0.0:1788872535.059452:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327599360:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872535.059672:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788872535.059739:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788872535.059803:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c45ca800 for lustre-MDT0000 00000100:00080000:2.0:1788872535.059957:0:84496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788872535.059961:0:84496:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788872535.059965:0:84496:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788872535.061985:0:84496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01d90b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d90c2 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062003:0:84496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01d90b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d90c2 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062010:0:84496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01d90b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d90c2 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062016:0:84496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01d90b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d90c2 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062041:0:84496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872535.062048:0:84496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440600/0xe4e6e89fb01d91b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d91be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062054:0:84496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440600/0xe4e6e89fb01d91b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d91be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062078:0:84496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440600/0xe4e6e89fb01d91b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d91be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062084:0:84496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9f5440600/0xe4e6e89fb01d91b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d91be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062189:0:84496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788872535.062197:0:84496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01d917f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9186 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062203:0:84496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01d917f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9186 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062208:0:84496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01d917f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9186 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062213:0:84496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01d917f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9186 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872535.062326:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788872535.062326:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872535.062333:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01d90b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d90c2 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.062337:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9f5440600/0xe4e6e89fb01d91b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d91be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.062345:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440600 already unused, calling callback (ffffffffc13c0c20) 00010000:00010000:1.0:1788872535.062346:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98e400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872535.062349:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01d90b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d90c2 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872535.062349:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440600/0xe4e6e89fb01d91b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d91be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872535.062359:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01d90b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d90c2 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.062359:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5440600/0xe4e6e89fb01d91b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d91be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872535.062367:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01d90b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d90c2 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872535.062367:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440600/0xe4e6e89fb01d91b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d91be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872535.062373:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788872535.062374:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788872535.062376:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788872535.062376:0:14981:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788872535.062378:0:14981:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788872535.062406:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01d90b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d90c2 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.062406:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9f5440600/0xe4e6e89fb01d91b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d91be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872535.062412:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872535.062421:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872535.062433:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01d90b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d90c2 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872535.062440:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01d90b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d90c2 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872535.062451:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872535.062455:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01d917f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9186 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872535.062460:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872535.062462:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01d917f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9186 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872535.062469:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327599616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872535.062478:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01d917f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d9186 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872535.062484:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01d917f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d9186 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872535.062488:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788872535.062490:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788872535.062500:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01d917f lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9186 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872535.062505:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872535.062519:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01d917f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9186 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872535.062527:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872535.062528:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872535.062530:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872535.062541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872535.062608:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327599488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872535.062623:0:84496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788872535.062628:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01d917f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9186 expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872535.062636:0:84496:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788872535.062665:0:84496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d90a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d90ad expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062671:0:84496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d90a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d90ad expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062684:0:84496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d90a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d90ad expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062690:0:84496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d90a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d90ad expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872535.062692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788872535.062702:0:84496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788872535.062705:0:84496:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788872535.062708:0:84496:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788872535.062795:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872535.062800:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d90a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d90ad expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062806:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98ee00 already unused, calling callback (ffffffffc13c0c20) 00000100:00100000:1.0:1788872535.062817:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327599616 00000100:00100000:1.0:1788872535.062825:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327599616 00000100:00100000:1.0:1788872535.062872:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1788872535.062881:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3647:x1875765327599616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872535.062904:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872535.062919:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98f600/0xe4e6e89fb01d91be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d91b7 expref: 23 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872535.062932:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:3.0:1788872535.062971:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d90a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d90ad expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.062981:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d90a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d90ad expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872535.062988:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d90a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d90ad expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872535.062993:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788872535.062996:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788872535.062997:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788872535.063013:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d90a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d90ad expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.063018:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872535.063031:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d90a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d90ad expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.063037:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d90a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d90ad expref: -99 pid: 83258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.063045:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872535.063047:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872535.063049:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788872535.063065:0:84496:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788872535.063069:0:84496:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1788872535.063074:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788872535.063080:0:84496:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1788872535.063126:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440600/0xe4e6e89fb01d91b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d91be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.063133:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5440600/0xe4e6e89fb01d91b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d91be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.063142:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872535.063144:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872535.063146:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872535.063156:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327599744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872535.063185:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872535.063219:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872535.063224:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327599872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872535.063245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872535.063274:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327599488 00000100:00100000:0.0:1788872535.063278:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327599488 00000100:00100000:0.0:1788872535.063304:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327599744 00000100:00100000:0.0:1788872535.063307:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327599744 00000100:00100000:0.0:1788872535.063325:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1788872535.063332:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327599488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872535.063340:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872535.063349:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01d90c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d90b4 expref: 24 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.063359:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872535.063694:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3647:x1875765327599616:12345-0@lo:103:ldlm_bl.0 Request processed in 813us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872535.063712:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1788872535.063726:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327599872 00000100:00100000:1.0:1788872535.063730:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327599872 00000100:00100000:1.0:1788872535.063748:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1788872535.063753:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3644:x1875765327599744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872535.063761:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872535.063770:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98fa00/0xe4e6e89fb01d9186 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d917f expref: 23 pid: 83265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872535.063778:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872535.063806:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3644:x1875765327599744:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872535.063812:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1788872535.063827:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1788872535.063832:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3644:x1875765327599872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872535.063840:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872535.063848:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01d90ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d90a6 expref: 21 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872535.063856:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872535.063877:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3644:x1875765327599872:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872535.063882:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1788872535.063994:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327599616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872535.064098:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:3647:x1875765327599488:12345-0@lo:103:ldlm_bl.0 Request processed in 765us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872535.064113:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1788872535.064174:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327599872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872535.064183:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327599744:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872535.064207:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872535.064248:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327599488:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1788872535.065859:0:84496:0:(mdt_handler.c:8248:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1788872535.066295:0:83259:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00010000:00010000:3.0:1788872535.066420:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01d9568 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.066431:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01d9568 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.066437:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01d9568 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.066442:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58afc00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872535.066446:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01d9568 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.066452:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01d9568 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.066470:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff98a8ca1a0000) 00010000:00010000:3.0:1788872535.066473:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872535.066483:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01d9568 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872535.066490:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01d9568 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788872535.066607:0:84496:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1788872535.066616:0:84496:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9e021d000 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 192.168.204.39@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 98784247815 stale:0 00000020:00080000:2.0:1788872535.066622:0:84496:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9c9892800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788872535.066630:0:84496:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9dfe92000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788872535.066634:0:84496:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9dfe95800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788872535.066637:0:84496:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9cb5ed000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788872535.066642:0:84496:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff98a8c72eb380) has exports, disconnecting them 00000020:00080000:2.0:1788872535.066647:0:84496:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.39@tcp (ffff98a9e021d000), last request at 1788872533 00000020:00000080:2.0:1788872535.066655:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d947a 00000100:00080000:2.0:1788872535.066664:0:84496:0:(import.c:65:import_set_state_nolock()) ffff98a9cb5ef800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788872535.066685:0:84496:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a9e021d000): rc 0 00000020:00000080:2.0:1788872535.066688:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9e021d000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00080000:2.0:1788872535.066699:0:84496:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9c9892800), last request at 1788872323 00000020:00000080:2.0:1788872535.066708:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d92a5 00000100:00080000:2.0:1788872535.066712:0:84496:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a5000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788872535.066727:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e021d000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-MDT0000 00000020:00000080:2.0:1788872535.066780:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9cb5ef800 for lustre-MDT0000 00000020:00080000:2.0:1788872535.066792:0:84496:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9c9892800): rc 0 00000020:00000080:2.0:1788872535.066794:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9c9892800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788872535.066801:0:84496:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9dfe92000), last request at 1788872530 00000020:00000080:2.0:1788872535.066805:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d929e 00000100:00080000:2.0:1788872535.066809:0:84496:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe90000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788872535.066820:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c9892800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788872535.066842:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e99a5000 for lustre-MDT0000 00000020:00080000:2.0:1788872535.066851:0:84496:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9dfe92000): rc 0 00000020:00000080:2.0:1788872535.066853:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9dfe92000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788872535.066859:0:84496:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9dfe95800), last request at 1788872530 00000020:00000080:2.0:1788872535.066862:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9297 00010000:00010000:3.0:1788872535.066867:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788872535.066871:0:84496:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe95000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788872535.066890:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788872535.066903:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9dfe92000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788872535.066928:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9dfe90000 for lustre-MDT0000 00010000:00010000:1.0:1788872535.066942:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788872535.066951:0:84496:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9dfe95800): rc 0 00000020:00000080:2.0:1788872535.066953:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9dfe95800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788872535.066967:0:84496:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9cb5ed000), last request at 1788872318 00000020:00000080:2.0:1788872535.066970:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9101 00000100:00080000:2.0:1788872535.066978:0:84496:0:(import.c:65:import_set_state_nolock()) ffff98a8c2795800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788872535.067000:0:84496:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9cb5ed000): rc 0 00000020:00000080:2.0:1788872535.067002:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9cb5ed000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1788872535.067009:0:84496:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb002c156fae0 00010000:00010000:1.0:1788872535.067018:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788872535.067028:0:84496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788872535.067032:0:84496:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411434 gen 3 00000020:00000080:3.0:1788872535.067045:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9dfe95800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788872535.067074:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb5ed000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788872535.067095:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9dfe95000 for lustre-MDT0000 00000020:00000080:3.0:1788872535.067098:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c2795800 for lustre-MDT0000 00000100:00080000:2.0:1788872535.067944:0:84496:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788872535.067968:0:84496:0:(import.c:65:import_set_state_nolock()) ffff98a9df968000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788872535.068697:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872535.068946:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327600000:0@lo:39:umount.0 00000100:00100000:3.0:1788872535.069023:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872535.069228:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327600000 00000100:00100000:0.0:1788872535.069236:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327600000 00000100:00100000:0.0:1788872535.069290:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:0.0:1788872535.069300:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327600000:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788872535.069325:0:30614:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9140 00000100:00080000:0.0:1788872535.069334:0:30614:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788872535.069350:0:30614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411434 00000100:00100000:0.0:1788872535.069493:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3643:x1875765327600000:12345-0@lo:39:umount.0 Request processed in 195us (469us total) trans 77309411435 rc 0/0 00000100:00100000:0.0:1788872535.069502:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00010000:00010000:3.0:1788872535.069594:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788872535.069621:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df968000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788872535.069629:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327600000:0@lo:39:umount.0 00000100:00080000:2.0:1788872535.069966:0:84496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788872535.069970:0:84496:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 3 00000004:00080000:2.0:1788872535.070017:0:84496:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00080000:2.0:1788872535.070080:0:84496:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788872535.070096:0:84496:0:(import.c:65:import_set_state_nolock()) ffff98a8c679b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788872535.070114:0:84496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788872535.070117:0:84496:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 3 00000004:00080000:2.0:1788872535.070126:0:84496:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00080000:2.0:1788872535.070186:0:84496:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788872535.070195:0:84496:0:(import.c:65:import_set_state_nolock()) ffff98a8c2794800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788872535.070232:0:84496:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98a8c72eb380) has no exports 00000100:00100000:3.0:1788872535.070286:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327600128:0@lo:9:umount.0 00000100:00100000:3.0:1788872535.070324:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872535.071444:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327600256:0@lo:9:umount.0 00000100:00100000:3.0:1788872535.071484:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872535.073527:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327600128 00000100:00100000:2.0:1788872535.073542:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327600128 00000100:00100000:2.0:1788872535.073643:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327600256 00000100:00100000:2.0:1788872535.073648:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327600256 00000100:00100000:2.0:1788872535.074016:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5925 00000100:00100000:2.0:1788872535.074035:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327600128:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788872535.074063:0:26182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9155 00000100:00080000:2.0:1788872535.074072:0:26182:0:(import.c:65:import_set_state_nolock()) ffff98a8c394d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788872535.074127:0:26182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:2.0:1788872535.074305:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3643:x1875765327600128:12345-0@lo:9:umount.0 Request processed in 279us (3979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872535.074443:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5926 00000100:00100000:3.0:1788872535.074455:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327600256:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788872535.074469:0:26190:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9178 00000100:00080000:3.0:1788872535.074477:0:26190:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788872535.074510:0:26190:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:3.0:1788872535.074617:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3643:x1875765327600256:12345-0@lo:9:umount.0 Request processed in 166us (3131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872535.074639:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5926 00010000:00010000:3.0:1788872535.074660:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788872535.074700:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c679b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788872535.074716:0:3643:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:3.0:1788872535.074719:0:3643:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872535.074722:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327600128:0@lo:9:umount.0 00000100:00080000:3.0:1788872535.074742:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c2794800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788872535.074752:0:3643:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:3.0:1788872535.074754:0:3643:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872535.074756:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327600256:0@lo:9:umount.0 00000020:00080000:1.0:1788872535.075094:0:84496:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98a8c72eb380) has no exports 00000100:00100000:2.0:1788872535.075167:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5925 00000100:00080000:2.0:1788872535.075261:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872535.075265:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788872535.075275:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788872535.123310:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9116 00000020:00000080:1.0:1788872535.123327:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a8c6773000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788872535.123352:0:84496:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788872535.123771:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872535.123799:0:84496:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788872535.123803:0:84496:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98a8c72e8000) has no exports 00000020:00000080:0.0:1788872535.123960:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c6773000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788872535.130314:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d910f 00000020:00000080:2.0:1788872535.130330:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9f5593800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788872535.130474:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872535.130490:0:84496:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788872535.130494:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9ee83a000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788872535.130498:0:84496:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ee83a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788872535.130513:0:84496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788872535.130799:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f5593800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788872535.130988:0:84496:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a8c47cef60 - data ffff98a9c6de9288/ffff98a8cb888000 00000020:01000000:2.0:1788872535.131138:0:84496:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9ef8d0660 - data ffff98a9c6fce510/ffff98a9c5d57800 00000100:00080000:3.0:1788872535.207288:0:84496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788872535.207298:0:84496:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411434 gen 4 00000100:00100000:3.0:1788872535.207313:0:84496:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98a8c1eedc00 x1875765327600000/t77309411435(77309411435) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872545 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872535.207336:0:84496:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788872535.212525:0:84496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788872535.212533:0:84496:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 4 00000004:00080000:3.0:1788872535.212658:0:84496:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872535.212728:0:84496:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788872535.221222:0:83276:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788872535.221230:0:83276:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:0.0:1788872535.221244:0:83276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:3.0:1788872535.222015:0:84496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788872535.222021:0:84496:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 4 00000004:00080000:3.0:1788872535.222032:0:84496:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872535.222034:0:84496:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788872535.224030:0:83278:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788872535.224038:0:83278:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 2 count 1 00000040:00080000:0.0:1788872535.224049:0:83278:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:3.0:1788872535.233179:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d90d0 00000020:00000080:3.0:1788872535.233192:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a8c1f5d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788872535.233821:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d90e5 00000020:00000080:3.0:1788872535.233828:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9cb5ec000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788872535.233834:0:84496:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788872535.233839:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872535.233865:0:84496:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788872535.233870:0:84496:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff98a8c72e99c0) has no exports 00000004:01000000:3.0:1788872535.234050:0:84496:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788872535.234059:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9163 00000020:00000080:3.0:1788872535.234063:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9e99a9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788872535.234068:0:84496:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788872535.234072:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872535.234080:0:84496:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788872535.234083:0:84496:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff98a9e9b08000) has no exports 00000020:00000080:3.0:1788872535.234088:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d915c 00000020:00000080:3.0:1788872535.234091:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9f0927800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788872535.234415:0:84496:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788872535.234421:0:84496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788872535.234424:0:84496:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 5 00000004:00080000:3.0:1788872535.234430:0:84496:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872535.234432:0:84496:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788872535.237405:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c1f5d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788872535.237432:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb5ec000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788872535.237438:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788872535.237443:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f0927800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788872535.237721:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872535.237738:0:84496:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872535.237749:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9147 00000020:00000080:3.0:1788872535.237758:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9faa5c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872535.243851:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c2794800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788872535.243871:0:82775:0:(genops.c:906:class_export_put()) final put ffff98a9cb582800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872535.243875:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb582800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788872535.243883:0:82775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788872535.244655:0:84496:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788872535.244666:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872535.244682:0:84496:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788872535.244687:0:84496:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff98a9efa7b380) has no exports 00000020:00000080:3.0:1788872535.244696:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9139 00000020:00000080:3.0:1788872535.244702:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a8c6799800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788872535.245102:0:84496:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788872535.245106:0:84496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788872535.245111:0:84496:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 5 00000004:00080000:3.0:1788872535.245117:0:84496:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872535.245119:0:84496:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788872535.245166:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872535.245187:0:84496:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788872535.245207:0:84496:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788872535.245214:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d912b 00000020:00000080:3.0:1788872535.245219:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9e99a1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788872535.245223:0:84496:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788872535.245226:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872535.245230:0:84496:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788872535.245233:0:84496:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff98a9f6710000) has no exports 00000020:00000080:3.0:1788872535.245237:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9124 00000020:00000080:3.0:1788872535.245239:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9f5597000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788872535.247640:0:84496:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788872535.247648:0:84496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788872535.247652:0:84496:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411434 gen 5 00000100:00100000:0.0:1788872535.247666:0:84496:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788872535.247748:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872535.247762:0:84496:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872535.247796:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872535.247800:0:84496:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872535.247805:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a8c1f59800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872535.247809:0:84496:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c1f59800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788872535.247818:0:84496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872535.247934:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d90ec 00000020:00000080:0.0:1788872535.247943:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9cb5e8800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788872535.247947:0:84496:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788872535.247952:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788872535.247957:0:84496:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788872535.247960:0:84496:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff98a8c72ecd40) has no exports 00000020:00000080:0.0:1788872535.247981:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872535.247985:0:84496:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788872535.247990:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d90f3 00000020:00000080:0.0:1788872535.247994:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9cb5ec800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788872535.248001:0:84496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9fbfac800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788872535.248005:0:84496:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9fbfac800 3 00000020:01000004:0.0:1788872535.248008:0:84496:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a9fbfac800 from lustre-MDT0000 00000020:00000080:0.0:1788872535.248033:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872535.248037:0:84496:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788872535.248040:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a8c1f5f800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788872535.248042:0:84496:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c1f5f800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788872535.248049:0:84496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788872535.248081:0:84496:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788872535.248084:0:84496:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788872535.248094:0:84496:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788872535.248097:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788872535.248099:0:84496:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788872535.248107:0:84496:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98a8c37f7000 8a09bb38-f574-4ce9-b65f-ec6facc58f7e 192.168.204.39@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788872535.248113:0:84496:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98a9fa732000 f2e885a0-f180-4b85-9f87-6a01e20afd1a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788872535.248123:0:84496:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff98a9e9b099c0) has exports, disconnecting them 00000020:00080000:0.0:1788872535.248128:0:84496:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.39@tcp (ffff98a8c37f7000), last request at 1788872319 00000020:00000080:0.0:1788872535.248151:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d91b0 00000020:00010000:0.0:1788872535.248156:0:84496:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a8c37f7000: total 6 00000100:00080000:0.0:1788872535.248160:0:84496:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f7800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788872535.248171:0:84496:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a8c37f7000): rc 0 00000020:00080000:0.0:1788872535.248174:0:84496:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98a9fa732000), last request at 1788872318 00000020:00010000:0.0:1788872535.248211:0:14981:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a8c37f7000: total 6 00010000:00010000:0.0:1788872535.248236:0:14981:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a8c37f7000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788872535.248266:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5440e00/0xe4e6e89fb01d9282 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadb5 expref: 5 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.248281:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5440400/0xe4e6e89fb01d9290 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadc3 expref: 4 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.248293:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98e200/0xe4e6e89fb01d9289 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadbc expref: 3 pid: 83265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.248303:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3600/0xe4e6e89fb01d927b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadae expref: 2 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.248312:0:14981:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a8c37f7000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788872535.248328:0:14981:0:(genops.c:906:class_export_put()) final put ffff98a8c37f7000/8a09bb38-f574-4ce9-b65f-ec6facc58f7e 00010000:00010000:0.0:1788872535.248333:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872535.248335:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872535.248337:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788872535.248347:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9091 00000020:00010000:0.0:1788872535.248350:0:84496:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9fa732000: total 7 00000100:00080000:0.0:1788872535.248353:0:84496:0:(import.c:65:import_set_state_nolock()) ffff98a9fa734800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788872535.248369:0:84496:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9fa732000): rc 0 00000020:00080000:0.0:1788872535.248372:0:84496:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff98a9e9b099c0) has no exports 00000100:00100000:0.0:1788872535.248420:0:83269:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff98a9c9cce800:83269] 3 exiting: rc = 0 00000100:00100000:0.0:1788872535.248513:0:83263:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98aa002a3e00:83263] 0 exiting: rc = 1 00000100:00100000:1.0:1788872535.248711:0:83265:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98a9efb2c400:83265] 2 exiting: rc = 0 00000100:00100000:1.0:1788872535.248765:0:83264:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98a8c75b9c00:83264] 1 exiting: rc = 0 00000020:00000080:1.0:1788872535.248809:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9faa5c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788872535.248819:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c6799800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788872535.248824:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c679b800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788872535.248829:0:82775:0:(genops.c:906:class_export_put()) final put ffff98a9e99a2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872535.248831:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788872535.248835:0:82775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872535.248901:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788872535.248907:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f5597000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788872535.248911:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9df968000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788872535.248915:0:82775:0:(genops.c:906:class_export_put()) final put ffff98a8c1f5f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872535.248918:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c1f5f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788872535.248920:0:82775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872535.248949:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb5e8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788872535.248953:0:82775:0:(genops.c:906:class_export_put()) final put ffff98a9ef236800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788872535.248962:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef236800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788872535.248966:0:82775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788872535.248993:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb5ec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788872535.248997:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c37f7000/8a09bb38-f574-4ce9-b65f-ec6facc58f7e for MGS 00000020:00000080:1.0:1788872535.249020:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c37f7800 for MGS 00000100:00100000:0.0:1788872535.249622:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249630:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249639:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249646:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249653:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249658:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249664:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249670:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249676:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249681:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249688:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249694:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249701:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249708:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249713:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249720:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249725:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249731:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249737:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249744:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249750:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249755:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249760:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249765:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249771:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249775:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249781:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249787:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249793:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249805:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249821:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249826:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249832:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249838:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249843:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249849:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249855:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249860:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249865:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249870:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249875:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249880:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249886:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249904:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249909:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249915:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249920:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249926:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249932:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249937:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249942:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249947:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249954:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249960:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249965:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249970:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249976:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249981:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249987:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249992:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.249997:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.250001:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.250007:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872535.250012:0:84496:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1788872535.254282:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9f5441c00/0xe4e6e89fb01d9266 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d925f expref: 14 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254326:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5441c00/0xe4e6e89fb01d9266 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d925f expref: 14 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254340:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9fa98e600/0xe4e6e89fb01d91cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d91c5 expref: 13 pid: 83263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254348:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98e600/0xe4e6e89fb01d91cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d91c5 expref: 13 pid: 83263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254355:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9df4d2200/0xe4e6e89fb01d91e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d91e1 expref: 12 pid: 83265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254362:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d2200/0xe4e6e89fb01d91e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d91e1 expref: 12 pid: 83265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254369:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9c56c9a00/0xe4e6e89fb01d9212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d920b expref: 11 pid: 83263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254377:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c9a00/0xe4e6e89fb01d9212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d920b expref: 11 pid: 83263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254384:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9fa98fe00/0xe4e6e89fb01d9220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d9219 expref: 10 pid: 83265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254390:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98fe00/0xe4e6e89fb01d9220 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d9219 expref: 10 pid: 83265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254397:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9f5441000/0xe4e6e89fb01d923c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d9235 expref: 9 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254414:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5441000/0xe4e6e89fb01d923c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d9235 expref: 9 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254422:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9df4d3400/0xe4e6e89fb01d924a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d9243 expref: 8 pid: 83263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254429:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3400/0xe4e6e89fb01d924a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d9243 expref: 8 pid: 83263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254437:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01d9274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d926d expref: 7 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254445:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01d9274 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d926d expref: 7 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254453:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9f5440800/0xe4e6e89fb01d91da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d91d3 expref: 6 pid: 83265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254460:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5440800/0xe4e6e89fb01d91da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d91d3 expref: 6 pid: 83265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254470:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9df4d3e00/0xe4e6e89fb01d91f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d91ef expref: 5 pid: 83263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254477:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3e00/0xe4e6e89fb01d91f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d91ef expref: 5 pid: 83263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254485:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01d9204 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d91fd expref: 4 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254501:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01d9204 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d91fd expref: 4 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254509:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9f5441600/0xe4e6e89fb01d922e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d9227 expref: 3 pid: 83263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254515:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5441600/0xe4e6e89fb01d922e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d9227 expref: 3 pid: 83263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254522:0:84496:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff98a9f5441400/0xe4e6e89fb01d9258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe4e6e89fb01d9251 expref: 2 pid: 83265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872535.254529:0:84496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5441400/0xe4e6e89fb01d9258 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe4e6e89fb01d9251 expref: 2 pid: 83265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:0.0:1788872535.290790:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9fa732000: total 0 00010000:00010000:0.0:1788872535.290871:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9fa732000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788872535.290899:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9fa732000, canceled 0 locks, left on hash table 0. 00000020:00000080:0.0:1788872535.290910:0:6509:0:(genops.c:906:class_export_put()) final put ffff98a9fa732000/f2e885a0-f180-4b85-9f87-6a01e20afd1a 00010000:00010000:0.0:1788872535.290921:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872535.290923:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872535.290925:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788872535.290962:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9fa732000/f2e885a0-f180-4b85-9f87-6a01e20afd1a for MGS 00000020:00000080:1.0:1788872535.290995:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9fa734800 for MGS 00010000:00010000:3.0:1788872535.377925:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872535.737750:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327600768:0@lo:400:kworker.0 00000100:00100000:3.0:1788872535.737826:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872535.737862:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327601280:0@lo:400:kworker.0 00000100:00100000:3.0:1788872535.737898:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872535.737921:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788872535.737927:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327600640:0@lo:400:kworker.0 00000100:00100000:3.0:1788872535.737950:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872535.737969:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327601152:0@lo:400:kworker.0 00000100:00100000:3.0:1788872535.738007:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872535.738042:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327600768 00000100:00100000:3.0:1788872535.738049:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327600768 00000100:00100000:3.0:1788872535.738107:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327601280 00000100:00100000:3.0:1788872535.738110:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327601280 00000100:00100000:3.0:1788872535.738123:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327600640 00000100:00100000:3.0:1788872535.738126:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327600640 00000100:00100000:3.0:1788872535.738141:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:3.0:1788872535.738152:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327600768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872535.738212:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327600768:12345-0@lo:400:kworker.0 Request processed in 62us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872535.738236:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:3.0:1788872535.738254:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:3.0:1788872535.738258:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875765327601280:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788872535.738263:0:66190:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788872535.738290:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875765327601280:12345-0@lo:400:kworker.0 Request processed in 31us (392us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788872535.738297:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:3.0:1788872535.738317:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1788872535.738321:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875765327600640:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788872535.738326:0:66190:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788872535.738349:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875765327600640:12345-0@lo:400:kworker.0 Request processed in 27us (398us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788872535.738355:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00080000:3.0:1788872535.738391:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788872535.738397:0:3645:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788872535.738401:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788872535.740121:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327600512:0@lo:400:kworker.0 00000100:00100000:2.0:1788872535.740193:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872535.740227:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327601024:0@lo:400:kworker.0 00000100:00100000:2.0:1788872535.740250:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872535.740276:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788872535.740283:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327600384:0@lo:400:kworker.0 00000100:00100000:2.0:1788872535.740305:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872535.740322:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327600896:0@lo:400:kworker.0 00000100:00100000:2.0:1788872535.740343:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788872535.740372:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872535.740388:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327600512 00000100:00100000:2.0:1788872535.740395:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327600512 00000100:00100000:2.0:1788872535.740445:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327600384 00000100:00100000:2.0:1788872535.740448:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327600384 00000100:00100000:2.0:1788872535.740459:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1788872535.740467:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef77b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327600512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872535.740517:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef77b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327600512:12345-0@lo:400:kworker.0 Request processed in 51us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872535.740538:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1788872535.742076:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1788872535.742086:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875765327600384:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788872535.742094:0:68674:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788872535.742148:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875765327600384:12345-0@lo:400:kworker.0 Request processed in 61us (1841us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788872535.742154:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1788872535.742186:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327601152 00000100:00100000:2.0:1788872535.742193:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327601152 00000100:00100000:2.0:1788872535.742233:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327601024 00000100:00100000:2.0:1788872535.742236:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327601024 00000100:00100000:2.0:1788872535.742253:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403 00000100:00100000:2.0:1788872535.742263:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327601152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872535.742299:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327601152:12345-0@lo:400:kworker.0 Request processed in 41us (4292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872535.742305:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403 00000100:00100000:2.0:1788872535.742316:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00100000:2.0:1788872535.742322:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327601024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872535.742347:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327601024:12345-0@lo:400:kworker.0 Request processed in 25us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872535.742352:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:2.0:1788872535.742371:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327600896 00000100:00100000:2.0:1788872535.742376:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327600896 00000100:00100000:2.0:1788872535.742404:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:2.0:1788872535.742409:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1875765327600896:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788872535.742414:0:8447:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788872535.742454:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1875765327600896:12345-0@lo:400:kworker.0 Request processed in 44us (2110us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788872535.742460:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00080000:2.0:1788872535.742484:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872535.742488:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872535.742490:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872535.742524:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788872535.742529:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788872535.742532:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788872535.742538:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872535.742542:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3260 00000100:00080000:2.0:1788872535.742570:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872535.742597:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1eef800 x1875765327601408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872535.742629:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327600384:0@lo:400:kworker.0 00000100:00080000:2.0:1788872535.742643:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788872535.742645:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788872535.742648:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788872535.742652:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872535.742655:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3442 00000100:00080000:2.0:1788872535.742659:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872535.742671:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1eed180 x1875765327601536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872535.742679:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327600896:0@lo:400:kworker.0 00000100:00100000:2.0:1788872535.742703:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327600512:0@lo:400:kworker.0 00000100:00100000:2.0:1788872535.742713:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327601024:0@lo:400:kworker.0 00000100:00100000:2.0:1788872535.742785:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327601408:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788872535.742818:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872535.742837:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327601536:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788872535.742857:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872535.745424:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327601408 00000100:00100000:0.0:1788872535.745440:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327601408 00000100:00100000:0.0:1788872535.745502:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1788872535.745518:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327601408:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788872535.745544:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872535.745730:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327601536 00000100:00100000:1.0:1788872535.745736:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327601536 00000100:00100000:1.0:1788872535.745764:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:1.0:1788872535.745769:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327601536:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788872535.745780:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872535.753083:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327601408:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 7553us (10251us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872535.753116:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1788872535.753672:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327601536:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 7892us (10804us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872535.753684:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00080000:2.0:1788872535.759986:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872535.759998:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872535.760003:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327601408:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788872535.760019:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872535.760022:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872535.760024:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327601536:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788872535.762018:0:3645:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872535.762031:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3260 00000100:00080000:3.0:1788872535.762041:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872535.762089:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff7f0700 x1875765327601664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872535.762120:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327600640:0@lo:400:kworker.0 00000100:00100000:3.0:1788872535.762157:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327601152:0@lo:400:kworker.0 00000100:00100000:3.0:1788872535.762172:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327600768:0@lo:400:kworker.0 00000100:00080000:3.0:1788872535.762204:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788872535.762209:0:3645:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788872535.762212:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788872535.762216:0:3645:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872535.762219:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3260 00000100:00080000:3.0:1788872535.762223:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872535.762239:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff7f0e00 x1875765327601792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872535.762249:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327601280:0@lo:400:kworker.0 00000100:00100000:2.0:1788872535.764692:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327601664:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788872535.764785:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872535.764829:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327601792:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788872535.764854:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872535.765128:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327601664 00000100:00100000:1.0:1788872535.765138:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327601664 00000100:00100000:1.0:1788872535.765184:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327601792 00000100:00100000:1.0:1788872535.765187:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327601792 00000100:00100000:1.0:1788872535.765215:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1788872535.765224:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327601664:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788872535.765246:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872535.765298:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327601664:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 74us (512us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872535.765305:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1788872535.765321:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1788872535.765325:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327601792:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788872535.765349:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872535.765376:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327601792:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 48us (520us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872535.765382:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00080000:1.0:1788872535.765423:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872535.765428:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872535.765432:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327601664:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1788872535.765441:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872535.765444:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872535.765447:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327601792:0@lo:38:ptlrpcd_00_01.0 00000400:00000100:0.0:1788872535.824207:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311126656 offset 0 length 224: 4 00000100:00100000:0.0:1788872535.824262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872535.824300:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872535.824330:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872535.824358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872535.824393:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311127168 00000100:00100000:0.0:1788872535.824402:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311127168 00000100:00100000:0.0:1788872535.824459:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311127040 00000100:00100000:0.0:1788872535.824462:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311127040 00000100:00100000:0.0:1788872535.824479:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2405 00000100:00100000:0.0:1788872535.824488:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311127168:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872535.824608:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311127168:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 118us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872535.824616:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2405 00000100:00100000:3.0:1788872535.824633:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2406 00000100:00100000:3.0:1788872535.824669:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311127040:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872535.824805:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311126912 00000100:00100000:1.0:1788872535.824811:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311126912 00000100:00100000:1.0:1788872535.824843:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311126784 00000100:00100000:1.0:1788872535.824845:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311126784 00000100:00100000:1.0:1788872535.824862:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1028 00000100:00100000:1.0:1788872535.824869:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311126912:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872535.824914:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311126912:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 46us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872535.824921:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1028 00000100:00100000:1.0:1788872535.824933:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1036 00000100:00100000:1.0:1788872535.824937:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2405:x1875765311126784:12345-192.168.204.39@tcp:400:kworker.0 00000020:00080000:1.0:1788872535.824944:0:66979:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.39@tcp 00000100:00100000:1.0:1788872535.824962:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2405:x1875765311126784:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 24us (662us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788872535.824968:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1036 00000100:00080000:1.0:1788872535.825087:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872535.825095:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872535.825096:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872535.825133:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311127040:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 483us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872535.832521:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2406 00000100:00100000:1.0:1788872535.859473:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872535.868872:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311127296 00000100:00100000:0.0:1788872535.868909:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311127296 00000100:00100000:0.0:1788872535.869016:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1037 00000100:00100000:0.0:1788872535.869030:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875765311127296:12345-192.168.204.39@tcp:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788872535.869069:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872535.869189:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875765311127296:12345-192.168.204.39@tcp:38:ptlrpcd_00_01.0 Request processed in 160us (9734us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872535.869197:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1037 00010000:00010000:2.0:1788872536.319859:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872536.764176:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788872536.764227:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327601920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872536.764346:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872536.764503:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327601920 00000100:00100000:1.0:1788872536.764514:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327601920 00000100:00100000:1.0:1788872536.764615:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:1.0:1788872536.764625:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327601920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872536.764672:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872536.764748:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327601920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872536.764758:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:2.0:1788872536.764886:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872536.764899:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327602048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872536.764937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872536.765018:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327601920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872536.765209:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327602048 00000100:00100000:1.0:1788872536.765214:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327602048 00000100:00100000:1.0:1788872536.765251:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:1.0:1788872536.765259:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327602048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872536.765285:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872536.765331:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327602048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872536.765338:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00100000:2.0:1788872536.765454:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327602048:0@lo:13:osp-pre-1-1.0 00000020:01000000:0.0:1788872537.273831:0:84496:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a8c47cea80 - data ffff98a9e9180af8/ffff98a9ef8bc800 00000020:01000000:0.0:1788872537.274087:0:84496:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9e951b540 - data ffff98a9e900aca8/ffff98a9f00c5000 00000020:00000080:0.0:1788872537.274971:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d908a 00000020:00000080:0.0:1788872537.274986:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9fa734000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788872537.275017:0:84496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9fbfac800 from MGS, refs=2 00000020:01000004:0.0:1788872537.275022:0:84496:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9fbfac800 2 00000020:01000004:0.0:1788872537.275026:0:84496:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a9fbfac800 from MGS 00000020:00000080:0.0:1788872537.275065:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872537.275077:0:84496:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788872537.275080:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9fa733800/MGS 00000020:00000080:0.0:1788872537.275083:0:84496:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9fa733800/MGS for MGS 00000020:01000000:0.0:1788872537.275091:0:84496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788872537.275203:0:84496:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788872537.275208:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788872537.275219:0:84496:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788872537.275227:0:84496:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98a8c67ee000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788872537.275233:0:84496:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff98a9e9b0cd40) has exports, disconnecting them 00000020:00080000:0.0:1788872537.275239:0:84496:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98a8c67ee000), last request at 1788872318 00000020:00000080:0.0:1788872537.275243:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d91a2 00000020:00080000:0.0:1788872537.275254:0:84496:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a8c67ee000): rc 0 00000020:00000080:0.0:1788872537.275260:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a8c67ee000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788872537.276001:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9fa734000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788872537.276022:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c67ee000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788872537.278395:0:84496:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788872537.278409:0:84496:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788872537.278416:0:84496:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788872537.278426:0:84496:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788872537.278690:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872537.278707:0:84496:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788872537.278717:0:84496:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9fbfac800 1 00000020:00000080:1.0:1788872537.278726:0:84496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d907c 00000020:00000080:1.0:1788872537.278737:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9fa736000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788872537.278762:0:84496:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788872537.278769:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872537.278775:0:84496:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788872537.278779:0:84496:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff98a9efa799c0) has no exports 00000020:00000080:3.0:1788872537.279535:0:30879:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c2796800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788872537.279566:0:30879:0:(genops.c:906:class_export_put()) final put ffff98a8c67ea800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788872537.279571:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c67ea800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788872537.279582:0:30879:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788872537.279721:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9fa736000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788872537.337768:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788872537.354835:0:84496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872537.354868:0:84496:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788872537.354877:0:84496:0:(genops.c:906:class_export_put()) final put ffff98a9c6ae6800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788872537.354882:0:84496:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c6ae6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788872537.354900:0:84496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788872537.355887:0:84496:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98a9fbfaf800 00000020:02000400:2.0:1788872537.357125:0:84496:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788872538.360892:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872539.384945:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872540.413442:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788872540.860867:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872540.860875:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872540.860879:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872540.860887:0:30879:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3472 00000100:00080000:3.0:1788872540.860894:0:30879:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788872540.860900:0:30879:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872540.860937:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff7f2d80 x1875765327602304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872540.860963:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872540.860967:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872540.860969:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872540.860972:0:30879:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3472 00000100:00080000:3.0:1788872540.860975:0:30879:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788872540.860978:0:30879:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872540.860989:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff7f2300 x1875765327602560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872540.861014:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872540.861017:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872540.861019:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872540.861022:0:30879:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3472 00000100:00080000:3.0:1788872540.861024:0:30879:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1788872540.861025:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327602176:0@lo:400:kworker.0 00000100:00080000:3.0:1788872540.861028:0:30879:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872540.861037:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff7f3100 x1875765327602816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872540.861068:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872540.861071:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872540.861072:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872540.861075:0:30879:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3472 00000100:00080000:3.0:1788872540.861078:0:30879:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000400:00000100:2.0:1788872540.861078:0:3644:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327602176 offset 0 length 224: 4 00000100:00080000:3.0:1788872540.861081:0:30879:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872540.861089:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff7f3b80 x1875765327603200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872540.861108:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327602432:0@lo:400:kworker.0 00000100:00100000:2.0:1788872540.861119:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327603072:0@lo:400:kworker.0 00000100:00100000:3.0:1788872540.861147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872540.861147:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872540.861177:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327602304:0@lo:38:kworker.0 00000100:00100000:2.0:1788872540.861188:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327602944:0@lo:400:kworker.0 00000100:00100000:3.0:1788872540.861201:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872540.861209:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872540.861218:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327602560:0@lo:38:kworker.0 00000100:00100000:2.0:1788872540.861224:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872540.861229:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327602688:0@lo:400:kworker.0 00000100:00100000:3.0:1788872540.861237:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872540.861247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872540.861249:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327602816:0@lo:38:kworker.0 00000100:00100000:3.0:1788872540.861269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872540.861277:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327602432 00000100:00100000:3.0:1788872540.861284:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327603200:0@lo:38:kworker.0 00000100:00100000:2.0:1788872540.861284:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327602432 00000100:00100000:3.0:1788872540.861301:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872540.861328:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327602304 00000100:00100000:2.0:1788872540.861329:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327602560 00000100:00100000:3.0:1788872540.861331:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327602304 00000100:00100000:2.0:1788872540.861331:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327602560 00000100:00100000:2.0:1788872540.861340:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327602688 00000100:00100000:3.0:1788872540.861342:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327603200 00000100:00100000:2.0:1788872540.861342:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327602688 00000100:00100000:3.0:1788872540.861344:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327603200 00000100:00100000:3.0:1788872540.861354:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1788872540.863385:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327602432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872540.863500:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327602432:12345-0@lo:400:kworker.0 Request processed in 2138us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872540.863873:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327603072 00000100:00100000:1.0:1788872540.863881:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327603072 00000100:00100000:1.0:1788872540.863937:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327602944 00000100:00100000:1.0:1788872540.863941:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327602944 00000100:00100000:1.0:1788872540.863979:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407 00000100:00100000:1.0:1788872540.864001:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327603072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872540.864061:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327603072:12345-0@lo:400:kworker.0 Request processed in 74us (2914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872540.864068:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407 00000100:00100000:1.0:1788872540.864085:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408 00000100:00100000:1.0:1788872540.864092:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327602944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872540.864129:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327602944:12345-0@lo:400:kworker.0 Request processed in 38us (2919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872540.864135:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408 00000100:00100000:2.0:1788872540.869232:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1788872540.869259:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327602688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872540.870487:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327602688:12345-0@lo:400:kworker.0 Request processed in 1236us (9231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872540.870514:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1788872540.870626:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1788872540.870633:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327602560:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872540.870656:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872540.870716:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327602560:12345-0@lo:38:kworker.0 Request processed in 82us (9477us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872540.870722:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1788872540.870734:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:2.0:1788872540.870738:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327602304:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872540.870749:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872540.870772:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327602304:12345-0@lo:38:kworker.0 Request processed in 33us (9571us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872540.870778:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:2.0:1788872540.870803:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1788872540.870807:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327603200:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872540.870817:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872540.870840:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327603200:12345-0@lo:38:kworker.0 Request processed in 31us (9538us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872540.870846:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1788872540.871754:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327602816 00000100:00100000:2.0:1788872540.871766:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327602816 00000100:00100000:2.0:1788872540.871808:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:2.0:1788872540.871814:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327602816:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872540.871827:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872540.871877:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327602816:12345-0@lo:38:kworker.0 Request processed in 62us (10606us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872540.871883:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00000100:00100000:2.0:1788872540.871975:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327602432:0@lo:400:kworker.0 00000100:00080000:2.0:1788872540.872019:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872540.872024:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872540.872028:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327602304:0@lo:38:kworker.0 00000100:00080000:2.0:1788872540.872037:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872540.872041:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872540.872044:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327602560:0@lo:38:kworker.0 00000100:00080000:2.0:1788872540.872052:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872540.872055:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872540.872057:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327602816:0@lo:38:kworker.0 00000100:00080000:2.0:1788872540.872105:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872540.872109:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872540.872112:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327603200:0@lo:38:kworker.0 00000001:00100000:2.0:1788872540.874065:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788872540.874082:0:75620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411435 is committed 00000020:00000080:2.0:1788872540.874088:0:75620:0:(genops.c:906:class_export_put()) final put ffff98a9e98d0800/lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1788872540.874480:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872540.874487:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872540.874490:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872540.874540:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327602688:0@lo:400:kworker.0 00000100:00100000:2.0:1788872540.874571:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327602944:0@lo:400:kworker.0 00000100:00100000:2.0:1788872540.874628:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327603072:0@lo:400:kworker.0 00000001:00100000:0.0:1788872540.874823:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872540.874827:0:9516:0:(genops.c:906:class_export_put()) final put ffff98a9e99a4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872540.874856:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e98d0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788872540.875245:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788872540.875290:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e99a9800 for lustre-MDT0001 00000020:00000080:0.0:1788872540.875296:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e99a3000 for lustre-OST0001 00000100:00100000:3.0:1788872540.876056:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000001:00100000:1.0:1788872540.879272:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872540.879282:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a8c394b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788872540.882568:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c394b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788872540.882648:0:30879:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c394d800 for lustre-OST0000 00000400:00000100:2.0:1788872540.941494:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311127424 offset 0 length 224: 4 00000100:00100000:2.0:1788872540.941538:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872540.941601:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311127808 00000100:00100000:0.0:1788872540.941612:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311127808 00000100:00100000:2.0:1788872540.941618:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872540.941658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872540.941684:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311127936 00000100:00100000:0.0:1788872540.941689:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311127936 00000100:00100000:2.0:1788872540.941691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872540.941737:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2409 00000100:00100000:0.0:1788872540.941746:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311127808:12345-192.168.204.39@tcp:400:kworker.0 00000100:00080000:1.0:1788872540.941817:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872540.941823:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872540.941840:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311127808:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 93us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872540.941850:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2409 00000100:00100000:0.0:1788872540.941870:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2410 00000100:00100000:0.0:1788872540.941877:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311127936:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872540.941918:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311127936:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 41us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872540.941933:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2410 00000100:00100000:1.0:1788872540.942014:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311127680 00000100:00100000:1.0:1788872540.942019:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311127680 00000100:00100000:3.0:1788872540.942024:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311127552 00000100:00100000:3.0:1788872540.942030:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311127552 00000100:00100000:3.0:1788872540.952878:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1031 00000100:00100000:3.0:1788872540.952899:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311127680:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872540.953374:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311127680:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 481us (11754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872540.953384:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1031 00000100:00100000:3.0:1788872540.953408:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1041 00000100:00100000:3.0:1788872540.953413:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311127552:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:3.0:1788872540.953434:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872540.953461:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311127552:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 47us (11770us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872540.953469:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1041 00000100:00080000:0.0:1788872540.954036:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788872541.432789:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872541.886167:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327603328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872541.886239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872541.886274:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327603328 00000100:00100000:3.0:1788872541.886283:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327603328 00000100:00100000:3.0:1788872541.886335:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:3.0:1788872541.886345:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327603328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872541.886374:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872541.886376:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327603456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872541.886404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872541.886417:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327603328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872541.886423:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:3.0:1788872541.886436:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327603456 00000100:00100000:3.0:1788872541.886451:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327603456 00000100:00100000:3.0:1788872541.886473:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:3.0:1788872541.886478:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327603456:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872541.886480:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327603328:0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872541.886492:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872541.886522:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327603456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872541.886528:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00100000:0.0:1788872541.886536:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327603456:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788872542.457809:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872543.481229:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872544.506773:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872545.528915:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788872545.977030:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872545.977040:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872545.977044:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872545.977053:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3477 00000100:00080000:1.0:1788872545.977075:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788872545.977082:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872545.977118:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9faa78000 x1875765327603712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872545.977146:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872545.977149:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872545.977151:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872545.977155:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3477 00000100:00080000:1.0:1788872545.977157:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788872545.977160:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872545.977170:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9faa79500 x1875765327603968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872545.977184:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872545.977187:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872545.977189:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872545.977192:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3477 00000100:00080000:1.0:1788872545.977194:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788872545.977198:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872545.977209:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9faa79f80 x1875765327604224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872545.977228:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872545.977230:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872545.977232:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872545.977235:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3477 00000100:00080000:1.0:1788872545.977242:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788872545.977246:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872545.977258:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9faa7b100 x1875765327604608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872545.977631:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327603584:0@lo:400:kworker.0 00000400:00000100:3.0:1788872545.977704:0:3647:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327603584 offset 0 length 224: 4 00000100:00100000:3.0:1788872545.977749:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327604480:0@lo:400:kworker.0 00000100:00100000:3.0:1788872545.977786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872545.977826:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788872545.977832:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327604352:0@lo:400:kworker.0 00000100:00100000:3.0:1788872545.977854:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872545.977882:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327603840:0@lo:400:kworker.0 00000100:00100000:3.0:1788872545.977908:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872545.977930:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788872545.977935:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327604096:0@lo:400:kworker.0 00000100:00100000:3.0:1788872545.977954:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872545.977979:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327603840 00000100:00100000:3.0:1788872545.977987:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327603840 00000100:00100000:3.0:1788872545.978030:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327604096 00000100:00100000:3.0:1788872545.978033:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327604096 00000100:00100000:3.0:1788872545.978053:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1788872545.978062:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327603840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872545.978125:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327603840:12345-0@lo:400:kworker.0 Request processed in 64us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872545.978132:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1788872545.978172:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327603840:0@lo:400:kworker.0 00000100:00100000:3.0:1788872545.978196:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1788872545.978203:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327604096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872545.978236:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327604096:12345-0@lo:400:kworker.0 Request processed in 34us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872545.978242:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1788872545.978262:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327604096:0@lo:400:kworker.0 00000100:00080000:0.0:1788872545.978430:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872545.978952:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327604480 00000100:00100000:0.0:1788872545.978958:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327604480 00000100:00100000:0.0:1788872545.979004:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327604352 00000100:00100000:0.0:1788872545.979008:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327604352 00000100:00100000:0.0:1788872545.979029:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411 00000100:00100000:0.0:1788872545.979038:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327604480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872545.979123:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327604480:12345-0@lo:400:kworker.0 Request processed in 87us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872545.979138:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411 00000100:00100000:0.0:1788872545.979154:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412 00000100:00100000:0.0:1788872545.979160:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327604352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872545.979195:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327604352:12345-0@lo:400:kworker.0 Request processed in 35us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872545.979201:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412 00000100:00080000:3.0:1788872545.979340:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872545.979344:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872545.979370:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327604352:0@lo:400:kworker.0 00000100:00100000:3.0:1788872545.979381:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327604480:0@lo:400:kworker.0 00000100:00100000:2.0:1788872545.979475:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327603712:0@lo:38:kworker.0 00000100:00100000:2.0:1788872545.979516:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872545.979545:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327603968:0@lo:38:kworker.0 00000100:00100000:2.0:1788872545.979599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872545.979614:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327604224:0@lo:38:kworker.0 00000100:00100000:2.0:1788872545.979640:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872545.979658:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327604608:0@lo:38:kworker.0 00000100:00100000:2.0:1788872545.979680:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872545.979727:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327604224 00000100:00100000:2.0:1788872545.979731:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327604224 00000100:00100000:2.0:1788872545.979756:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:2.0:1788872545.979761:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327604224:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872545.979782:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872545.979823:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327604224:12345-0@lo:38:kworker.0 Request processed in 61us (181us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872545.979830:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00080000:2.0:1788872545.979866:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872545.979870:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872545.979873:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327604224:0@lo:38:kworker.0 00000100:00100000:2.0:1788872545.979890:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327603712 00000100:00100000:2.0:1788872545.979893:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327603712 00000100:00100000:2.0:1788872545.979909:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327603968 00000100:00100000:2.0:1788872545.979912:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327603968 00000100:00100000:2.0:1788872545.979921:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327604608 00000100:00100000:2.0:1788872545.979923:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327604608 00000100:00100000:2.0:1788872545.979933:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1788872545.979937:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327603712:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872545.979947:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872545.979976:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327603712:12345-0@lo:38:kworker.0 Request processed in 38us (460us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872545.979983:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00080000:2.0:1788872545.980001:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872545.980005:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872545.980008:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327603712:0@lo:38:kworker.0 00000100:00100000:2.0:1788872545.980026:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1788872545.980030:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327603968:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872545.980039:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872545.980068:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327603968:12345-0@lo:38:kworker.0 Request processed in 36us (468us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872545.980079:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00080000:2.0:1788872545.980116:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872545.980121:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872545.980124:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327603968:0@lo:38:kworker.0 00000100:00100000:2.0:1788872545.980143:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1788872545.980147:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327604608:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872545.980156:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872545.980183:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327604608:12345-0@lo:38:kworker.0 Request processed in 35us (502us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872545.980188:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00080000:2.0:1788872545.980206:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872545.980210:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872545.980213:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327604608:0@lo:38:kworker.0 00000100:00100000:1.0:1788872546.062732:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872546.062782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872546.062817:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000400:00000100:1.0:1788872546.062838:0:3639:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311128064 offset 0 length 224: 4 00000100:00100000:1.0:1788872546.062898:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872546.062933:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311128448 00000100:00100000:1.0:1788872546.062955:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311128448 00000100:00100000:1.0:1788872546.063011:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311128576 00000100:00100000:1.0:1788872546.063014:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311128576 00000100:00100000:1.0:1788872546.063038:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5927 00000100:00100000:1.0:1788872546.063048:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2403:x1875765311128448:12345-192.168.204.39@tcp:9:kworker.0 00000020:00000080:1.0:1788872546.063079:0:26185:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9481 00000100:00080000:1.0:1788872546.063099:0:26185:0:(import.c:65:import_set_state_nolock()) ffff98a8c67ef000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788872546.063139:0:26185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:1.0:1788872546.063309:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+2:2403:x1875765311128448:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 262us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872546.063317:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5927 00000100:00100000:1.0:1788872546.063332:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5928 00000100:00100000:1.0:1788872546.063338:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2403:x1875765311128576:12345-192.168.204.39@tcp:9:kworker.0 00000020:00000080:1.0:1788872546.063349:0:26185:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d8ff0 00000100:00080000:1.0:1788872546.063354:0:26185:0:(import.c:65:import_set_state_nolock()) ffff98a9e99ab800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788872546.063375:0:26185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:1.0:1788872546.063453:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+2:2403:x1875765311128576:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 114us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872546.063459:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5928 00010000:00010000:1.0:1788872546.063615:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872546.066202:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788872546.066217:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872546.066223:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872546.066245:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311128192 00000100:00100000:3.0:1788872546.066256:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311128192 00000100:00100000:3.0:1788872546.066304:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311128320 00000100:00100000:3.0:1788872546.066307:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311128320 00000100:00100000:3.0:1788872546.066369:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1034 00000100:00100000:3.0:1788872546.066380:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311128320:12345-192.168.204.39@tcp:400:kworker.0 00000100:00080000:0.0:1788872546.066670:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872546.066716:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1045 00000100:00100000:0.0:1788872546.066722:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311128192:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:0.0:1788872546.066744:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872546.067061:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311128320:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 681us (4160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872546.067086:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1034 00000100:00100000:0.0:1788872546.071838:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311128192:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 5101us (9103us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872546.071856:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1045 00010000:00010000:2.0:1788872546.552786:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872547.001830:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327604864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872547.001901:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872547.001955:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872547.001962:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327604736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872547.001986:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872547.002217:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327604864 00000100:00100000:2.0:1788872547.002225:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327604864 00000100:00100000:2.0:1788872547.002294:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327604736 00000100:00100000:2.0:1788872547.002298:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327604736 00000100:00100000:2.0:1788872547.002321:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:2.0:1788872547.002332:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327604864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872547.002363:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872547.002411:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327604864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872547.002419:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00100000:2.0:1788872547.002436:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:2.0:1788872547.002456:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327604736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872547.002472:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872547.002500:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327604736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872547.002505:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00080000:1.0:1788872547.002875:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872547.002879:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872547.002918:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327604736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872547.002933:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327604864:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788872547.578478:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872548.600821:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872549.624807:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872550.652328:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872551.097837:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327604992:0@lo:400:kworker.0 00000400:00000100:0.0:1788872551.097893:0:3646:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327604992 offset 0 length 224: 4 00000100:00080000:1.0:1788872551.098919:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872551.098926:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872551.098930:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872551.098937:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3483 00000100:00080000:1.0:1788872551.098943:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872551.098950:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872551.099745:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9faa79500 x1875765327605120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872551.099810:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872551.099814:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872551.099827:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872551.099831:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3483 00000100:00080000:1.0:1788872551.099834:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872551.099838:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872551.099854:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9faa79f80 x1875765327605376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872551.099885:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872551.099888:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872551.099890:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872551.099893:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3483 00000100:00080000:1.0:1788872551.099895:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872551.099899:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872551.100006:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327605248:0@lo:400:kworker.0 00000100:00100000:0.0:1788872551.100067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872551.100144:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327605248 00000100:00100000:0.0:1788872551.100151:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327605248 00000100:00100000:0.0:1788872551.100216:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1788872551.100226:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327605248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872551.100280:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327605248:12345-0@lo:400:kworker.0 Request processed in 55us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872551.100288:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00080000:0.0:1788872551.100320:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872551.100369:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327605248:0@lo:400:kworker.0 00000100:00100000:3.0:1788872551.100491:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327605120:0@lo:38:kworker.0 00000100:00100000:3.0:1788872551.100521:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872551.100576:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327605376:0@lo:38:kworker.0 00000100:00100000:3.0:1788872551.100611:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872551.100643:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327605504:0@lo:400:kworker.0 00000100:00100000:3.0:1788872551.100668:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872551.100696:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327605120 00000100:00100000:3.0:1788872551.100700:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327605120 00000100:00100000:3.0:1788872551.100718:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327605376 00000100:00100000:3.0:1788872551.100721:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327605376 00000100:00100000:3.0:1788872551.100733:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327605504 00000100:00100000:3.0:1788872551.100736:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327605504 00000100:00100000:3.0:1788872551.100760:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1788872551.100766:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327605504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872551.100803:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327605504:12345-0@lo:400:kworker.0 Request processed in 36us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872551.100810:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1788872551.100821:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1788872551.100826:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327605120:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872551.100843:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872551.100876:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327605120:12345-0@lo:38:kworker.0 Request processed in 49us (354us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872551.100882:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1788872551.100903:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1788872551.100907:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327605376:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872551.100929:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872551.100956:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327605376:12345-0@lo:38:kworker.0 Request processed in 47us (344us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872551.100961:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00080000:3.0:1788872551.100991:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872551.101009:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327605504:0@lo:400:kworker.0 00000100:00080000:3.0:1788872551.101031:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872551.101035:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872551.101038:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327605120:0@lo:38:kworker.0 00000100:00080000:3.0:1788872551.101045:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872551.101049:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872551.101051:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327605376:0@lo:38:kworker.0 00000100:00100000:1.0:1788872551.101367:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9faa78700 x1875765327605632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872551.101417:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872551.101421:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872551.101423:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872551.101427:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3483 00000100:00080000:1.0:1788872551.101430:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872551.101435:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872551.101449:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9faa79f80 x1875765327606016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872551.101476:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327605760:0@lo:400:kworker.0 00000100:00100000:1.0:1788872551.101509:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872551.101575:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327605760 00000100:00100000:1.0:1788872551.101580:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327605760 00000100:00100000:1.0:1788872551.101628:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413 00000100:00100000:1.0:1788872551.101635:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327605760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872551.101675:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327605760:12345-0@lo:400:kworker.0 Request processed in 41us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872551.101682:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413 00000100:00100000:1.0:1788872551.101714:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327605760:0@lo:400:kworker.0 00000100:00100000:0.0:1788872551.101823:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327605888:0@lo:400:kworker.0 00000100:00100000:0.0:1788872551.101853:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872551.101889:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327605632:0@lo:38:kworker.0 00000100:00100000:0.0:1788872551.101927:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872551.101949:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327606016:0@lo:38:kworker.0 00000100:00100000:0.0:1788872551.101981:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872551.102009:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327605632 00000100:00100000:0.0:1788872551.102013:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327605632 00000100:00100000:0.0:1788872551.102032:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:0.0:1788872551.102037:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327605632:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872551.102051:0:8446:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872551.102082:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327605632:12345-0@lo:38:kworker.0 Request processed in 44us (155us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872551.102088:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00080000:0.0:1788872551.102115:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872551.102119:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872551.102122:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327605632:0@lo:38:kworker.0 00000100:00100000:3.0:1788872551.102464:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327605888 00000100:00100000:3.0:1788872551.102468:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327605888 00000100:00100000:3.0:1788872551.102506:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414 00000100:00100000:3.0:1788872551.102514:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327605888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872551.102573:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327605888:12345-0@lo:400:kworker.0 Request processed in 60us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872551.102580:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414 00000100:00080000:3.0:1788872551.102609:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872551.102613:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872551.102630:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327606016 00000100:00100000:3.0:1788872551.102634:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327606016 00000100:00100000:3.0:1788872551.102654:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:3.0:1788872551.102667:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327606016:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872551.102679:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872551.102712:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327606016:12345-0@lo:38:kworker.0 Request processed in 43us (740us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872551.102717:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00080000:3.0:1788872551.102756:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872551.102760:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872551.102764:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327606016:0@lo:38:kworker.0 00000100:00100000:0.0:1788872551.103210:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327605888:0@lo:400:kworker.0 00000100:00100000:1.0:1788872551.177799:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872551.177840:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000400:00000100:1.0:1788872551.177870:0:3639:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311128704 offset 0 length 224: 4 00000100:00100000:0.0:1788872551.177963:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311128960 00000100:00100000:0.0:1788872551.177981:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311128960 00000100:00100000:0.0:1788872551.178065:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311128832 00000100:00100000:0.0:1788872551.178068:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311128832 00000100:00100000:0.0:1788872551.178090:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1037 00000100:00100000:0.0:1788872551.178100:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311128960:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872551.178186:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311128960:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 87us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872551.178194:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1037 00000100:00100000:0.0:1788872551.178215:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1049 00000100:00100000:0.0:1788872551.178220:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875765311128832:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:0.0:1788872551.178242:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872551.178265:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875765311128832:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 44us (425us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872551.178271:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1049 00000100:00080000:1.0:1788872551.178445:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1788872551.611024:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:1.0:1788872551.611034:0:9516:0:(genops.c:906:class_export_put()) final put ffff98a9e99ac000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:1.0:1788872551.611062:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ac000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-OST0001 00000020:00000080:1.0:1788872551.611121:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e99ab800 for lustre-OST0001 00000001:00100000:2.0:1788872551.614989:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:2.0:1788872551.615000:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a9e99ab000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:0.0:1788872551.615082:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ab000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-OST0000 00000020:00000080:0.0:1788872551.615130:0:30879:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c67ef000 for lustre-OST0000 00010000:00010000:1.0:1788872551.675686:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872552.121687:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872552.121704:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327606144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872552.121775:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872552.121820:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327606144 00000100:00100000:1.0:1788872552.121827:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327606144 00000100:00100000:1.0:1788872552.121871:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:1.0:1788872552.121879:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327606144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872552.121908:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872552.121949:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327606144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872552.121969:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00100000:1.0:1788872552.122015:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327606144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872552.122853:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872552.122866:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327606272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872552.122907:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872552.123085:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327606272 00000100:00100000:3.0:1788872552.123090:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327606272 00000100:00100000:3.0:1788872552.123130:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:3.0:1788872552.123138:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327606272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872552.123159:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872552.123207:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327606272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872552.123214:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00100000:1.0:1788872552.123379:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327606272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872552.224368:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000400:00000100:3.0:1788872552.224407:0:3637:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311129088 offset 0 length 520: 4 00000100:00100000:3.0:1788872552.224465:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872552.224544:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311129344 00000100:00100000:1.0:1788872552.224587:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311129344 00000100:00100000:1.0:1788872552.224642:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311129216 00000100:00100000:1.0:1788872552.224645:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311129216 00000100:00100000:1.0:1788872552.224663:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1038 00000100:00100000:1.0:1788872552.224671:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311129344:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872552.224739:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311129344:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 68us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872552.224745:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1038 00000100:00100000:1.0:1788872552.224760:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1050 00000100:00100000:1.0:1788872552.224764:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875765311129216:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:1.0:1788872552.224785:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872552.224804:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875765311129216:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 39us (339us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872552.224810:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1050 00010000:00010000:1.0:1788872552.698335:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872553.725760:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872554.745729:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872555.769140:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788872556.216827:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872556.216836:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872556.216840:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872556.216851:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3488 00000100:00080000:2.0:1788872556.216857:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872556.216867:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872556.216898:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1ca9f80 x1875765327606528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872556.216937:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872556.216942:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872556.216943:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872556.216947:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3488 00000100:00080000:2.0:1788872556.216950:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1788872556.216951:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1788872556.216953:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872556.216964:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1ca8a80 x1875765327606784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872556.216976:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327606656:0@lo:400:kworker.0 00000100:00080000:2.0:1788872556.216980:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872556.216992:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872556.216994:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872556.216998:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3488 00000100:00080000:2.0:1788872556.217001:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872556.217005:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872556.217018:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1cab480 x1875765327607040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872556.217041:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872556.217045:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872556.217046:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872556.217050:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3488 00000100:00080000:2.0:1788872556.217052:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872556.217056:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872556.217066:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1caa300 x1875765327607424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000400:2.0:1788872556.217097:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788872540/real 1788872540] req@ffff98a9ff7f1500 x1875765327602176/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872556 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872556.217099:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872556.217292:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327606400:0@lo:400:kworker.0 00000100:00100000:2.0:1788872556.217380:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff98a9ff7f1500 x1875765327602176/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872556 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788872556.217389:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788872556.217392:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1788872556.220370:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327606912:0@lo:400:kworker.0 00000100:00100000:0.0:1788872556.220471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872556.220577:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327606656 00000100:00100000:0.0:1788872556.220590:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327606656 00000100:00100000:0.0:1788872556.220675:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327606912 00000100:00100000:0.0:1788872556.220678:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327606912 00000100:00100000:0.0:1788872556.220708:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:0.0:1788872556.220718:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327606656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872556.220796:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327606656:12345-0@lo:400:kworker.0 Request processed in 79us (3696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872556.220803:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:0.0:1788872556.220842:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1788872556.220849:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327606912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872556.220882:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327606912:12345-0@lo:400:kworker.0 Request processed in 33us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872556.220888:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00080000:0.0:1788872556.221039:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872556.222346:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327606912:0@lo:400:kworker.0 00000100:00100000:0.0:1788872556.222369:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327606656:0@lo:400:kworker.0 00000400:00000100:1.0:1788872556.229241:0:3645:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327606400 offset 0 length 224: 4 00000100:00100000:1.0:1788872556.229335:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327607296:0@lo:400:kworker.0 00000100:00100000:1.0:1788872556.229396:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872556.229461:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872556.229470:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327607168:0@lo:400:kworker.0 00000100:00100000:1.0:1788872556.229512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872556.229586:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327607296 00000100:00100000:1.0:1788872556.229596:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327607296 00000100:00100000:1.0:1788872556.229685:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327607168 00000100:00100000:1.0:1788872556.229689:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327607168 00000100:00100000:1.0:1788872556.229717:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415 00000100:00100000:1.0:1788872556.229729:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327607296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872556.229819:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327607296:12345-0@lo:400:kworker.0 Request processed in 92us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872556.229828:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415 00000100:00100000:1.0:1788872556.229852:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416 00000100:00100000:1.0:1788872556.229863:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327607168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872556.229898:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327607168:12345-0@lo:400:kworker.0 Request processed in 38us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872556.229906:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416 00000100:00100000:1.0:1788872556.229964:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327607168:0@lo:400:kworker.0 00000100:00100000:1.0:1788872556.229977:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327607296:0@lo:400:kworker.0 00000100:00080000:0.0:1788872556.230417:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872556.230423:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872556.234542:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327606528:0@lo:38:kworker.0 00000100:00100000:3.0:1788872556.234692:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872556.234745:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327606784:0@lo:38:kworker.0 00000100:00100000:3.0:1788872556.234788:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872556.234810:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327607040:0@lo:38:kworker.0 00000100:00100000:3.0:1788872556.234861:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872556.234884:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327607424:0@lo:38:kworker.0 00000100:00100000:3.0:1788872556.234907:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872556.234958:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327606528 00000100:00100000:3.0:1788872556.234970:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327606528 00000100:00100000:3.0:1788872556.235013:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327606784 00000100:00100000:3.0:1788872556.235017:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327606784 00000100:00100000:3.0:1788872556.235029:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327607424 00000100:00100000:3.0:1788872556.235031:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327607424 00000100:00100000:3.0:1788872556.235051:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:3.0:1788872556.235060:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327606528:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872556.235092:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872556.235148:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327606528:12345-0@lo:38:kworker.0 Request processed in 87us (455us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872556.235156:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:3.0:1788872556.235176:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:3.0:1788872556.235179:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327606784:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872556.235189:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872556.237074:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1788872556.237091:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327607424:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872556.237121:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872556.237234:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327607424:12345-0@lo:38:kworker.0 Request processed in 144us (2324us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872556.237242:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1788872556.237683:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327606784:12345-0@lo:38:kworker.0 Request processed in 2500us (2892us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872556.237692:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00080000:3.0:1788872556.237771:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872556.237778:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872556.237783:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327606528:0@lo:38:kworker.0 00000100:00080000:3.0:1788872556.237795:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872556.237799:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872556.237823:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327606784:0@lo:38:kworker.0 00000100:00080000:3.0:1788872556.237838:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872556.237842:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872556.237845:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327607424:0@lo:38:kworker.0 00000100:00100000:3.0:1788872556.237926:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327607040 00000100:00100000:3.0:1788872556.237934:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327607040 00000100:00100000:3.0:1788872556.237985:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:3.0:1788872556.237991:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327607040:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872556.238005:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872556.238043:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327607040:12345-0@lo:38:kworker.0 Request processed in 51us (3181us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872556.238049:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00000100:00080000:3.0:1788872556.238071:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872556.238075:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872556.238078:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327607040:0@lo:38:kworker.0 00000100:00080000:2.0:1788872556.240396:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.139@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788872556.240403:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788872556.240415:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9ff7f1500 x1875765327602176/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872556 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872556.240446:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9faa79c00 x1875765327603584/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872561 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872556.240475:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9faa7b100 x1875765327604992/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872556.240488:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a8c1caaa00 x1875765327606400/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872572 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788872556.240520:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788872556.240523:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788872556.240525:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788872556.240527:0:3644:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1788872556.240625:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327602176:0@lo:400:kworker.0 00000100:00100000:3.0:1788872556.241025:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327604992:0@lo:400:kworker.0 00000100:00100000:3.0:1788872556.241087:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327603584:0@lo:400:kworker.0 00000100:00080000:2.0:1788872556.243784:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872556.243797:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788872556.243802:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872556.243815:0:30879:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3255 00000100:00080000:2.0:1788872556.243828:0:30879:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872556.243875:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327606400:0@lo:400:kworker.0 00000100:00100000:2.0:1788872556.243879:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1cabb80 x1875765327607552/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872556.243950:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327607552:0@lo:250:kworker.0 00000400:00000100:3.0:1788872556.244026:0:3643:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327607552 offset 0 length 520: 4 00010000:00010000:2.0:1788872556.795684:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872557.240789:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872557.240823:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327607680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872557.240936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872557.241003:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327607680 00000100:00100000:1.0:1788872557.241013:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327607680 00000100:00100000:1.0:1788872557.241086:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:1.0:1788872557.241097:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327607680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872557.241139:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872557.241203:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327607680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872557.241211:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:1.0:1788872557.241274:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327607680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872557.242641:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872557.242666:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327607808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872557.242745:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872557.242956:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327607808 00000100:00100000:3.0:1788872557.242966:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327607808 00000100:00100000:3.0:1788872557.243036:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:3.0:1788872557.243076:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327607808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872557.243112:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872557.243178:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327607808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872557.243186:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00100000:2.0:1788872557.243436:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327607808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872557.324573:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872557.324625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872557.325182:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311129600 00000100:00100000:2.0:1788872557.325220:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311129600 00000100:00080000:0.0:1788872557.325304:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872557.325312:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311129472 00000100:00100000:0.0:1788872557.325335:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1041 00000100:00100000:2.0:1788872557.325337:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311129472 00000100:00100000:0.0:1788872557.325353:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311129600:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872557.325373:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1054 00000100:00100000:2.0:1788872557.325382:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875765311129472:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:2.0:1788872557.325411:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872557.325468:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311129600:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 121us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872557.325488:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1041 00000100:00100000:2.0:1788872557.326448:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875765311129472:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 1055us (1810us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872557.326459:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1054 00010000:00010000:2.0:1788872557.817793:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872558.841167:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872559.865080:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872560.889117:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788872561.339004:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872561.339014:0:52416:0:(pinger.c:247:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788872561.339017:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872561.339021:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872561.339025:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872561.339033:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3493 00000100:00080000:3.0:1788872561.339038:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872561.339045:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872561.339082:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a48a80 x1875765327607936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872561.339130:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872561.339134:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872561.339136:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872561.339139:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3493 00000100:00080000:3.0:1788872561.339142:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872561.339145:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872561.339156:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a4a680 x1875765327608192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872561.339191:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872561.339194:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872561.339196:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872561.339199:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3493 00000100:00080000:3.0:1788872561.339201:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872561.339205:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872561.339216:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a4ad80 x1875765327608448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872561.339246:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872561.339249:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872561.339251:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788872561.339374:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327608064:0@lo:400:kworker.0 00000100:00100000:2.0:1788872561.339458:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872561.339497:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872561.339503:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327608320:0@lo:400:kworker.0 00000100:00100000:2.0:1788872561.339530:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872561.339585:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327608064 00000100:00100000:2.0:1788872561.339592:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327608064 00000100:00100000:2.0:1788872561.339646:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327608320 00000100:00100000:2.0:1788872561.339649:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327608320 00000100:00100000:2.0:1788872561.339676:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1788872561.339687:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327608064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872561.339739:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327608064:12345-0@lo:400:kworker.0 Request processed in 54us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872561.339746:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1788872561.339764:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1788872561.339770:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327608320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872561.339795:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327608320:12345-0@lo:400:kworker.0 Request processed in 26us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872561.339809:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00080000:2.0:1788872561.339826:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872561.339844:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327607936:0@lo:38:kworker.0 00000100:00100000:2.0:1788872561.339871:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872561.339888:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327608192:0@lo:38:kworker.0 00000100:00100000:2.0:1788872561.339907:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872561.339920:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327608448:0@lo:38:kworker.0 00000100:00100000:2.0:1788872561.339943:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872561.339967:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327607936 00000100:00100000:2.0:1788872561.339971:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327607936 00000100:00100000:2.0:1788872561.340043:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327608192 00000100:00100000:2.0:1788872561.340046:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327608192 00000100:00100000:2.0:1788872561.340061:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1788872561.340066:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327607936:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872561.340083:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872561.340115:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327607936:12345-0@lo:38:kworker.0 Request processed in 48us (244us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872561.340122:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1788872561.340133:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1788872561.340137:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327608192:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872561.340146:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872561.340168:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327608192:12345-0@lo:38:kworker.0 Request processed in 29us (260us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872561.340173:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1788872561.340190:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327608448 00000100:00100000:2.0:1788872561.340199:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327608448 00000100:00100000:2.0:1788872561.340221:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:2.0:1788872561.340224:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327608448:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872561.340233:0:8446:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872561.340335:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327608448:12345-0@lo:38:kworker.0 Request processed in 109us (391us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872561.340341:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00100000:2.0:1788872561.340381:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327608320:0@lo:400:kworker.0 00000100:00100000:2.0:1788872561.340392:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327608064:0@lo:400:kworker.0 00000100:00080000:2.0:1788872561.340429:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872561.340434:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872561.340437:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327607936:0@lo:38:kworker.0 00000100:00080000:2.0:1788872561.340444:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872561.340447:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872561.340449:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327608192:0@lo:38:kworker.0 00000100:00080000:2.0:1788872561.340456:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872561.340459:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872561.340462:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327608448:0@lo:38:kworker.0 00000100:00080000:3.0:1788872561.340533:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3493 00000100:00080000:3.0:1788872561.340536:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872561.340542:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872561.340582:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a48000 x1875765327608832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872561.340620:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327608576:0@lo:400:kworker.0 00000100:00100000:3.0:1788872561.340651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872561.340674:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872561.340680:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327608704:0@lo:400:kworker.0 00000100:00100000:3.0:1788872561.340700:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872561.340734:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327608576 00000100:00100000:3.0:1788872561.340737:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327608576 00000100:00100000:3.0:1788872561.340770:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327608704 00000100:00100000:3.0:1788872561.340779:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327608704 00000100:00100000:3.0:1788872561.340800:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417 00000100:00100000:3.0:1788872561.340806:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327608576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872561.340841:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327608576:12345-0@lo:400:kworker.0 Request processed in 35us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872561.340847:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417 00000100:00100000:3.0:1788872561.340861:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418 00000100:00100000:3.0:1788872561.340866:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327608704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872561.340891:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327608704:12345-0@lo:400:kworker.0 Request processed in 24us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872561.340897:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418 00000100:00100000:3.0:1788872561.340928:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327608704:0@lo:400:kworker.0 00000100:00100000:3.0:1788872561.340937:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327608576:0@lo:400:kworker.0 00000100:00080000:3.0:1788872561.340953:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872561.340956:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872561.341293:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327608832:0@lo:38:kworker.0 00000100:00100000:2.0:1788872561.341326:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872561.341502:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327608832 00000100:00100000:3.0:1788872561.341508:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327608832 00000100:00100000:3.0:1788872561.341539:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1788872561.341545:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327608832:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872561.341585:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872561.341620:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327608832:12345-0@lo:38:kworker.0 Request processed in 74us (293us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872561.341627:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00080000:3.0:1788872561.341651:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872561.341655:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872561.341658:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327608832:0@lo:38:kworker.0 00010000:00010000:3.0:1788872561.919158:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872562.362641:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872562.362669:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327608960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872562.362740:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872562.362798:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327608960 00000100:00100000:3.0:1788872562.362805:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327608960 00000100:00100000:3.0:1788872562.362848:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:3.0:1788872562.362857:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327608960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872562.362903:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872562.362951:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327608960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872562.362959:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:3.0:1788872562.363006:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327608960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872562.364444:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872562.364474:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327609088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872562.364528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872562.364699:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327609088 00000100:00100000:3.0:1788872562.364707:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327609088 00000100:00100000:3.0:1788872562.364753:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:3.0:1788872562.364762:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327609088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872562.364790:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872562.364838:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327609088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872562.364844:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:3.0:1788872562.366053:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327609088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872562.443221:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872562.443302:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311129856 00000100:00100000:3.0:1788872562.443313:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311129856 00000100:00100000:3.0:1788872562.443398:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1044 00000100:00100000:3.0:1788872562.443408:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311129856:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872562.443495:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311129856:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 89us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872562.443503:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1044 00000100:00080000:0.0:1788872562.443776:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872562.444272:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872562.444336:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311129728 00000100:00100000:0.0:1788872562.444342:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311129728 00000100:00100000:0.0:1788872562.444387:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1058 00000100:00100000:0.0:1788872562.444394:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875765311129728:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:0.0:1788872562.444415:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872562.444462:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875765311129728:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 67us (192us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872562.444469:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1058 00000400:00000100:3.0:1788872562.445704:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311129984 offset 0 length 520: 4 00010000:00010000:1.0:1788872562.939780:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788872563.552824:0:85117:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788872563.552834:0:85117:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788872563.552836:0:85117:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788872563.553506:0:85117:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98a9fa733800 00000020:01000004:1.0:1788872563.553529:0:85117:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788872563.553594:0:85117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788872563.553618:0:85117:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98a9f6710000) 00000020:00000080:1.0:1788872563.553647:0:85117:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788872563.829225:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788872563.841690:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.848093:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788872563.858070:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788872563.859776:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788872563.860223:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788872563.860518:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788872563.861129:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788872563.861431:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788872563.861876:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788872563.862160:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788872563.862450:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788872563.863405:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788872563.863934:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788872563.864323:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788872563.886190:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788872563.886443:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788872563.886984:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788872563.888066:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788872563.891762:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.901490:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788872563.902933:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788872563.903828:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788872563.904475:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788872563.904997:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788872563.907123:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.907780:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.908415:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.909174:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.909829:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.910223:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788872563.910449:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.910978:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788872563.911210:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788872563.911425:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788872563.912753:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788872563.913127:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.914079:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.914369:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788872563.916076:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788872563.916628:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.917924:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.918814:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.920052:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788872563.924218:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788872563.924915:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788872563.925381:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788872563.930703:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788872563.932729:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788872563.933866:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788872563.935272:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788872563.935925:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788872563.936686:0:85117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788872563.941433:0:85117:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788872563.942093:0:85117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788872563.942109:0:85117:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788872563.942127:0:85117:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9599 00000020:01000004:3.0:1788872563.942149:0:85117:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788872563.942165:0:85117:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788872563.942173:0:85117:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a9fa733800 from MGS 00000020:01000004:3.0:1788872563.942177:0:85117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788872563.942192:0:85117:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98a9efa78000) 00000020:00000080:3.0:1788872563.942207:0:85117:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:3.0:1788872563.942304:0:85117:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9fa733800 from MGS, refs=2 00080000:01000000:3.0:1788872563.942329:0:85117:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788872563.942336:0:85117:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d95a7 00010000:00010000:3.0:1788872563.942705:0:85117:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1788872563.957472:0:85117:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788872563.959070:0:85122:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788872563.959148:0:85117:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788872563.959211:0:85117:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00010000:00010000:1.0:1788872563.960678:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788872563.960992:0:85117:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788872563.961415:0:85117:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788872563.963786:0:85117:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788872563.963803:0:85117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788872563.984747:0:85117:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788872563.984769:0:85117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788872563.990101:0:85117:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788872563.990125:0:85117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788872563.992921:0:85117:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788872563.992965:0:85117:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1788872563.992968:0:85117:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.139@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1788872563.992973:0:85117:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.139@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1788872563.992981:0:85117:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98a9e98d3800 already not connected (conn 59, was 0): CONNECTING 00000100:00100000:2.0:1788872563.992989:0:85117:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:3.0:1788872564.985322:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872566.009164:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872566.456842:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788872556/real 1788872556] req@ffff98a8c1cabb80 x1875765327607552/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788872566 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872566.456919:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98a8c1cabb80 x1875765327607552/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788872566 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872566.456947:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872566.456996:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788872566.457012:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327607552:0@lo:250:kworker.0 10000000:01000000:2.0:1788872566.457199:0:85117:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1788872566.457224:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8a00/0xe4e6e89fb01d925f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457236:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8a00/0xe4e6e89fb01d925f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457244:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788872566.457265:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457278:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8a00/0xe4e6e89fb01d925f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9266 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.457311:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e000/0xe4e6e89fb01d91c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d91cc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457318:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e000/0xe4e6e89fb01d91c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d91cc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457326:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872566.457331:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457334:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e000/0xe4e6e89fb01d91c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d91cc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.457343:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d91e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d91e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457349:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d91e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d91e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457354:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872566.457357:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457360:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d91e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d91e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.457377:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f800/0xe4e6e89fb01d920b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457384:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f800/0xe4e6e89fb01d920b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457388:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872566.457391:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457394:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f800/0xe4e6e89fb01d920b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9212 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.457401:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3a00/0xe4e6e89fb01d9219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457406:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3a00/0xe4e6e89fb01d9219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457411:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872566.457414:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457417:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3a00/0xe4e6e89fb01d9219 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9220 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.457426:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fc00/0xe4e6e89fb01d9235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d923c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457432:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fc00/0xe4e6e89fb01d9235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d923c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457437:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872566.457445:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457449:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fc00/0xe4e6e89fb01d9235 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d923c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.457458:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01d9243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d924a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457464:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01d9243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d924a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457469:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872566.457472:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457475:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01d9243 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d924a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.457482:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8200/0xe4e6e89fb01d926d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9274 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457488:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8200/0xe4e6e89fb01d926d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9274 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457493:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872566.457495:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457498:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8200/0xe4e6e89fb01d926d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9274 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.457509:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d91d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d91da expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457516:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d91d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d91da expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457532:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872566.457535:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457539:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d91d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d91da expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.457605:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d91ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d91f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457612:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d91ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d91f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457616:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872566.457619:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457627:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d91ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d91f6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.457638:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2400/0xe4e6e89fb01d91fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457645:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2400/0xe4e6e89fb01d91fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457649:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788872566.457652:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457656:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2400/0xe4e6e89fb01d91fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9204 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.457663:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01d9227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d922e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457679:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01d9227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d922e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457684:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788872566.457687:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457690:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01d9227 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d922e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.457698:0:85117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d9251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872566.457703:0:85117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d9251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.457708:0:85117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788872566.457710:0:85117:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872566.457712:0:85117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d9251 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9258 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788872566.457726:0:85117:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98a9e98d3800 already not connected (conn 59, was 0): DISCONN 00000100:00080000:2.0:1788872566.457732:0:85117:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872566.457737:0:85117:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3493 00000100:00080000:2.0:1788872566.457743:0:85117:0:(import.c:589:import_select_connection()) MGC192.168.204.139@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788872566.457749:0:85117:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872566.457783:0:85117:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1caa300 x1875765327609216/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872566.457802:0:85117:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1788872566.458039:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327609216:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788872566.458188:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788872566.458839:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872566.458845:0:30879:0:(pinger.c:247:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788872566.458848:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872566.458852:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872566.458856:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872566.458862:0:30879:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3498 00000100:00080000:1.0:1788872566.458865:0:30879:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872566.458871:0:30879:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872566.458905:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9cb5d8000 x1875765327609344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872566.458972:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872566.458976:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872566.458979:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872566.458982:0:30879:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3498 00000100:00080000:1.0:1788872566.458984:0:30879:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872566.458988:0:30879:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872566.459001:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9cb5d9f80 x1875765327609600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872566.459018:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872566.459022:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872566.459023:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872566.459026:0:30879:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3498 00000100:00080000:1.0:1788872566.459041:0:30879:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872566.459046:0:30879:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872566.459058:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9cb5d9180 x1875765327609856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872566.459106:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872566.459110:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872566.459112:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872566.459115:0:30879:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3498 00000100:00080000:1.0:1788872566.459117:0:30879:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872566.459121:0:30879:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872566.459132:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c4d16300 x1875765327610240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872566.459186:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327609728:0@lo:400:kworker.0 00000100:00100000:1.0:1788872566.459239:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872566.459267:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872566.459272:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327609472:0@lo:400:kworker.0 00000100:00100000:1.0:1788872566.459291:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872566.459333:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327609984:0@lo:400:kworker.0 00000100:00100000:1.0:1788872566.459364:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872566.459382:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872566.459388:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327610112:0@lo:400:kworker.0 00000100:00100000:1.0:1788872566.459408:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872566.459448:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327609728 00000100:00100000:1.0:1788872566.459456:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327609728 00000100:00100000:1.0:1788872566.459513:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327609472 00000100:00100000:1.0:1788872566.459525:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327609472 00000100:00100000:1.0:1788872566.459607:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1788872566.459617:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327609728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872566.459676:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327609728:12345-0@lo:400:kworker.0 Request processed in 59us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.459685:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1788872566.459706:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:1.0:1788872566.459712:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327609472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872566.459742:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327609472:12345-0@lo:400:kworker.0 Request processed in 31us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.459748:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:1.0:1788872566.459791:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327609472:0@lo:400:kworker.0 00000100:00100000:1.0:1788872566.459801:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327609728:0@lo:400:kworker.0 00000100:00100000:0.0:1788872566.460268:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327609984 00000100:00100000:0.0:1788872566.460274:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327609984 00000100:00100000:0.0:1788872566.460329:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327610112 00000100:00100000:0.0:1788872566.460332:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327610112 00000100:00100000:0.0:1788872566.460357:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419 00000100:00100000:0.0:1788872566.460365:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327609984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872566.460447:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327609984:12345-0@lo:400:kworker.0 Request processed in 83us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872566.460454:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419 00000100:00100000:0.0:1788872566.460470:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:0.0:1788872566.460475:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327610112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872566.460508:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327610112:12345-0@lo:400:kworker.0 Request processed in 31us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872566.460513:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00080000:0.0:1788872566.460539:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872566.460543:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872566.460546:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872566.460596:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327610112:0@lo:400:kworker.0 00000100:00100000:0.0:1788872566.460620:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327609984:0@lo:400:kworker.0 00000100:00100000:3.0:1788872566.460782:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327609344:0@lo:38:kworker.0 00000100:00100000:3.0:1788872566.460824:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872566.460858:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327609600:0@lo:38:kworker.0 00000100:00100000:3.0:1788872566.460882:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872566.460901:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327609856:0@lo:38:kworker.0 00000100:00100000:3.0:1788872566.460932:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872566.460952:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327610240:0@lo:38:kworker.0 00000100:00100000:3.0:1788872566.460989:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872566.461024:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327609344 00000100:00100000:3.0:1788872566.461028:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327609344 00000100:00100000:3.0:1788872566.461052:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327609600 00000100:00100000:3.0:1788872566.461054:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327609600 00000100:00100000:3.0:1788872566.461064:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327610240 00000100:00100000:3.0:1788872566.461066:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327610240 00000100:00100000:3.0:1788872566.461091:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1788872566.461097:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327609344:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872566.461121:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872566.461158:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327609344:12345-0@lo:38:kworker.0 Request processed in 61us (333us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872566.461173:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1788872566.461187:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1788872566.461191:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327609600:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872566.461202:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872566.461228:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327609600:12345-0@lo:38:kworker.0 Request processed in 35us (344us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872566.461234:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1788872566.461245:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1788872566.461248:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327610240:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872566.461256:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872566.461279:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327610240:12345-0@lo:38:kworker.0 Request processed in 30us (289us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872566.461285:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1788872566.461317:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327609856 00000100:00100000:3.0:1788872566.461321:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327609856 00000100:00100000:3.0:1788872566.461344:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:3.0:1788872566.461348:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327609856:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872566.461358:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872566.461385:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327609856:12345-0@lo:38:kworker.0 Request processed in 35us (452us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872566.461391:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00080000:3.0:1788872566.461454:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872566.461461:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872566.461464:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327609344:0@lo:38:kworker.0 00000100:00080000:3.0:1788872566.461484:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872566.461487:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872566.461490:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327609600:0@lo:38:kworker.0 00000100:00080000:3.0:1788872566.461497:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872566.461501:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872566.461503:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327609856:0@lo:38:kworker.0 00000100:00080000:3.0:1788872566.461510:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872566.461513:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872566.461516:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327610240:0@lo:38:kworker.0 00000100:00100000:2.0:1788872566.461575:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327609216 00000100:00100000:2.0:1788872566.461590:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327609216 00000100:00100000:2.0:1788872566.461619:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788872566.461625:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1875765327609216:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788872566.461645:0:85123:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo t0 exp 0000000000000000 cur 3503 last 0 00000020:00000080:2.0:1788872566.461682:0:85123:0:(genops.c:1406:class_connect()) connect: client f2e885a0-f180-4b85-9f87-6a01e20afd1a, cookie 0xe4e6e89fb01d95ae 00000100:00080000:2.0:1788872566.461845:0:85123:0:(import.c:65:import_set_state_nolock()) ffff98a9fbfae800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872566.461907:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:3643:x1875765327609216:12345-0@lo:250:mount.lustre.0 Request processed in 281us (3719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872566.461915:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788872566.463165:0:3643:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.139@tcp: committing for last_committed 0 gen 24 00000100:00080000:3.0:1788872566.463183:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.139@tcp: connect to target with instance 0 00000100:00080000:3.0:1788872566.463195:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788872566.463203:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788872566.463208:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788872566.463212:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788872566.463311:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788872566.463332:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327609216:0@lo:250:mount.lustre.0 00000020:01000000:2.0:1788872566.463423:0:52416:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.139@tcp 10000000:01000000:2.0:1788872566.463458:0:52416:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1788872566.463462:0:52416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788872566.463464:0:52416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788872566.463466:0:52416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872566.463467:0:52416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872566.463469:0:52416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872566.463470:0:52416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872566.463472:0:52416:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788872566.463474:0:52416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872566.463475:0:52416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788872566.463530:0:52416:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788872566.463537:0:52416:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1788872566.463538:0:52416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788872566.463540:0:52416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788872566.463541:0:52416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872566.463542:0:52416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872566.463543:0:52416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872566.463544:0:52416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872566.463545:0:52416:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788872566.463546:0:52416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872566.463606:0:52416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788872566.463623:0:52416:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788872566.463628:0:52416:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1788872566.463630:0:52416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788872566.463637:0:52416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788872566.463638:0:52416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872566.463639:0:52416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872566.463640:0:52416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872566.463641:0:52416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872566.463642:0:52416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788872566.463643:0:52416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872566.463644:0:52416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788872566.463669:0:52416:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1788872566.463704:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327610624:0@lo:253:kworker.0 00000100:00100000:3.0:1788872566.463972:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327610368:0@lo:253:kworker.0 00000100:00100000:1.0:1788872566.464056:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327610496:0@lo:253:kworker.0 00000100:00100000:3.0:1788872566.465888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872566.466015:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327610368 00000100:00100000:3.0:1788872566.466025:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327610368 00000100:00100000:3.0:1788872566.466084:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788872566.466095:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:3646:x1875765327610368:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788872566.466139:0:85126:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00080000:0.0:1788872566.466943:0:85117:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1788872566.466982:0:85117:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788872566.467051:0:85117:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788872566.467059:0:85117:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 10000000:01000000:3.0:1788872566.467065:0:85127:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788872566.467211:0:85126:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 103 00000040:01000000:0.0:1788872566.467246:0:85117:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.139@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788872566.467310:0:85117:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.139@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788872566.467316:0:85117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788872566.467318:0:85117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788872566.467320:0:85117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872566.467321:0:85117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872566.467322:0:85117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872566.467323:0:85117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872566.467325:0:85117:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872566.467327:0:85117:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788872566.467329:0:85117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872566.467331:0:85117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788872566.467334:0:85117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788872566.467337:0:85117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788872566.467338:0:85117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788872566.467339:0:85117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872566.467341:0:85117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872566.467342:0:85117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872566.467343:0:85117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872566.467343:0:85117:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872566.467345:0:85117:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788872566.467346:0:85117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872566.467347:0:85117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788872566.467382:0:85117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788872566.467407:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327610752:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788872566.467642:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872566.467705:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa954a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872566.467752:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327610752 00000100:00100000:0.0:1788872566.467760:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327610752 00000100:00100000:0.0:1788872566.467805:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788872566.467812:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:85117:x1875765327610752:12345-0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788872566.468281:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872566.468372:0:85123:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1788872566.468384:0:85123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1788872566.469645:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327610624 00000100:00100000:3.0:1788872566.469657:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327610624 00000100:00100000:0.0:1788872566.469851:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788872566.469864:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:3644:x1875765327610624:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788872566.469905:0:85128:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1788872566.480723:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872566.480803:0:85123:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:3.0:1788872566.480817:0:85123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 20000000:01000000:2.0:1788872566.481493:0:85129:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788872566.481501:0:85129:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788872566.481505:0:85129:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788872566.481508:0:85129:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000100:00100000:3.0:1788872566.481535:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327610496 00000100:00100000:3.0:1788872566.481546:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327610496 00000100:00100000:1.0:1788872566.481742:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788872566.481754:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3647:x1875765327610496:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788872566.481796:0:85130:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000040:00080000:2.0:1788872566.482363:0:85129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788872566.482910:0:85126:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788872566.482945:0:85126:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788872566.483121:0:85125:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788872566.483139:0:85125:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788872566.483146:0:85125:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1788872566.483156:0:85125:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788872566.490638:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:85117:x1875765327610752:12345-0@lo:253:mount.lustre.0 Request processed in 22808us (22978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872566.490660:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788872566.490832:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327610752:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788872566.490856:0:85117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788872566.490860:0:85117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788872566.490863:0:85117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788872566.490864:0:85117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872566.490866:0:85117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872566.490868:0:85117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872566.490869:0:85117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872566.490870:0:85117:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788872566.490873:0:85117:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788872566.490875:0:85117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872566.490876:0:85117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788872566.490911:0:85117:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a9fa733800 from lustre-MDT0000 10000000:01000000:2.0:1788872566.490960:0:85117:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788872566.490963:0:85117:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788872566.490976:0:85117:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98a9fa733800 10000000:01000000:2.0:1788872566.490982:0:85117:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788872566.490989:0:85117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98a9fa733800 10000000:01000000:2.0:1788872566.491016:0:85117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788872566.491021:0:85117:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a9fa733800 from 1 10000000:01000000:2.0:1788872566.491025:0:85117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788872566.491078:0:85117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.491102:0:85117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.491113:0:85117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872566.491141:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1caad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327610880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788872566.491192:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872566.491246:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327610880 00000100:00100000:2.0:1788872566.491253:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788872566.491256:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327610880 00000100:00100000:0.0:1788872566.491324:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788872566.491335:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:85117:x1875765327610880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788872566.491354:0:85123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872566.491374:0:85123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c58afa00/0xe4e6e89fb01d95bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d95b5 expref: -99 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872566.491406:0:85123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c58afa00/0xe4e6e89fb01d95bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d95b5 expref: 9 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872566.491419:0:85123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c58afa00/0xe4e6e89fb01d95bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d95b5 expref: 9 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872566.491430:0:85123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58afa00, rc 0) 00000100:00100000:0.0:1788872566.491485:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:85117:x1875765327610880:12345-0@lo:101:mount.lustre.0 Request processed in 151us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872566.491499:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788872566.498861:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1caad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327610880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872566.498911:0:85117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.498930:0:85117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.498959:0:85117:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788872566.498980:0:85117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.498988:0:85117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872566.498998:0:85117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788872566.499030:0:85117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788872566.499039:0:85117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98a9fa733800 10000000:01000000:2.0:1788872566.499042:0:85117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788872566.499047:0:85117:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788872566.499051:0:85117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788872566.499170:0:85117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.499180:0:85117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.499191:0:85117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872566.499218:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1caad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327611008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788872566.499321:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872566.499391:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788872566.499462:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327611008 00000100:00100000:1.0:1788872566.499584:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327611008 00000100:00100000:1.0:1788872566.499707:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788872566.499721:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:85117:x1875765327611008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872566.499739:0:85123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872566.499824:0:85123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01d95ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d95c3 expref: -99 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.499866:0:85123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01d95ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d95c3 expref: 10 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.499879:0:85123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01d95ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d95c3 expref: 10 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.499891:0:85123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9800, rc 0) 00000100:00100000:1.0:1788872566.500027:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85117:x1875765327611008:12345-0@lo:101:mount.lustre.0 Request processed in 309us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.500037:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788872566.500323:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1caad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327611008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872566.500343:0:85117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.500353:0:85117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872566.500454:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327611136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872566.500695:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872566.500713:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c6507e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872566.500750:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327611136 00000100:00100000:1.0:1788872566.500827:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327611136 00000100:00100000:1.0:1788872566.501735:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788872566.501747:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85117:x1875765327611136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872566.502199:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85117:x1875765327611136:12345-0@lo:501:mount.lustre.0 Request processed in 452us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.502227:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788872566.502367:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327611136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872566.502435:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327611264:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872566.502488:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872566.502530:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788872566.502814:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327611264 00000100:00100000:1.0:1788872566.502822:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327611264 00000100:00100000:1.0:1788872566.502866:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788872566.502874:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85117:x1875765327611264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872566.504360:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85117:x1875765327611264:12345-0@lo:503:mount.lustre.0 Request processed in 1474us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.504375:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 20000000:01000000:3.0:1788872566.504401:0:85126:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:2.0:1788872566.504480:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327611264:0@lo:503:mount.lustre.0 20000000:01000000:3.0:1788872566.504485:0:85126:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788872566.504644:0:85128:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788872566.504826:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:3646:x1875765327610368:12345-0@lo:253:kworker.0 Request processed in 38731us (38945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872566.504834:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:3.0:1788872566.504870:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788872566.504873:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788872566.504875:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872566.504876:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872566.504878:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872566.504879:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872566.504881:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788872566.504884:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872566.504885:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788872566.504888:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327610368:0@lo:253:kworker.0 20000000:01000000:3.0:1788872566.505020:0:85127:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788872566.505026:0:85127:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788872566.505054:0:85127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d95d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.505163:0:85127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d95d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788872566.505176:0:85127:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000151550s 00010000:00010000:3.0:1788872566.505182:0:85127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d95d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.505200:0:85127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d95d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.505208:0:85127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d95d1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.505217:0:85127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d95d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.505224:0:85127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5dea600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872566.505229:0:85127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d95d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.505239:0:85127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d95d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.505255:0:85127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d95d1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.505265:0:85127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d95d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.505271:0:85127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d95d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872566.507031:0:85131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f098b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85131:1875765327611392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872566.507218:0:85131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872566.507312:0:85131:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa954240 going to sleep for 11 seconds 00000100:00100000:2.0:1788872566.507379:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327611392 00000100:00100000:2.0:1788872566.507390:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327611392 00000100:00100000:2.0:1788872566.507500:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788872566.507513:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85131:x1875765327611392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872566.509677:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85131:x1875765327611392:12345-0@lo:502:llog_process_th.0 Request processed in 2154us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872566.509705:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788872566.510080:0:85131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f098b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85131:1875765327611392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788872566.511138:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872566.511154:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872566.511157:0:85131:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788872566.511163:0:85131:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788872566.511166:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788872566.511188:0:85131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98a8c72eb380) 00000020:00000080:0.0:1788872566.511221:0:85131:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1788872566.511229:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788872566.511364:0:85131:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788872566.511373:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d95df 00000020:00000080:0.0:1788872566.511680:0:85131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788872566.511686:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872566.511690:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872566.511692:0:85131:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788872566.511694:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872566.511698:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872566.511700:0:85131:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788872566.511703:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788872566.511713:0:85131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98a8c72e99c0) 00000020:00000080:0.0:1788872566.511727:0:85131:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1788872566.511732:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788872566.511734:0:85131:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788872566.511737:0:85131:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788872566.511744:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788872566.511839:0:85131:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9fa733800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788872566.511853:0:85131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98a8c72ecd40) 00000020:00000080:0.0:1788872566.511865:0:85131:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1788872566.512331:0:85131:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788872566.512342:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d95f4 00000020:00000080:0.0:1788872566.512465:0:85131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788872566.512474:0:85131:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788872566.512479:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe4e6e89fb01d95fb 00080000:01000000:0.0:1788872566.512485:0:85131:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788872566.512489:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9602 20000000:01000000:1.0:1788872566.514278:0:85130:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788872566.514487:0:85128:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788872566.514509:0:85128:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788872566.514899:0:85127:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788872566.514906:0:85127:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788872566.514948:0:85127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01d9609 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.514970:0:85127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01d9609 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788872566.514982:0:85127:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000151550s 00010000:00010000:1.0:1788872566.514988:0:85127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01d9609 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.514997:0:85127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01d9609 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.515006:0:85127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01d9609 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.515014:0:85127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01d9609 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.515042:0:85127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872566.515048:0:85127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01d9609 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.515057:0:85127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01d9609 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.515073:0:85127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01d9609 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.515093:0:85127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01d9609 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.515101:0:85127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01d9609 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788872566.522803:0:85130:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788872566.522824:0:85130:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788872566.522859:0:85127:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788872566.522864:0:85127:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788872566.522896:0:85127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01d9610 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.522918:0:85127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01d9610 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788872566.522938:0:85127:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000151550s 00010000:00010000:1.0:1788872566.522944:0:85127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01d9610 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.522951:0:85127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01d9610 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.522968:0:85127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01d9610 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.522977:0:85127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01d9610 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.522984:0:85127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872566.522989:0:85127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01d9610 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.522999:0:85127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01d9610 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.523017:0:85127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01d9610 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.523027:0:85127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01d9610 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.523034:0:85127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01d9610 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872566.523732:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:3644:x1875765327610624:12345-0@lo:253:kworker.0 Request processed in 53864us (55445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872566.523757:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1788872566.523894:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788872566.523898:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788872566.523900:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872566.523902:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872566.523903:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872566.523905:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872566.523906:0:3644:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788872566.523917:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872566.523919:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788872566.523924:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327610624:0@lo:253:kworker.0 00000100:00100000:1.0:1788872566.524319:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3647:x1875765327610496:12345-0@lo:253:kworker.0 Request processed in 42566us (43605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.524329:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:2.0:1788872566.524404:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788872566.524407:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788872566.524408:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872566.524409:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872566.524410:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872566.524412:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872566.524414:0:3647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788872566.524415:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872566.524416:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788872566.524419:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327610496:0@lo:253:kworker.0 00010000:00010000:2.0:1788872566.649352:0:85131:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788872566.649797:0:85131:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 idx: 0 lr: 0 srv lr: 98784247808 lx: 0 gen 23 00000001:00080000:2.0:1788872566.649863:0:85131:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 22 00000001:00000004:2.0:1788872566.650180:0:85131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:2.0:1788872566.650367:0:85131:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788872566.650454:0:85131:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff98a9c5d10840: xid 1875765311121536, transno 98784247809, client gen 23, slot idx 0 00000020:00000080:2.0:1788872566.652717:0:85131:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98a9e9b0cd40) 00000020:00000080:2.0:1788872566.652754:0:85131:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788872566.652861:0:85131:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788872566.652868:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d962c 00000020:00000080:2.0:1788872566.658130:0:85131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788872566.679783:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe4e6e89fb01d9633 00000020:00000080:0.0:1788872566.683240:0:85131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788872566.683260:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872566.683270:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872566.683273:0:85131:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788872566.683276:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788872566.683279:0:85131:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788872566.683281:0:85131:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788872566.683283:0:85131:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788872566.683284:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788872566.683287:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872566.683288:0:85131:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788872566.683291:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872566.683309:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872566.683310:0:85131:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788872566.683316:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788872566.683397:0:85131:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788872566.683422:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872566.683426:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872566.683427:0:85131:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788872566.683430:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872566.683433:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872566.683435:0:85131:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788872566.683456:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788872566.683472:0:85131:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:00000080:0.0:1788872566.683509:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788872566.683530:0:85131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98a8c72e8000) 00000020:00000080:0.0:1788872566.683598:0:85131:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788872566.683605:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788872566.683685:0:85131:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788872566.683692:0:85131:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788872566.683700:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9641 00010000:00080000:0.0:1788872566.683747:0:85131:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9dfe91800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:0.0:1788872566.687414:0:85131:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1788872566.688863:0:85131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872566.688902:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788872566.688956:0:85131:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788872566.688992:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d9648 00000100:00080000:1.0:1788872566.689006:0:85131:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788872566.689025:0:85131:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98a9dfe91800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872566.689076:0:85131:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c4d16d80 x1875765327611520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872566.689107:0:85131:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788872566.689179:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872566.689183:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872566.689185:0:85131:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788872566.689188:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788872566.689191:0:85131:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788872566.689193:0:85131:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788872566.689195:0:85131:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788872566.689197:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788872566.689200:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872566.689201:0:85131:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788872566.689204:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788872566.689210:0:85131:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788872566.689214:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872566.689216:0:85131:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788872566.689219:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788872566.689223:0:85131:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:1.0:1788872566.689256:0:85131:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788872566.689259:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788872566.689275:0:85131:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98a9f6713380) 00000020:00000080:1.0:1788872566.689293:0:85131:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788872566.689309:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788872566.689392:0:85131:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788872566.689399:0:85131:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788872566.689407:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9656 00010000:00080000:1.0:1788872566.689442:0:85131:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a8c37f5000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:1.0:1788872566.689715:0:85131:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1788872566.690459:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327611520:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788872566.690591:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872566.690762:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327611520 00000100:00100000:0.0:1788872566.690772:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327611520 00000100:00100000:0.0:1788872566.690817:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:0.0:1788872566.690825:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327611520:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788872566.690859:0:8446:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3503 last 0 00000020:00000080:0.0:1788872566.690923:0:8446:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d965d 00000004:00100000:0.0:1788872566.690944:0:8446:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788872566.691067:0:8446:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872566.691159:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327611520:12345-0@lo:38:llog_process_th.0 Request processed in 333us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872566.691168:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00100000:3.0:1788872566.691619:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788872566.691632:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1788872566.691642:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788872566.691648:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788872566.691651:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe91800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788872566.691667:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327611520:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788872566.691830:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327611648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872566.691983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872566.692612:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327611648 00000100:00100000:1.0:1788872566.692628:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327611648 00000100:00100000:1.0:1788872566.692677:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:1.0:1788872566.692686:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327611648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872566.692728:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872566.692789:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327611648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.692796:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00100000:0.0:1788872566.693105:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327611648:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1788872566.693232:0:85131:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788872566.693265:0:85131:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788872566.693949:0:85131:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:1.0:1788872566.695250:0:85131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788872566.695287:0:85131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:1.0:1788872566.695487:0:85131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000040:00080000:1.0:1788872566.696337:0:85137:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:1.0:1788872566.696344:0:85137:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788872566.697012:0:85137:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:1.0:1788872566.697040:0:85137:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788872566.697206:0:85137:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:1.0:1788872566.697210:0:85137:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788872566.698271:0:85131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872566.698288:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788872566.698358:0:85131:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788872566.698393:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d9664 00000100:00080000:1.0:1788872566.698409:0:85131:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788872566.698416:0:85131:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98a8c37f5000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872566.698463:0:85131:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c4d15500 x1875765327611776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872566.699232:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327611776:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788872566.699349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872566.699474:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327611776 00000100:00100000:0.0:1788872566.699484:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327611776 00000100:00100000:0.0:1788872566.699535:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5929 00000100:00100000:0.0:1788872566.699544:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3643:x1875765327611776:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788872566.699601:0:26185:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3503 last 0 00000020:00000080:0.0:1788872566.699655:0:26185:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d966b 00002000:00100000:0.0:1788872566.699674:0:26185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98a8c5113800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788872566.699679:0:26185:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788872566.699683:0:26185:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788872566.699779:0:26185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788872566.699813:0:26185:0:(import.c:65:import_set_state_nolock()) ffff98a8c5117800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788872566.700070:0:85131:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788872566.700238:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872566.700251:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872566.700253:0:85131:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788872566.700257:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788872566.700260:0:85131:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788872566.700262:0:85131:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788872566.700263:0:85131:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788872566.700265:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788872566.700267:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872566.700269:0:85131:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788872566.700271:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788872566.700277:0:85131:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788872566.700280:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872566.700282:0:85131:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788872566.700285:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788872566.700289:0:85131:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:1.0:1788872566.700326:0:85131:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788872566.700329:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788872566.700347:0:85131:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98a9f6714d40) 00000020:00000080:1.0:1788872566.700369:0:85131:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788872566.700375:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788872566.700478:0:85131:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788872566.700487:0:85131:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788872566.700494:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9679 00010000:00080000:1.0:1788872566.700534:0:85131:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9ee838000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:1.0:1788872566.700811:0:85131:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1788872566.700918:0:85131:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788872566.700940:0:85131:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788872566.701836:0:85131:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000100:00100000:0.0:1788872566.702673:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327611776:12345-0@lo:8:llog_process_th.0 Request processed in 3118us (3313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872566.702688:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5929 00000040:00080000:1.0:1788872566.703103:0:85131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788872566.703136:0:85131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:1.0:1788872566.703278:0:85131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:0.0:1788872566.703947:0:85139:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:0.0:1788872566.703953:0:85139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788872566.707223:0:85131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872566.707245:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788872566.707331:0:85131:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788872566.707384:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d9680 00000100:00080000:2.0:1788872566.707398:0:85131:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788872566.707406:0:85131:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98a9ee838000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872566.707458:0:85131:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1ca9f80 x1875765327611904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872566.707480:0:85131:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788872566.707622:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872566.707628:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872566.707631:0:85131:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788872566.707634:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872566.707640:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872566.707643:0:85131:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788872566.707646:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788872566.707648:0:85131:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788872566.707652:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872566.707655:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872566.707656:0:85131:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788872566.707658:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872566.707661:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872566.707663:0:85131:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788872566.707667:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788872566.707713:0:85131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85131:1875765327612032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872566.707819:0:85131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872566.708335:0:85131:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56b1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788872566.708451:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788872566.708465:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788872566.708474:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788872566.708482:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788872566.708487:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788872566.708564:0:3643:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:3.0:1788872566.708574:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327611776:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788872566.708619:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327612032 00000100:00100000:3.0:1788872566.708625:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327612032 00000100:00100000:3.0:1788872566.708681:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788872566.708692:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:85131:x1875765327612032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872566.708899:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:85131:x1875765327612032:12345-0@lo:502:llog_process_th.0 Request processed in 200us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872566.708909:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788872566.708960:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327611904:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788872566.709002:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788872566.709243:0:85137:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788872566.709350:0:85137:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3503835799823ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788872566.709365:0:85137:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788872566.709397:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327611904 00000100:00100000:1.0:1788872566.709401:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327611904 00000100:00100000:1.0:1788872566.709426:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5930 00000100:00100000:1.0:1788872566.709432:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3643:x1875765327611904:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788872566.709464:0:26196:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3503 last 0 00000020:00000080:1.0:1788872566.709503:0:26196:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d9687 00002000:00100000:1.0:1788872566.709521:0:26196:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98a9ee838800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788872566.709526:0:26196:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788872566.709529:0:26196:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788872566.709621:0:26196:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788872566.709653:0:26196:0:(import.c:65:import_set_state_nolock()) ffff98a9ee83d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872566.709708:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327611904:12345-0@lo:8:llog_process_th.0 Request processed in 275us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.709716:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5930 00000100:00100000:2.0:1788872566.709933:0:85131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85131:1875765327612032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788872566.709975:0:85131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872566.709983:0:85131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872566.709986:0:85131:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788872566.709992:0:85131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788872566.711454:0:85117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788872566.711496:0:85117:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788872566.711518:0:85117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.711533:0:85117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872566.711543:0:85117:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9fa733800 from 1 10000000:01000000:1.0:1788872566.711566:0:85117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788872566.711619:0:85117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.711646:0:85117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.711658:0:85117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872566.711690:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327612160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788872566.711772:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872566.711816:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e83540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872566.712238:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327612160 00000100:00100000:2.0:1788872566.712256:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327612160 00000100:00100000:2.0:1788872566.712332:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788872566.712344:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:85117:x1875765327612160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872566.712361:0:85123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872566.712384:0:85123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d9695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d968e expref: -99 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.712412:0:85123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d9695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d968e expref: 9 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.712424:0:85123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d9695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d968e expref: 9 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.712434:0:85123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5441a00, rc 0) 00000100:00100000:2.0:1788872566.712494:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:85117:x1875765327612160:12345-0@lo:101:mount.lustre.0 Request processed in 152us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872566.712502:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788872566.712628:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788872566.712639:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788872566.712649:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788872566.712656:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788872566.712661:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ee838000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788872566.712679:0:3643:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:2.0:1788872566.712687:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327611904:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788872566.713539:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327612160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872566.713590:0:85117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9695 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.713606:0:85117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9695 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872566.714816:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327612288:0@lo:256:mount.lustre.0 00000004:00080000:3.0:1788872566.715448:0:85118:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1788872566.715838:0:85139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 3 count 2 00000100:00100000:2.0:1788872566.716019:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f098ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327612544:0@lo:6:osp-syn-1-0.0 00000040:00080000:0.0:1788872566.716100:0:85139:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:0.0:1788872566.716105:0:85139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1788872566.716133:0:85139:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788872566.716228:0:85139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3503842677547ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788872566.716235:0:85139:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788872566.716344:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f098b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327612416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872566.716541:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872566.716583:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327612672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872566.716780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872566.716924:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788872566.718520:0:85118:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788872566.718664:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327612416 00000100:00100000:2.0:1788872566.718679:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327612416 00000100:00100000:2.0:1788872566.718799:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:2.0:1788872566.718811:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327612416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872566.718852:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872566.718954:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327612416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872566.718962:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:2.0:1788872566.719038:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f098b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327612416:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788872566.719155:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872566.719804:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872566.719858:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e83540 going to sleep for 11 seconds 00000100:00100000:1.0:1788872566.719910:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327612544 00000100:00100000:1.0:1788872566.719917:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327612544 00000100:00100000:1.0:1788872566.719991:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5931 00000100:00100000:1.0:1788872566.720000:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327612544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788872566.720030:0:26193:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:674 count 1 00000100:00100000:2.0:1788872566.720208:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327612288 00000100:00100000:2.0:1788872566.720213:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327612288 00000100:00100000:2.0:1788872566.720253:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788872566.720261:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:85117:x1875765327612288:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788872566.720278:0:85130:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788872566.720317:0:85130:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788872566.720322:0:85130:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788872566.720326:0:85130:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788872566.720329:0:85130:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 106 00000100:00100000:2.0:1788872566.720451:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:85117:x1875765327612288:12345-0@lo:256:mount.lustre.0 Request processed in 190us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872566.720460:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788872566.720536:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872566.721071:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327612544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1070us (4289us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788872566.721103:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5931 00000100:00100000:1.0:1788872566.721158:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327612288:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788872566.721961:0:85117:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788872566.721995:0:85117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9695 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.722010:0:85117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9695 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872566.722020:0:85117:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9fa733800 from 1 10000000:01000000:1.0:1788872566.722024:0:85117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788872566.722071:0:85117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.722080:0:85117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.722091:0:85117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872566.722118:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327612800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788872566.722174:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872566.722220:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e83540 going to sleep for 11 seconds 00000100:00100000:3.0:1788872566.722670:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327612800 00000100:00100000:3.0:1788872566.722680:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327612800 00000100:00100000:3.0:1788872566.722731:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788872566.722740:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:85117:x1875765327612800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872566.722755:0:85125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872566.722775:0:85125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d96a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d969c expref: -99 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.722807:0:85125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d96a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d969c expref: 10 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.722820:0:85125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d96a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d969c expref: 10 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.722829:0:85125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5dea600, rc 0) 00000100:00100000:3.0:1788872566.722900:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85117:x1875765327612800:12345-0@lo:101:mount.lustre.0 Request processed in 160us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872566.722932:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788872566.723214:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327612800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872566.723235:0:85117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.723246:0:85117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872566.723349:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327612928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872566.723385:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872566.723499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872566.723768:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e83540 going to sleep for 11 seconds 00000004:00080000:2.0:1788872566.723957:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98a9f098ad80, transno 0 00000004:00080000:2.0:1788872566.723965:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98a9f098ad80/1, rc -2, transno 0 00000100:00100000:2.0:1788872566.723979:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f098ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327612544:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1788872566.724210:0:85139:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1788872566.724236:0:85139:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788872566.724452:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327612928 00000100:00100000:3.0:1788872566.724461:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327612928 00000100:00100000:3.0:1788872566.724511:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788872566.724522:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85117:x1875765327612928:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788872566.724861:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85117:x1875765327612928:12345-0@lo:501:mount.lustre.0 Request processed in 340us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872566.724871:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788872566.724918:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327612672 00000100:00100000:3.0:1788872566.724923:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327612672 00000100:00100000:1.0:1788872566.724927:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327612928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872566.724990:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327613056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788872566.725013:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:3.0:1788872566.725023:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327612672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872566.725053:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872566.725053:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872566.725107:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327612672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872566.725114:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00100000:1.0:1788872566.725197:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e83540 going to sleep for 11 seconds 00000100:00100000:3.0:1788872566.725202:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327612672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872566.725220:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327613056 00000100:00100000:1.0:1788872566.725226:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327613056 00000100:00100000:1.0:1788872566.725268:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788872566.725275:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85117:x1875765327613056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872566.725389:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85117:x1875765327613056:12345-0@lo:503:mount.lustre.0 Request processed in 113us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.725395:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788872566.725422:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327613056:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872566.726078:0:85141:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85141:1875765327613184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872566.726138:0:85141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872566.726175:0:85141:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56b1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788872566.726240:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327613184 00000100:00100000:1.0:1788872566.726246:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327613184 00000100:00100000:1.0:1788872566.726285:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788872566.726293:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85141:x1875765327613184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872566.726887:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85141:x1875765327613184:12345-0@lo:502:llog_process_th.0 Request processed in 590us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.726903:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788872566.727254:0:85141:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85141:1875765327613184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788872566.727287:0:85141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872566.727312:0:85141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872566.727314:0:85141:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788872566.727324:0:85141:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a9fa733800 00000020:00000080:2.0:1788872566.727327:0:85141:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788872566.727339:0:85141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872566.727341:0:85141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872566.727343:0:85141:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788872566.727345:0:85141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872566.727347:0:85141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872566.727348:0:85141:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788872566.727351:0:85141:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a9fa733800 00000020:00000080:2.0:1788872566.727353:0:85141:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788872566.727491:0:85141:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85141:1875765327613312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872566.727539:0:85141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872566.727607:0:85141:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56b1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788872566.727689:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327613312 00000100:00100000:0.0:1788872566.727696:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327613312 00000100:00100000:0.0:1788872566.727745:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788872566.727753:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85141:x1875765327613312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872566.727905:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85141:x1875765327613312:12345-0@lo:502:llog_process_th.0 Request processed in 153us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872566.727913:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788872566.728235:0:85141:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85141:1875765327613312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788872566.728261:0:85141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872566.728267:0:85141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872566.728269:0:85141:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788872566.728274:0:85141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788872566.728785:0:85117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788872566.728818:0:85117:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788872566.728845:0:85117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872566.728859:0:85117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872566.729196:0:85117:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788872566.729200:0:85117:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98a9fa733800 10000000:01000000:0.0:1788872566.729204:0:85117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98a9fa733800 10000000:01000000:0.0:1788872566.729209:0:85117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788872566.729216:0:85117:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9fa733800 from 1 10000000:01000000:0.0:1788872566.729220:0:85117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788872566.729266:0:85117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872566.729276:0:85117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872566.729288:0:85117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872566.729328:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327613440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788872566.729387:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872566.729446:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2e29780 going to sleep for 11 seconds 00000100:00100000:2.0:1788872566.729510:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327613440 00000100:00100000:2.0:1788872566.729518:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327613440 00000100:00100000:2.0:1788872566.729610:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788872566.729621:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:85117:x1875765327613440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872566.729637:0:85128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872566.729664:0:85128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9f5441200/0xe4e6e89fb01d96b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d96aa expref: -99 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.729694:0:85128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9f5441200/0xe4e6e89fb01d96b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d96aa expref: 11 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.729707:0:85128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9f5441200/0xe4e6e89fb01d96b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d96aa expref: 11 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.729718:0:85128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5441200, rc 0) 00000100:00100000:2.0:1788872566.729756:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85117:x1875765327613440:12345-0@lo:101:mount.lustre.0 Request processed in 138us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872566.729764:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788872566.730073:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327613440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788872566.730156:0:85117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872566.730181:0:85117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872566.730249:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327613568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788872566.730282:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872566.730333:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2e29780 going to sleep for 11 seconds 00000100:00100000:2.0:1788872566.730393:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327613568 00000100:00100000:2.0:1788872566.730397:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327613568 00000100:00100000:2.0:1788872566.730475:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788872566.730484:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85117:x1875765327613568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872566.730724:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85117:x1875765327613568:12345-0@lo:501:mount.lustre.0 Request processed in 241us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872566.730732:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788872566.731248:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327613568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872566.731325:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327613696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872566.731393:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872566.731472:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56b1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872566.731516:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327613696 00000100:00100000:3.0:1788872566.731523:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327613696 00000100:00100000:3.0:1788872566.731598:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788872566.731608:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85117:x1875765327613696:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788872566.731732:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85117:x1875765327613696:12345-0@lo:503:mount.lustre.0 Request processed in 125us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872566.731740:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788872566.732150:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327613696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872566.733351:0:85142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85142:1875765327613824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872566.733439:0:85142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872566.733484:0:85142:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e83d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788872566.733539:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327613824 00000100:00100000:1.0:1788872566.733572:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327613824 00000100:00100000:1.0:1788872566.733620:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788872566.733630:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85142:x1875765327613824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872566.733777:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85142:x1875765327613824:12345-0@lo:502:llog_process_th.0 Request processed in 148us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.733786:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788872566.733842:0:85142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85142:1875765327613824:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788872566.735062:0:85142:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788872566.735234:0:85142:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98a9f67119c0) 00000020:00000080:1.0:1788872566.735274:0:85142:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788872566.735506:0:85142:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9fa733800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788872566.735512:0:85142:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9fa733800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788872566.735516:0:85142:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9fa733800 4 00010000:00080000:1.0:1788872566.735583:0:85142:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9ff63f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:1.0:1788872566.746244:0:85142:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1788872566.746410:0:85142:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788872566.746477:0:85142:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788872566.746496:0:85142:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe4e6e89fb01d96bf 00000100:00080000:1.0:1788872566.746511:0:85142:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788872566.746518:0:85142:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98a9ff63f800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872566.746592:0:85142:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c4d15180 x1875765327613952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872566.746624:0:85142:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788872566.747313:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327613952:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788872566.747417:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872566.747624:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327613952 00000100:00100000:3.0:1788872566.747645:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327613952 00000100:00100000:3.0:1788872566.747694:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1788872566.747703:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f098ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327613952:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788872566.747779:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f098ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327613952:12345-0@lo:38:llog_process_th.0 Request processed in 76us (362us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788872566.747788:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1788872566.747837:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788872566.747848:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ff63f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872566.747852:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788872566.747857:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327613952:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788872566.749279:0:85142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85142:1875765327614080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872566.749392:0:85142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872566.749439:0:85142:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9eedbc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872566.749601:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327614080 00000100:00100000:1.0:1788872566.749610:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327614080 00000100:00100000:1.0:1788872566.749663:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788872566.749673:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85142:x1875765327614080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872566.749851:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85142:x1875765327614080:12345-0@lo:502:llog_process_th.0 Request processed in 178us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.749859:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788872566.753242:0:85142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85142:1875765327614080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872566.753363:0:85142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85142:1875765327614208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872566.753459:0:85142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872566.753510:0:85142:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9eedbc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872566.753626:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327614208 00000100:00100000:0.0:1788872566.753635:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327614208 00000100:00100000:0.0:1788872566.753706:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788872566.753717:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85142:x1875765327614208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872566.753898:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85142:x1875765327614208:12345-0@lo:502:llog_process_th.0 Request processed in 171us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872566.753908:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788872566.754806:0:85142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85142:1875765327614208:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788872566.754853:0:85142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788872566.756125:0:85117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788872566.756159:0:85117:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872566.756187:0:85117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872566.756203:0:85117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788872566.756279:0:85117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788872566.756282:0:85117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788872566.756284:0:85117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872566.756291:0:85117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872566.756293:0:85117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872566.756304:0:85117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872566.756306:0:85117:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872566.756307:0:85117:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788872566.756310:0:85117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872566.756311:0:85117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788872566.756316:0:85117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788872566.756319:0:85117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788872566.756320:0:85117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788872566.756321:0:85117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872566.756322:0:85117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872566.756322:0:85117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872566.756323:0:85117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872566.756324:0:85117:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872566.756325:0:85117:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788872566.756326:0:85117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872566.756326:0:85117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788872566.756363:0:85117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788872566.756391:0:85117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f098b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327614336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788872566.756481:0:85117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872566.756570:0:85117:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2e29c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872566.756600:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327614336 00000100:00100000:0.0:1788872566.756609:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327614336 00000100:00100000:0.0:1788872566.756663:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788872566.756672:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85117:x1875765327614336:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788872566.756706:0:85128:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788872566.756725:0:85128:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788872566.771136:0:85128:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788872566.771166:0:85128:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788872566.771216:0:85127:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788872566.771224:0:85127:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788872566.771254:0:85127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.771280:0:85127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d9695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d968e expref: 11 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.771291:0:85127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.771359:0:85127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d9695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01d968e expref: 11 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.771379:0:85127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d9695 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01d968e expref: 11 pid: 85123 timeout: 3603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872566.771399:0:85127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85127:1875765327614464:0@lo:104: 00000100:00100000:3.0:1788872566.771492:0:85127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872566.771578:0:85127:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5edcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872566.771622:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327614464 00000100:00100000:3.0:1788872566.771630:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327614464 00000100:00100000:3.0:1788872566.771693:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788872566.771706:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:85127:x1875765327614464:12345-0@lo:104: 00010000:00010000:3.0:1788872566.771721:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01d9695 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872566.771785:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788872566.771792:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:85127:x1875765327614464:12345-0@lo:104: Request processed in 90us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872566.771799:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788872566.772042:0:85127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85127:1875765327614464:0@lo:104: 00010000:00010000:2.0:1788872566.772070:0:85127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872566.772208:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:85117:x1875765327614336:12345-0@lo:253:mount.lustre.0 Request processed in 15534us (15724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.772220:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788872566.772273:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872566.772281:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01d9695 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.772290:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872566.772305:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01d9695 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.772316:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01d9695 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872566.772325:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01d9695 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872566.772343:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788872566.772391:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01d9695 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.772399:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872566.772433:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01d9695 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.772442:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01d968e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01d9695 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872566.772460:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872566.772462:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872566.772464:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872566.772493:0:85117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f098b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:85117:1875765327614336:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788872566.772507:0:85117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788872566.772511:0:85117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788872566.772513:0:85117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788872566.772514:0:85117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872566.772516:0:85117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872566.772517:0:85117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872566.772519:0:85117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872566.772521:0:85117:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788872566.772522:0:85117:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788872566.772525:0:85117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872566.772526:0:85117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788872566.772541:0:85117:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788872566.773717:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327614592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872566.773791:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872566.776390:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327614592 00000100:00100000:2.0:1788872566.776412:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327614592 00010000:00010000:2.0:1788872566.776480:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d9695 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01d968e expref: 11 pid: 85123 timeout: 3603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872566.776526:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:2.0:1788872566.776538:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:3645:x1875765327614592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872566.776576:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872566.776584:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d9695 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01d968e expref: 11 pid: 85123 timeout: 3603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.776599:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d9695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01d968e expref: 11 pid: 85123 timeout: 3603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.776622:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d9695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01d968e expref: 11 pid: 85123 timeout: 3603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.776640:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.776650:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788872566.776671:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005449012s 00010000:00010000:2.0:1788872566.776686:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.776694:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.776703:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.776711:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.776718:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5dea400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872566.776724:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.776734:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.776750:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.776766:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872566.776859:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:3645:x1875765327614592:12345-0@lo:103:ldlm_bl.0 Request processed in 323us (3068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872566.776868:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:2.0:1788872566.776946:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327614592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872566.776982:0:85127:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.776992:0:85127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872566.777005:0:85127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d96c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788872566.808510:0:85117:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411353 00000040:01000000:0.0:1788872566.809129:0:85117:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788872566.809193:0:85149:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411353 00000020:00080000:1.0:1788872566.809198:0:85149:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411353 00000040:01000000:1.0:1788872566.810097:0:85150:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788872566.810182:0:85150:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788872566.811073:0:85117:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788872566.818370:0:85150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788872566.818511:0:85150:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788872566.819644:0:85151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85151:1875765327614720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872566.819765:0:85151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872566.819813:0:85151:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872566.820085:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327614720 00000100:00100000:3.0:1788872566.820098:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327614720 00000100:00100000:3.0:1788872566.820184:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:3.0:1788872566.820196:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85151:x1875765327614720:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788872566.820333:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85151:x1875765327614720:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 138us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872566.820341:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000100:00100000:2.0:1788872566.820588:0:85151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85151:1875765327614720:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788872566.820631:0:85151:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788872566.820678:0:85151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85151:1875765327614848:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872566.820729:0:85151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872566.820755:0:85151:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872566.820873:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327614848 00000100:00100000:1.0:1788872566.820879:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327614848 00000100:00100000:1.0:1788872566.820930:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000100:00100000:1.0:1788872566.820938:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85151:x1875765327614848:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788872566.821215:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85151:x1875765327614848:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 276us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872566.821224:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00000100:00100000:2.0:1788872566.821318:0:85151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85151:1875765327614848:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872566.821400:0:85151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85151:1875765327614976:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872566.821427:0:85151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872566.821449:0:85151:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872566.821575:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327614976 00000100:00100000:3.0:1788872566.821580:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327614976 00000100:00100000:3.0:1788872566.821611:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:3.0:1788872566.821619:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85151:x1875765327614976:12345-0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788872566.821713:0:85117:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788872566.821765:0:85117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788872566.821854:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85151:x1875765327614976:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872566.821873:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00100000:1.0:1788872566.821899:0:85151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85151:1875765327614976:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788872566.821954:0:85151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788872566.822208:0:85117:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788872566.822216:0:85117:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788872566.822257:0:85117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788872566.823945:0:85117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788872566.827674:0:85151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788872566.829508:0:85151:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788872566.829515:0:85151:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1788872566.830283:0:85117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788872566.830363:0:85117:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788872566.830590:0:85117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788872566.836196:0:85117:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00010000:00080000:0.0:1788872566.843819:0:85117:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247809 00010000:00080000:0.0:1788872566.850340:0:85152:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85152 00010000:02000000:0.0:1788872566.850357:0:85152:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:1.0:1788872566.852370:0:85117:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788872566.852397:0:85117:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.139@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788872566.852432:0:85117:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788872566.852463:0:85117:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788872566.853826:0:85117:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788872566.854131:0:85117:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:1.0:1788872566.854712:0:85152:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788872566.854719:0:85152:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1788872567.039380:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872567.482484:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327615104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872567.482631:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872567.482751:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872567.482761:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327615232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872567.482789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872567.492772:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327615104 00000100:00100000:3.0:1788872567.492797:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327615104 00000100:00100000:3.0:1788872567.492919:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327615232 00000100:00100000:3.0:1788872567.492923:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327615232 00000100:00100000:3.0:1788872567.492954:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:3.0:1788872567.492966:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327615104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872567.493007:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872567.493380:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327615104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 417us (10749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872567.493389:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00100000:3.0:1788872567.493413:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1788872567.493420:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327615232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872567.493434:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872567.493466:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327615232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (10676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872567.493473:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1788872567.494324:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327615232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872567.494365:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327615104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872567.564156:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872567.567037:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311130240 00000100:00100000:2.0:1788872567.567058:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311130240 00000100:00100000:2.0:1788872567.567173:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1047 00000100:00100000:2.0:1788872567.567193:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311130240:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872567.567371:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311130240:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 186us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872567.567381:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1047 00000100:00080000:1.0:1788872567.567726:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872567.571865:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872567.572058:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311130112 00000100:00100000:2.0:1788872567.572071:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311130112 00000100:00100000:2.0:1788872567.572135:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1063 00000100:00100000:2.0:1788872567.572157:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875765311130112:12345-192.168.204.39@tcp:38:kworker.0 00010000:00080000:2.0:1788872567.572205:0:66190:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '2a005fe2-2a3d-4ca6-8402-a633d5d16eb3' at ffff98a9e99ab000, cookie 0xe4e6e89fb01d9617 00010000:00080000:2.0:1788872567.572212:0:66190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp recovering/t98784247810 exp ffff98a9e99ab000 cur 3504 last 1788872566 00010000:02000400:2.0:1788872567.572224:0:66190:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788872567.572230:0:66190:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788872567.572272:0:66190:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788872567.572485:0:66190:0:(import.c:65:import_set_state_nolock()) ffff98a8c6777000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872567.572646:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311130112:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 499us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872567.572657:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1063 00000100:00100000:1.0:1788872567.579638:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872567.579959:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311123328 00000100:00100000:3.0:1788872567.579974:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311123328 00000100:00100000:3.0:1788872567.580057:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1064 00000100:00100000:3.0:1788872567.580069:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311123328:12345-192.168.204.39@tcp:36:mcreate.0 00010000:00080000:3.0:1788872567.580095:0:66979:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247810, current: 98784247810, replaying 00000100:00100000:3.0:1788872567.580136:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311123328:12345-192.168.204.39@tcp:36:mcreate.0 Request processed in 69us (513us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872567.580154:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1064 00010000:00080000:1.0:1788872567.580349:0:85152:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:0.0:1788872567.800988:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788872567.800999:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9fa733800 from 107 10000000:01000000:0.0:1788872567.801007:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788872567.801133:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.801150:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.801185:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872567.801224:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f098b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327615360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.801341:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.801413:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788872567.801589:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327615360 00000100:00100000:2.0:1788872567.801601:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327615360 00000100:00100000:0.0:1788872567.801866:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788872567.801884:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:6517:x1875765327615360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872567.801907:0:85126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872567.801929:0:85126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c58af600/0xe4e6e89fb01d96d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d96cd expref: -99 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.801967:0:85126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c58af600/0xe4e6e89fb01d96d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d96cd expref: 11 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.801980:0:85126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c58af600/0xe4e6e89fb01d96d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d96cd expref: 11 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.801990:0:85126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58af600, rc 0) 00000100:00100000:0.0:1788872567.802084:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327615360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872567.802091:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788872567.802347:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f098b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327615360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872567.802367:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.802378:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872567.802880:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327615488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.802946:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.802994:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872567.803028:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327615488 00000100:00100000:0.0:1788872567.803055:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327615488 00000100:00100000:0.0:1788872567.803115:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788872567.803125:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327615488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788872567.803152:0:85123:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788872567.803175:0:85123:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788872567.803178:0:85123:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 107 00000100:00100000:0.0:1788872567.803336:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327615488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 211us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872567.803345:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788872567.803676:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327615488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788872567.803747:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788872567.803759:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.803771:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872567.803796:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788872567.803800:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9d0cfb000 from 52 10000000:01000000:2.0:1788872567.803803:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788872567.803982:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440e00/0xe4e6e89fb01d96db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.803993:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5440e00/0xe4e6e89fb01d96db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.804003:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5440e00/0xe4e6e89fb01d96db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872567.804027:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1caa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327615616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.804072:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872567.804111:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872567.804213:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327615616 00000100:00100000:1.0:1788872567.804219:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327615616 00000100:00100000:1.0:1788872567.804269:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788872567.804287:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327615616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872567.804299:0:85125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872567.804316:0:85125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c8200/0xe4e6e89fb01d96e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d96db expref: -99 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.804346:0:85125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c8200/0xe4e6e89fb01d96e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d96db expref: 12 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.804372:0:85125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c8200/0xe4e6e89fb01d96e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d96db expref: 12 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.804383:0:85125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8200, rc 0) 00000100:00100000:1.0:1788872567.804433:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327615616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872567.804440:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788872567.804945:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1caa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327615616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872567.804965:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5440e00/0xe4e6e89fb01d96db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.804976:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440e00/0xe4e6e89fb01d96db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d96e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872567.805162:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327615744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.805204:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872567.805248:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef2af480 going to sleep for 11 seconds 00000100:00100000:1.0:1788872567.806846:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327615744 00000100:00100000:1.0:1788872567.806864:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327615744 00000100:00100000:1.0:1788872567.806954:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788872567.806967:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327615744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.808302:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327615744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1329us (3087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872567.808319:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788872567.811481:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327615744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.811984:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327615872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.812238:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.812345:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872567.812402:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327615872 00000100:00100000:0.0:1788872567.812412:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327615872 00000100:00100000:0.0:1788872567.812528:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788872567.812540:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327615872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.812806:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327615872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872567.812827:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788872567.812913:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327615872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872567.822726:0:85182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788872567.825025:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788872567.825094:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788872567.825113:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440e00/0xe4e6e89fb01d96db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.825129:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5440e00/0xe4e6e89fb01d96db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872567.825142:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788872567.825145:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9d0cfb000 from 104 10000000:01000000:2.0:1788872567.825147:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788872567.825208:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440400/0xe4e6e89fb01d96e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.825237:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5440400/0xe4e6e89fb01d96e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.825250:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5440400/0xe4e6e89fb01d96e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872567.825295:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.825396:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872567.825455:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f6780 going to sleep for 11 seconds 00000100:00100000:3.0:1788872567.829000:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327616000 00000100:00100000:3.0:1788872567.829025:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327616000 00000100:00100000:3.0:1788872567.829304:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788872567.829361:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327616000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872567.829389:0:85130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872567.829417:0:85130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5deb200/0xe4e6e89fb01d96f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d96e9 expref: -99 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872567.829459:0:85130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5deb200/0xe4e6e89fb01d96f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d96e9 expref: 13 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872567.829474:0:85130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5deb200/0xe4e6e89fb01d96f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d96e9 expref: 13 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872567.829485:0:85130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5deb200, rc 0) 00000100:00100000:3.0:1788872567.829624:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327616000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 310us (4227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872567.829632:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788872567.830414:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872567.830442:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5440400/0xe4e6e89fb01d96e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.830456:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440400/0xe4e6e89fb01d96e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d96f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872567.830586:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.830650:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872567.830983:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788872567.832025:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327616128 00000100:00100000:1.0:1788872567.832040:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327616128 00000100:00100000:1.0:1788872567.832110:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788872567.832122:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327616128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788872567.832155:0:85123:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788872567.832181:0:85123:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788872567.832185:0:85123:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788872567.832189:0:85123:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788872567.832193:0:85123:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1788872567.832202:0:85123:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 107 00000100:00100000:1.0:1788872567.832355:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327616128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 235us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872567.832364:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788872567.832426:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788872567.832532:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788872567.832543:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440400/0xe4e6e89fb01d96e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.832586:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5440400/0xe4e6e89fb01d96e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872567.832597:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788872567.832600:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1788872567.832604:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788872567.832644:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d96f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.832653:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d96f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.834629:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d96f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872567.834694:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.834773:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.834828:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872567.834855:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327616256 00000100:00100000:1.0:1788872567.834863:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327616256 00000100:00100000:1.0:1788872567.834937:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788872567.834947:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327616256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872567.834965:0:85125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872567.834987:0:85125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c8a00/0xe4e6e89fb01d96fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d96f7 expref: -99 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.835021:0:85125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c8a00/0xe4e6e89fb01d96fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d96f7 expref: 14 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.835035:0:85125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c8a00/0xe4e6e89fb01d96fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d96f7 expref: 14 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.835046:0:85125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8a00, rc 0) 00000100:00100000:1.0:1788872567.835090:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327616256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872567.835098:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788872567.835147:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872567.835163:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d96f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.835173:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d96f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d96fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872567.835259:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.835300:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.835314:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872567.835329:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327616384 00000100:00100000:1.0:1788872567.835334:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327616384 00000100:00100000:1.0:1788872567.835366:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788872567.835372:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327616384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.835581:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327616384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872567.835590:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788872567.835629:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.835661:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.835705:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.835719:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872567.835729:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327616512 00000100:00100000:1.0:1788872567.835733:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327616512 00000100:00100000:1.0:1788872567.835755:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788872567.835761:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9eecde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327616512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.844433:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9eecde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327616512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 8656us (8711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872567.844452:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788872567.844805:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788872567.850241:0:85184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1788872567.853113:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1788872567.853232:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788872567.853249:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d96f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.853264:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d96f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872567.853286:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1788872567.853289:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a9d0cfb000 from 1 10000000:01000000:1.0:1788872567.853292:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788872567.853366:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9a00/0xe4e6e89fb01d9705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.853376:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9a00/0xe4e6e89fb01d9705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.853389:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9a00/0xe4e6e89fb01d9705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872567.853419:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.853732:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.853905:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c550cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872567.853969:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327616640 00000100:00100000:0.0:1788872567.853978:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327616640 00000100:00100000:0.0:1788872567.854143:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788872567.854154:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327616640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872567.854168:0:85125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872567.854183:0:85125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c58aec00/0xe4e6e89fb01d970c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9705 expref: -99 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.854210:0:85125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c58aec00/0xe4e6e89fb01d970c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9705 expref: 15 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.854223:0:85125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c58aec00/0xe4e6e89fb01d970c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9705 expref: 15 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.854232:0:85125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58aec00, rc 0) 00000100:00100000:0.0:1788872567.854410:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327616640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 258us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872567.854418:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788872567.854643:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872567.854663:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9a00/0xe4e6e89fb01d9705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d970c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.854673:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9a00/0xe4e6e89fb01d9705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d970c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872567.854709:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788872567.854714:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9a00/0xe4e6e89fb01d9705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d970c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.854722:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9a00/0xe4e6e89fb01d9705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d970c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872567.854730:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788872567.854732:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9d0cfb000 from 7 10000000:01000000:2.0:1788872567.854735:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788872567.854768:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5441c00/0xe4e6e89fb01d9713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.854776:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5441c00/0xe4e6e89fb01d9713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.854784:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5441c00/0xe4e6e89fb01d9713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872567.854806:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.854841:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872567.855133:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872567.855239:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327616768 00000100:00100000:1.0:1788872567.855245:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327616768 00000100:00100000:1.0:1788872567.855299:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788872567.855307:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327616768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872567.855316:0:85126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872567.855327:0:85126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c9600/0xe4e6e89fb01d971a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9713 expref: -99 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.855345:0:85126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c9600/0xe4e6e89fb01d971a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9713 expref: 16 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.855353:0:85126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c9600/0xe4e6e89fb01d971a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9713 expref: 16 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.855359:0:85126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9600, rc 0) 00000100:00100000:1.0:1788872567.855393:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327616768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872567.855399:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788872567.855601:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872567.855615:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5441c00/0xe4e6e89fb01d9713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d971a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.855623:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5441c00/0xe4e6e89fb01d9713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d971a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872567.855697:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.855725:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872567.855741:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872567.855873:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327616896 00000100:00100000:1.0:1788872567.855878:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327616896 00000100:00100000:1.0:1788872567.855913:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788872567.855920:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327616896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.856111:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327616896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872567.856119:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788872567.856262:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327616896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.856306:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.856347:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872567.856380:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872567.856430:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327617024 00000100:00100000:1.0:1788872567.856435:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327617024 00000100:00100000:1.0:1788872567.865358:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788872567.865378:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327617024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.865582:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327617024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (9232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872567.865594:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788872567.865679:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872567.867595:0:85185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788872567.868015:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788872567.868060:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788872567.868073:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5441c00/0xe4e6e89fb01d9713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d971a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.868085:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5441c00/0xe4e6e89fb01d9713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d971a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872567.868096:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788872567.868099:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff5b1000 from 52 10000000:01000000:2.0:1788872567.868102:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788872567.868150:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01d9721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.868159:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01d9721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.868169:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01d9721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872567.868214:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1caa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.868291:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872567.868339:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f6900 going to sleep for 11 seconds 00000100:00100000:3.0:1788872567.868363:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327617152 00000100:00100000:3.0:1788872567.868380:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327617152 00000100:00100000:3.0:1788872567.868459:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788872567.868533:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327617152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872567.868595:0:85126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872567.868611:0:85126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c58ae200/0xe4e6e89fb01d9728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9721 expref: -99 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.868635:0:85126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c58ae200/0xe4e6e89fb01d9728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9721 expref: 17 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.868660:0:85126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c58ae200/0xe4e6e89fb01d9728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9721 expref: 17 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.868669:0:85126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58ae200, rc 0) 00000100:00100000:0.0:1788872567.868739:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327617152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 257us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872567.868754:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788872567.868917:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1caa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872567.868945:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01d9721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872567.868958:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01d9721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872567.869064:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872567.869120:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872567.869169:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c740e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788872567.870151:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327617280 00000100:00100000:0.0:1788872567.870163:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327617280 00000100:00100000:0.0:1788872567.870219:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788872567.870229:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327617280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.870439:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327617280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872567.870447:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788872567.872494:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872567.872614:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872567.872721:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872567.872774:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c740e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788872567.873008:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327617408 00000100:00100000:0.0:1788872567.873029:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327617408 00000100:00100000:0.0:1788872567.873105:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788872567.873116:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327617408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.873285:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327617408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872567.873294:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788872567.873453:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872567.874790:0:85187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788872567.880976:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788872567.881049:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872567.881066:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01d9721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.881101:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01d9721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872567.881111:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788872567.881115:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788872567.881118:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788872567.881173:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58af800/0xe4e6e89fb01d972f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.881182:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c58af800/0xe4e6e89fb01d972f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.881193:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c58af800/0xe4e6e89fb01d972f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872567.881228:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.881340:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872567.881427:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef2af900 going to sleep for 11 seconds 00000100:00100000:2.0:1788872567.881936:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327617536 00000100:00100000:2.0:1788872567.881953:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327617536 00000100:00100000:2.0:1788872567.882043:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788872567.882055:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327617536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872567.882076:0:85130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872567.882097:0:85130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9f5440800/0xe4e6e89fb01d9736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d972f expref: -99 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.882127:0:85130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9f5440800/0xe4e6e89fb01d9736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d972f expref: 18 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.882138:0:85130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9f5440800/0xe4e6e89fb01d9736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d972f expref: 18 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.882146:0:85130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5440800, rc 0) 00000100:00100000:2.0:1788872567.882227:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327617536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872567.882233:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788872567.883351:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872567.883378:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c58af800/0xe4e6e89fb01d972f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.883391:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c58af800/0xe4e6e89fb01d972f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872567.883484:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.883539:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872567.883637:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef2af900 going to sleep for 11 seconds 00000100:00100000:2.0:1788872567.886788:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327617664 00000100:00100000:2.0:1788872567.886805:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327617664 00000100:00100000:2.0:1788872567.886873:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788872567.886885:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327617664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.887186:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327617664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (3645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872567.887206:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788872567.887311:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.887358:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.887400:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872567.887455:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef2af900 going to sleep for 11 seconds 00000100:00100000:2.0:1788872567.887527:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327617792 00000100:00100000:2.0:1788872567.887531:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327617792 00000100:00100000:2.0:1788872567.887586:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788872567.887594:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327617792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.890753:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327617792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3149us (3342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872567.890768:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788872567.890904:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872567.894421:0:85188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788872567.894846:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788872567.894876:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788872567.894887:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58af800/0xe4e6e89fb01d972f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.894899:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c58af800/0xe4e6e89fb01d972f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872567.894908:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788872567.894911:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ff5b1000 from 7 10000000:01000000:2.0:1788872567.894914:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788872567.894957:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01d973d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.894965:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01d973d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.894976:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01d973d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872567.895001:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.895092:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872567.895139:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f6540 going to sleep for 11 seconds 00000100:00100000:0.0:1788872567.895908:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327617920 00000100:00100000:0.0:1788872567.895917:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327617920 00000100:00100000:0.0:1788872567.895980:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788872567.895990:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327617920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872567.896004:0:85130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872567.896020:0:85130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c58aea00/0xe4e6e89fb01d9744 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d973d expref: -99 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.896045:0:85130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c58aea00/0xe4e6e89fb01d9744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d973d expref: 19 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.896056:0:85130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c58aea00/0xe4e6e89fb01d9744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d973d expref: 19 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.896064:0:85130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58aea00, rc 0) 00000100:00100000:0.0:1788872567.896270:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327617920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 280us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872567.896288:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788872567.899423:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327617920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872567.899467:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01d973d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9744 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872567.899480:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01d973d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9744 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872567.899600:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872567.899673:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872567.899708:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c740ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872567.900799:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327618048 00000100:00100000:0.0:1788872567.900809:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327618048 00000100:00100000:0.0:1788872567.900857:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788872567.900865:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327618048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.901043:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327618048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872567.901052:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788872567.901986:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.902039:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.902088:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.902125:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c740ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788872567.902362:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327618176 00000100:00100000:2.0:1788872567.902369:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327618176 00000100:00100000:2.0:1788872567.902424:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788872567.902433:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327618176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.902573:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327618176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872567.902582:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788872567.902630:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788872567.903851:0:85190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788872567.916253:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788872567.916313:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788872567.916326:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01d973d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9744 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872567.916339:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01d973d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9744 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872567.916377:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788872567.916380:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ef97c000 from 52 10000000:01000000:3.0:1788872567.916384:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788872567.916430:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb000/0xe4e6e89fb01d974b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872567.916438:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb000/0xe4e6e89fb01d974b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872567.917544:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb000/0xe4e6e89fb01d974b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872567.917595:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872567.917672:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872567.917722:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5edcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872567.918047:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327618304 00000100:00100000:0.0:1788872567.918055:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327618304 00000100:00100000:0.0:1788872567.918113:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788872567.918623:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df44d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327618304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872567.918642:0:85130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872567.918663:0:85130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01d9752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d974b expref: -99 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.918694:0:85130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01d9752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d974b expref: 20 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.918706:0:85130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01d9752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d974b expref: 20 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.918716:0:85130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58ae600, rc 0) 00000100:00100000:0.0:1788872567.918797:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df44d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327618304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 676us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872567.918805:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788872567.919625:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872567.919650:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb000/0xe4e6e89fb01d974b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9752 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872567.919672:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb000/0xe4e6e89fb01d974b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9752 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872567.919756:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872567.919796:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872567.919828:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327618432 00000100:00100000:3.0:1788872567.919834:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327618432 00000100:00100000:3.0:1788872567.919870:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788872567.919878:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df44f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327618432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872567.920010:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df44f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327618432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872567.920017:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788872567.920059:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5edcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872567.920071:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872567.920098:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872567.920139:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872567.920161:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327618560 00000100:00100000:3.0:1788872567.920164:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327618560 00000100:00100000:3.0:1788872567.920187:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788872567.920193:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df44d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327618560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872567.920264:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df44d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327618560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872567.920270:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788872567.920318:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5edcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872567.920336:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872567.922992:0:85192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788872567.923999:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788872567.924046:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788872567.924057:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb000/0xe4e6e89fb01d974b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9752 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.924070:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb000/0xe4e6e89fb01d974b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9752 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872567.924091:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788872567.924094:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788872567.924097:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788872567.924133:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8000/0xe4e6e89fb01d9759 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.924141:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8000/0xe4e6e89fb01d9759 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.924151:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8000/0xe4e6e89fb01d9759 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872567.924174:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.924242:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.924297:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788872567.924418:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327618688 00000100:00100000:3.0:1788872567.924426:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327618688 00000100:00100000:3.0:1788872567.924490:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788872567.924499:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df44e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327618688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872567.924513:0:85126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872567.924526:0:85126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5deb400/0xe4e6e89fb01d9760 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9759 expref: -99 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872567.924576:0:85126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5deb400/0xe4e6e89fb01d9760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9759 expref: 21 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872567.924588:0:85126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5deb400/0xe4e6e89fb01d9760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9759 expref: 21 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872567.924597:0:85126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5deb400, rc 0) 00000100:00100000:3.0:1788872567.924641:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df44e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327618688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872567.924648:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788872567.924881:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872567.924897:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8000/0xe4e6e89fb01d9759 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.924906:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8000/0xe4e6e89fb01d9759 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872567.924970:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.924997:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.925091:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788872567.925133:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327618816 00000100:00100000:3.0:1788872567.925138:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327618816 00000100:00100000:3.0:1788872567.925172:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788872567.925179:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df44cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327618816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872567.925380:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df44cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327618816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872567.925388:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788872567.928391:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.928478:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.928583:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872567.928624:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788872567.928706:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327618944 00000100:00100000:0.0:1788872567.928713:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327618944 00000100:00100000:0.0:1788872567.928773:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788872567.928782:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df44e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327618944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.933494:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df44e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327618944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4698us (4896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872567.933533:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788872567.933534:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327618944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788872567.936332:0:85194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788872567.936920:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788872567.937021:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788872567.937038:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8000/0xe4e6e89fb01d9759 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.937050:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8000/0xe4e6e89fb01d9759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872567.937059:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788872567.937062:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ef97c000 from 7 10000000:01000000:1.0:1788872567.937064:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788872567.937102:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01d9767 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.937111:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01d9767 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.938047:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01d9767 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872567.938090:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327619072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.938700:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.938815:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82ba180 going to sleep for 11 seconds 00000100:00100000:3.0:1788872567.949420:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327619072 00000100:00100000:3.0:1788872567.949900:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327619072 00000100:00100000:2.0:1788872567.950182:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788872567.950196:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df44dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327619072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872567.950219:0:85123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872567.950242:0:85123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9f5440600/0xe4e6e89fb01d976e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9767 expref: -99 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.950290:0:85123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9f5440600/0xe4e6e89fb01d976e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9767 expref: 22 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.950316:0:85123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9f5440600/0xe4e6e89fb01d976e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9767 expref: 22 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.950324:0:85123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5440600, rc 0) 00000100:00100000:2.0:1788872567.950466:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df44dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327619072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 273us (11768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872567.950473:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788872567.956218:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327619072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872567.956256:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01d9767 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d976e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872567.956283:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01d9767 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d976e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872567.956388:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327619200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.956461:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872567.956519:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c65073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872567.956699:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327619200 00000100:00100000:2.0:1788872567.956706:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327619200 00000100:00100000:2.0:1788872567.956826:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788872567.956838:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df44ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327619200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872567.956973:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df44ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327619200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872567.956981:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788872567.957910:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327619200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.957961:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327619328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872567.958015:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.958606:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327619328 00000100:00100000:1.0:1788872567.958612:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327619328 00000100:00100000:0.0:1788872567.958632:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c65073c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872567.958659:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788872567.958669:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df44c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327619328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.958804:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df44c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327619328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872567.958812:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788872567.958842:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327619328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788872567.960169:0:85196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788872567.960295:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788872567.960331:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788872567.960343:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01d9767 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d976e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.960354:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01d9767 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d976e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872567.960363:0:6517:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788872567.960366:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98a9e9b999c0 from 1 10000000:01000000:1.0:1788872567.960368:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788872567.960403:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01d9775 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.960409:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01d9775 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.960419:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01d9775 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872567.960441:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327619456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.960504:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.960539:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82bad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788872567.961205:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327619456 00000100:00100000:2.0:1788872567.961213:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327619456 00000100:00100000:2.0:1788872567.961281:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788872567.961291:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df44d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327619456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872567.961305:0:85123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872567.961324:0:85123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9f5440200/0xe4e6e89fb01d977c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9775 expref: -99 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.961351:0:85123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9f5440200/0xe4e6e89fb01d977c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9775 expref: 23 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.961361:0:85123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9f5440200/0xe4e6e89fb01d977c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9775 expref: 23 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.961380:0:85123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5440200, rc 0) 00000100:00100000:2.0:1788872567.961439:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df44d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327619456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872567.961456:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788872567.961588:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327619456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872567.961602:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01d9775 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d977c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.961610:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01d9775 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d977c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872567.961626:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788872567.961637:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01d9775 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d977c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.961644:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01d9775 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d977c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872567.961651:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788872567.961653:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98a9e9b999c0 from 1 10000000:01000000:1.0:1788872567.961656:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788872567.961673:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01d9783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.961680:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01d9783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.961687:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01d9783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872567.961702:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327619584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.961730:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.961757:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82bad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788872567.962139:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327619584 00000100:00100000:2.0:1788872567.962145:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327619584 00000100:00100000:2.0:1788872567.962179:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788872567.962188:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df44c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327619584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872567.962197:0:85126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872567.962207:0:85126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d978a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9783 expref: -99 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.962223:0:85126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d978a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9783 expref: 24 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.962232:0:85126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d978a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9783 expref: 24 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872567.962239:0:85126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5441a00, rc 0) 00000100:00100000:2.0:1788872567.962287:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df44c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327619584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872567.962293:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788872567.962381:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327619584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872567.962392:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01d9783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d978a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.962401:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01d9783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d978a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872567.962456:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327619712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.962583:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872567.962606:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82bad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788872567.962620:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327619712 00000100:00100000:1.0:1788872567.962623:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327619712 00000100:00100000:1.0:1788872567.962649:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788872567.962655:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df44f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327619712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872567.962722:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df44f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327619712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (139us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788872567.962729:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788872567.962759:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327619712:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788872567.963592:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788872567.963602:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01d9783 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d978a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872567.963612:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01d9783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d978a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872568.056743:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872569.081882:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872570.105164:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872571.129666:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872572.088676:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872572.088709:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327619840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872572.088784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.089170:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327619840 00000100:00100000:3.0:1788872572.089180:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327619840 00000100:00100000:3.0:1788872572.089247:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:3.0:1788872572.089258:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f098b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327619840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788872572.089293:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:3.0:1788872572.089347:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f098b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327619840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872572.089354:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:3.0:1788872572.089415:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327619840:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788872572.093793:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872572.093800:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872572.093803:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872572.093811:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3503 00000100:00080000:3.0:1788872572.093815:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872572.093822:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872572.093841:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef1b8000 x1875765327620096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872572.093871:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872572.093874:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872572.093876:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872572.093879:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3503 00000100:00080000:3.0:1788872572.093881:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872572.093884:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872572.093910:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef1bbb80 x1875765327620352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872572.093915:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327619968:0@lo:400:kworker.0 00000100:00080000:3.0:1788872572.093931:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872572.093935:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872572.093937:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872572.093941:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3503 00000100:00080000:3.0:1788872572.093943:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872572.093947:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872572.093960:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a0a80 x1875765327620608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872572.093992:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1788872572.093998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788872572.093999:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872572.094003:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872572.094007:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3503 00000100:00080000:3.0:1788872572.094010:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872572.094013:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872572.094023:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a3b80 x1875765327620992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872572.094043:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788872572.094046:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872572.094047:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9ff63f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872572.094052:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98a9ff63f800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872572.094063:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a1c00 x1875765327621376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872572.094063:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327620864:0@lo:400:kworker.0 00000100:00100000:3.0:1788872572.094106:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327620736:0@lo:400:kworker.0 00000100:00100000:3.0:1788872572.094140:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327620096:0@lo:38:kworker.0 00000100:00100000:3.0:1788872572.094163:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872572.094175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.094188:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327620352:0@lo:38:kworker.0 00000100:00100000:3.0:1788872572.094227:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.094247:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327620608:0@lo:38:kworker.0 00000100:00100000:3.0:1788872572.094269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.094285:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327620992:0@lo:38:kworker.0 00000100:00100000:3.0:1788872572.094304:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872572.094316:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327620864 00000100:00100000:3.0:1788872572.094322:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327621376:0@lo:38:kworker.0 00000100:00100000:1.0:1788872572.094326:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327620864 00000100:00100000:3.0:1788872572.094348:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872572.094400:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:1.0:1788872572.094410:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327620864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872572.094466:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327620864:12345-0@lo:400:kworker.0 Request processed in 57us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872572.094481:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00080000:1.0:1788872572.094503:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872572.094535:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327620864:0@lo:400:kworker.0 00000100:00100000:2.0:1788872572.094839:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327619968 00000100:00100000:2.0:1788872572.094844:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327619968 00000100:00100000:2.0:1788872572.094877:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788872572.094890:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c7796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327619968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872572.094929:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c7796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327619968:12345-0@lo:400:kworker.0 Request processed in 40us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872572.094935:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788872572.095128:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327620224:0@lo:400:kworker.0 00000100:00100000:3.0:1788872572.095158:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.095246:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327621120:0@lo:400:kworker.0 00000100:00100000:3.0:1788872572.095270:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.095290:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788872572.095296:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327620480:0@lo:400:kworker.0 00000100:00100000:3.0:1788872572.095316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.095333:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327621248:0@lo:400:kworker.0 00000100:00100000:3.0:1788872572.095354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.095383:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327620096 00000100:00100000:3.0:1788872572.095388:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327620096 00000100:00100000:3.0:1788872572.095402:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327620352 00000100:00100000:3.0:1788872572.095410:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327620352 00000100:00100000:3.0:1788872572.095420:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327620992 00000100:00100000:3.0:1788872572.095422:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327620992 00000100:00100000:3.0:1788872572.095429:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327621376 00000100:00100000:3.0:1788872572.095431:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327621376 00000100:00100000:3.0:1788872572.095438:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327620224 00000100:00100000:3.0:1788872572.095439:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327620224 00000100:00100000:3.0:1788872572.095471:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327620480 00000100:00100000:3.0:1788872572.095475:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327620480 00000100:00100000:3.0:1788872572.095488:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:3.0:1788872572.095493:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327620224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872572.095529:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327620224:12345-0@lo:400:kworker.0 Request processed in 35us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872572.095535:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:3.0:1788872572.095546:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1788872572.095572:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327620480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872572.095600:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327620480:12345-0@lo:400:kworker.0 Request processed in 28us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872572.095606:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1788872572.095812:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1788872572.095821:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327620096:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872572.095848:0:66193:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3509 last 0 00000020:00000080:3.0:1788872572.095883:0:66193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe4e6e89fb01d9791 00000004:00100000:3.0:1788872572.095900:0:66193:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872572.096138:0:66193:0:(import.c:65:import_set_state_nolock()) ffff98a9c5f16800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872572.096188:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875765327620096:12345-0@lo:38:kworker.0 Request processed in 365us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872572.096205:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1788872572.096228:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1788872572.096232:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327620352:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872572.096245:0:66193:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3509 last 0 00000020:00000080:3.0:1788872572.096268:0:66193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe4e6e89fb01d9798 00000004:00100000:3.0:1788872572.096275:0:66193:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872572.096291:0:66193:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872572.096319:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875765327620352:12345-0@lo:38:kworker.0 Request processed in 86us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872572.096325:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1788872572.096338:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1788872572.096342:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327620992:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872572.096355:0:66193:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3509 last 0 00000020:00000080:3.0:1788872572.096374:0:66193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe4e6e89fb01d979f 00000004:00100000:3.0:1788872572.096380:0:66193:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872572.096393:0:66193:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872572.096419:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875765327620992:12345-0@lo:38:kworker.0 Request processed in 76us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872572.096425:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1788872572.096437:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1788872572.096441:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327621376:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872572.096629:0:66193:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3509 last 0 00000020:00000080:3.0:1788872572.096651:0:66193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe4e6e89fb01d97a6 00000004:00100000:3.0:1788872572.096658:0:66193:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872572.096672:0:66193:0:(import.c:65:import_set_state_nolock()) ffff98a9ff60b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872572.096769:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875765327621376:12345-0@lo:38:kworker.0 Request processed in 326us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872572.096782:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1788872572.096811:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327620608 00000100:00100000:3.0:1788872572.096816:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327620608 00000100:00100000:3.0:1788872572.096841:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:3.0:1788872572.096845:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327620608:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872572.096859:0:8446:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff98a9e99ab800, cookie 0xe4e6e89fb01d961e 00010000:00080000:3.0:1788872572.096864:0:8446:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378652 exp ffff98a9e99ab800 cur 3509 last 1788872566 00000004:00100000:3.0:1788872572.096872:0:8446:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872572.096886:0:8446:0:(import.c:65:import_set_state_nolock()) ffff98a9ff60d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872572.096926:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327620608:12345-0@lo:38:kworker.0 Request processed in 78us (2655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872572.096932:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00100000:0.0:1788872572.097312:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327621120 00000100:00100000:0.0:1788872572.097317:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327621120 00000100:00100000:0.0:1788872572.097345:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327621248 00000100:00100000:0.0:1788872572.097347:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327621248 00000100:00100000:0.0:1788872572.097375:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422 00000100:00100000:0.0:1788872572.097381:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327621120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872572.097588:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327620480:0@lo:400:kworker.0 00000100:00100000:3.0:1788872572.097614:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327620224:0@lo:400:kworker.0 00000100:00100000:1.0:1788872572.097614:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:1.0:1788872572.097627:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327621248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872572.097676:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327621248:12345-0@lo:400:kworker.0 Request processed in 53us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872572.097683:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00080000:1.0:1788872572.097818:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872572.097824:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872572.097827:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788872572.097838:0:85152:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1788872572.097843:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327621248:0@lo:400:kworker.0 00010000:00080000:1.0:1788872572.097843:0:85152:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 98784247810 00000020:00080000:1.0:1788872572.097851:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.097855:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247810, next_transno: 98784247810 00010000:00080000:1.0:1788872572.097860:0:85152:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247810) 00000020:00080000:1.0:1788872572.097862:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.097874:0:85152:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311123328 t98784247810 from 192.168.204.39@tcp req@ffff98a8c4d16a00 x1875765311123328/t0(98784247810) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:493/0 lens 528/0 e 0 to 0 dl 1788872578 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788872572.097881:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9ef1b8000 x1875765327620096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872572.097896:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00100000:0.0:1788872572.098111:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327621120:12345-0@lo:400:kworker.0 Request processed in 729us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872572.098118:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422 00000100:00100000:0.0:1788872572.098148:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327619968:0@lo:400:kworker.0 00000100:00100000:0.0:1788872572.098180:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872572.098231:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327620736 00000100:00100000:0.0:1788872572.098236:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327620736 00000100:00100000:0.0:1788872572.098265:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424 00000100:00100000:0.0:1788872572.098271:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327620736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872572.098311:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327620736:12345-0@lo:400:kworker.0 Request processed in 40us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872572.098316:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424 00000100:00100000:0.0:1788872572.098343:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327620736:0@lo:400:kworker.0 00000100:00100000:0.0:1788872572.098371:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327621120:0@lo:400:kworker.0 00000100:00080000:0.0:1788872572.098396:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872572.100907:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff98a9ef1b8000 x1875765327620096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872597 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872572.100925:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788872572.100931:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788872572.100936:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788872572.100951:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327620096:0@lo:38:kworker.0 00010000:00080000:3.0:1788872572.101061:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9ef1bbb80 x1875765327620352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872572.101077:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000004:00080000:1.0:1788872572.102099:0:85152:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4167us 00000100:00080000:3.0:1788872572.104610:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff98a9ef1bbb80 x1875765327620352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872597 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872572.104624:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788872572.104630:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788872572.104635:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788872572.104641:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327620352:0@lo:38:kworker.0 00000100:00080000:3.0:1788872572.105050:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:3.0:1788872572.105065:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788872572.105070:0:3643:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788872572.105072:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:3.0:1788872572.105076:0:3643:0:(recover.c:53:ptlrpc_replay_next()) import ffff98a9df8c9800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:3.0:1788872572.105080:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1788872572.107689:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327620608:0@lo:38:kworker.0 00010000:00080000:2.0:1788872572.107735:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9f67a3b80 x1875765327620992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788872572.107755:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00000100:00080000:2.0:1788872572.108839:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff98a9f67a3b80 x1875765327620992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872597 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788872572.108850:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788872572.108856:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788872572.108860:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788872572.108866:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327620992:0@lo:38:kworker.0 00010000:00080000:2.0:1788872572.108895:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9f67a1c00 x1875765327621376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788872572.108907:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:2.0:1788872572.108914:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788872572.108919:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788872572.108921:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ff63f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788872572.108925:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327621376:0@lo:38:kworker.0 00010000:00080000:3.0:1788872572.114141:0:85394:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1788872572.114149:0:85394:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1788872572.114156:0:85394:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1788872572.114653:0:85394:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788872572.114944:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327621504:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788872572.115048:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.115831:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327621504 00000100:00100000:3.0:1788872572.115841:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327621504 00000100:00100000:3.0:1788872572.115889:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:3.0:1788872572.115898:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327621504:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788872572.115926:0:8447:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a8c1ca9180 x1875765327621504/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:498/0 lens 224/0 e 0 to 0 dl 1788872583 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872572.115937:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327621504:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 41us (890us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872572.115944:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00010000:00010000:1.0:1788872572.132327:0:85152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d97ad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132351:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d97ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132368:0:85152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d97ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132390:0:85152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d97b4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132398:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d97b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132405:0:85152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d97b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132814:0:85152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d97ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132823:0:85152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d97ad lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132829:0:85152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d97ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132835:0:85152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872572.132839:0:85152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d97ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132847:0:85152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d97ad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132859:0:85152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4f00) 00010000:00010000:1.0:1788872572.132862:0:85152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872572.132866:0:85152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d97ad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132873:0:85152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d97ad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872572.132896:0:85152:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019c8f8e8 reply state 0000000053de4e0e transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d97b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132907:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d97b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.132914:0:85152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4e00) 00010000:00010000:1.0:1788872572.132916:0:85152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872572.132919:0:85152:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788872572.133026:0:85152:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788872572.133044:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.133047:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000020:00080000:1.0:1788872572.133051:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.133053:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000100:00100000:3.0:1788872572.136479:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872572.136608:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311123840 00000100:00100000:3.0:1788872572.136619:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311123840 00000100:00100000:3.0:1788872572.136675:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1069 00000100:00100000:3.0:1788872572.136685:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2403:x1875765311123840:12345-192.168.204.39@tcp:36:rm.0 00010000:00080000:3.0:1788872572.136705:0:66193:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247811, current: 98784247811, replaying 00000100:00100000:3.0:1788872572.136718:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2403:x1875765311123840:12345-192.168.204.39@tcp:36:rm.0 Request processed in 36us (250us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872572.136725:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1069 00000020:00080000:3.0:1788872572.136777:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872572.136781:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247811, next_transno: 98784247811 00010000:00080000:3.0:1788872572.136786:0:85152:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247811) 00000020:00080000:3.0:1788872572.136789:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872572.136798:0:85152:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311123840 t98784247811 from 192.168.204.39@tcp req@ffff98a9f67a2300 x1875765311123840/t0(98784247811) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:498/0 lens 512/0 e 0 to 0 dl 1788872583 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788872572.136893:0:85152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debe00/0xe4e6e89fb01d97bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.136910:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debe00/0xe4e6e89fb01d97bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.136921:0:85152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debe00/0xe4e6e89fb01d97bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.136944:0:85152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d97c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.136953:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d97c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.136961:0:85152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d97c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137049:0:85152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d97c9 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137058:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d97c9 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137065:0:85152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d97c9 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137324:0:85152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d97c9 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137333:0:85152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d97c9 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137340:0:85152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d97c9 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137346:0:85152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5dea400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872572.137352:0:85152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d97c9 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137359:0:85152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d97c9 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137380:0:85152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff98a9cd26b700) 00010000:00010000:3.0:1788872572.137383:0:85152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788872572.137388:0:85152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d97c9 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137394:0:85152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d97c9 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137416:0:85152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debe00/0xe4e6e89fb01d97bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137423:0:85152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debe00/0xe4e6e89fb01d97bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137429:0:85152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debe00/0xe4e6e89fb01d97bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137434:0:85152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5debe00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872572.137437:0:85152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debe00/0xe4e6e89fb01d97bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137443:0:85152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debe00/0xe4e6e89fb01d97bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137450:0:85152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd26be00) 00010000:00010000:3.0:1788872572.137453:0:85152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872572.137455:0:85152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debe00/0xe4e6e89fb01d97bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137461:0:85152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debe00/0xe4e6e89fb01d97bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872572.137487:0:85152:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045e4a166 reply state 0000000075c12b38 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d97c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137499:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d97c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.137505:0:85152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4e00) 00010000:00010000:3.0:1788872572.137507:0:85152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872572.137510:0:85152:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788872572.137613:0:85152:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788872572.137627:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872572.137630:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000020:00080000:3.0:1788872572.137634:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872572.137636:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000100:00100000:2.0:1788872572.153324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872572.153714:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311125632 00000100:00100000:3.0:1788872572.153732:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311125632 00010000:00010000:1.0:1788872572.154258:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872572.154397:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1070 00000100:00100000:1.0:1788872572.154419:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2403:x1875765311125632:12345-192.168.204.39@tcp:101:lfs.0 00010000:00080000:1.0:1788872572.154443:0:66190:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247812, current: 98784247812, replaying 00000100:00100000:1.0:1788872572.154462:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2403:x1875765311125632:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 54us (1147us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872572.154471:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1070 00000020:00080000:1.0:1788872572.154497:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.154500:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247812, next_transno: 98784247812 00010000:00080000:1.0:1788872572.154505:0:85152:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247812) 00000020:00080000:1.0:1788872572.154508:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.154519:0:85152:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311125632 t98784247812 from 192.168.204.39@tcp req@ffff98a8c1caa300 x1875765311125632/t0(98784247812) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:498/0 lens 536/0 e 0 to 0 dl 1788872583 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1788872572.154611:0:85152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872572.154706:0:85152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d97d0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fadfb expref: -99 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788872572.156021:0:85118:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247810 is committed 00010000:00010000:1.0:1788872572.156375:0:85152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d97d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.156392:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d97d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.156404:0:85152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d97d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.156420:0:85152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01d97de lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.156427:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01d97de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.156433:0:85152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01d97de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872572.156963:0:85152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:1.0:1788872572.156983:0:85152:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0xe4e6e89fb01d9576 00000004:00080000:1.0:1788872572.156986:0:85152:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xe4e6e89fb01d9576 in new mfd 00010000:00010000:1.0:1788872572.156997:0:85152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d97d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.157004:0:85152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d97d7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.157028:0:85152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d97d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.157034:0:85152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872572.157038:0:85152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d97d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.157047:0:85152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d97d7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.157061:0:85152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4700) 00010000:00010000:1.0:1788872572.157063:0:85152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872572.157068:0:85152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d97d7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.157074:0:85152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d97d7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872572.157088:0:85152:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000817aa847 reply state 00000000f2e29f15 transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01d97de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.157099:0:85152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01d97de lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.157105:0:85152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff98a9e7bf4400) 00010000:00010000:1.0:1788872572.157108:0:85152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872572.157110:0:85152:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788872572.157143:0:85152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d97d0 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadfb expref: 11 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.157165:0:85152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4700) 00010000:00010000:1.0:1788872572.157167:0:85152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872572.157171:0:85152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d97d0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fadfb expref: 11 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.157186:0:85152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9c00, rc 0) 00010000:00080000:1.0:1788872572.158657:0:85152:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788872572.158687:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.158690:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000020:00080000:1.0:1788872572.158695:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.158697:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00010000:00010000:1.0:1788872572.158727:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d97b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.158738:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d97b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.158745:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d97b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.158751:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872572.158756:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d97b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.158763:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d97b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.160085:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4e00) 00010000:00010000:1.0:1788872572.160098:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872572.160106:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d97b4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.160114:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d97b4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872572.188612:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872572.188711:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311125888 00000100:00100000:1.0:1788872572.188729:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311125888 00000100:00100000:1.0:1788872572.188800:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1071 00000100:00100000:1.0:1788872572.188810:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2403:x1875765311125888:12345-192.168.204.39@tcp:101:lfs.0 00010000:00080000:1.0:1788872572.188831:0:66192:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:1.0:1788872572.188845:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2403:x1875765311125888:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 38us (303us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872572.188851:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1071 00000020:00080000:1.0:1788872572.188869:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.188872:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:1.0:1788872572.188876:0:85152:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:1.0:1788872572.188879:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.188887:0:85152:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311125888 t98784247813 from 192.168.204.39@tcp req@ffff98a9f67a1c00 x1875765311125888/t0(98784247813) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:498/0 lens 736/0 e 0 to 0 dl 1788872583 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1788872572.188910:0:85152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872572.188934:0:85152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01d97ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae02 expref: -99 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872572.189032:0:85152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:1.0:1788872572.191540:0:85152:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0xe4e6e89fb01d958b 00000004:00080000:1.0:1788872572.191563:0:85152:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xe4e6e89fb01d958b in new mfd 00010000:00010000:1.0:1788872572.191629:0:85152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01d97ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae02 expref: 12 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.191647:0:85152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4700) 00010000:00010000:1.0:1788872572.191650:0:85152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788872572.191655:0:85152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01d97ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae02 expref: 12 pid: 85152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.191675:0:85152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2600, rc 0) 00010000:00080000:1.0:1788872572.191753:0:85152:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788872572.191777:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.191781:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:1.0:1788872572.191785:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.191788:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000100:00100000:0.0:1788872572.197053:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872572.197179:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311126272 00000100:00100000:3.0:1788872572.197210:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311126272 00000100:00100000:3.0:1788872572.197304:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 215 00000100:00100000:3.0:1788872572.197318:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2403:x1875765311126272:12345-192.168.204.39@tcp:35:lfs.0 00010000:00080000:3.0:1788872572.197347:0:66194:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:3.0:1788872572.197377:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2403:x1875765311126272:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 60us (331us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872572.197387:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 215 00000020:00080000:0.0:1788872572.197807:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872572.197816:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:0.0:1788872572.197821:0:85152:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:0.0:1788872572.197823:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872572.197835:0:85152:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311126272 t98784247814 from 192.168.204.39@tcp req@ffff98a9f85c6680 x1875765311126272/t0(98784247814) o35->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:498/0 lens 392/0 e 0 to 0 dl 1788872583 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788872572.198339:0:85152:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788872572.198365:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872572.198367:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:0.0:1788872572.198371:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872572.198372:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:1.0:1788872572.201713:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872572.201843:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311126528 00000100:00100000:3.0:1788872572.201855:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311126528 00000100:00100000:3.0:1788872572.201917:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 216 00000100:00100000:3.0:1788872572.201927:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0953050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2403:x1875765311126528:12345-192.168.204.39@tcp:35:lfs.0 00010000:00080000:3.0:1788872572.201952:0:66195:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:3.0:1788872572.202032:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0953050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2403:x1875765311126528:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 49us (273us total) trans 0 rc 0/-999 00000020:00080000:2.0:1788872572.202035:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:3.0:1788872572.202040:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 216 00010000:00080000:2.0:1788872572.202040:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:2.0:1788872572.202044:0:85152:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:2.0:1788872572.202047:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872572.202057:0:85152:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311126528 t98784247815 from 192.168.204.39@tcp req@ffff98a9f0953050 x1875765311126528/t0(98784247815) o35->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:498/0 lens 392/0 e 0 to 0 dl 1788872583 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788872572.202458:0:85152:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788872572.202509:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872572.202512:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:2.0:1788872572.202516:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872572.202518:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:0.0:1788872572.211512:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872572.211796:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311130368 00000100:00100000:3.0:1788872572.211807:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311130368 00000100:00100000:3.0:1788872572.211876:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1050 00000100:00100000:3.0:1788872572.211893:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:2403:x1875765311130368:12345-192.168.204.39@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788872572.211921:0:66193:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a9f85c7100 x1875765311130368/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:498/0 lens 224/0 e 0 to 0 dl 1788872583 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872572.211951:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:2403:x1875765311130368:12345-192.168.204.39@tcp:400:ldlm_lock_repla.0 Request processed in 68us (451us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872572.211959:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1050 00000020:00080000:1.0:1788872572.212004:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.212008:0:85152:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247816 00010000:00080000:1.0:1788872572.212010:0:85152:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788872572.212013:0:85152:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872572.212020:0:85152:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788872572.212023:0:85152:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788872572.212154:0:85152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:3.0:1788872572.215186:0:85118:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00100000:3.0:1788872572.215207:0:85118:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788872572.215233:0:85118:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00000001:00080000:1.0:1788872572.215359:0:85152:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788872572.215401:0:85152:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1788872572.215419:0:85152:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff98a8c1ca9180 x1875765327621504/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:498/0 lens 224/0 e 0 to 0 dl 1788872583 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788872572.215583:0:85152:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.39@tcp: req@ffff98a9f85c7100 x1875765311130368/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:498/0 lens 224/0 e 0 to 0 dl 1788872583 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788872572.215653:0:85152:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788872572.217222:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788872572.217237:0:3643:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff98a9f67a0000 x1875765327621504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872588 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872572.217248:0:3643:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff98a9f67a0000 x1875765327621504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872588 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872572.217256:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788872572.217269:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788872572.217290:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327621504:0@lo:400:ldlm_lock_repla.0 00010000:00010000:0.0:1788872572.218372:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d97c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218386:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d97c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218395:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d97c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218401:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5dea200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872572.218406:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d97c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218415:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d97c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218434:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4e00) 00010000:00010000:0.0:1788872572.218438:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872572.218443:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d97c2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218449:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d97c2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218477:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01d97de lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218500:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01d97de lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218506:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01d97de lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218511:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872572.218515:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01d97de lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218520:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01d97de lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218530:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff98a9e7bf4400) 00010000:00010000:0.0:1788872572.218532:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872572.218535:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01d97de lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.218541:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01d97de lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872572.218605:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327621632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872572.218679:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.218766:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327621632 00000100:00100000:3.0:1788872572.218774:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327621632 00000100:00100000:3.0:1788872572.218827:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:3.0:1788872572.218836:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327621632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872572.218873:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:3.0:1788872572.218918:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327621632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872572.218925:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000100:00100000:0.0:1788872572.219484:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327621632:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1788872572.263315:0:85152:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb002c86efe10 00100000:10000000:0.0:1788872572.263332:0:85152:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1788872572.263699:0:85138:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1788872572.263747:0:85138:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85138:1875765327621760:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788872572.263820:0:85138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872572.263868:0:85138:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5ea8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788872572.263894:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327621760 00000100:00100000:0.0:1788872572.263900:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327621760 00000100:00100000:0.0:1788872572.263945:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5932 00000100:00100000:0.0:1788872572.263954:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:85138:x1875765327621760:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788872572.263982:0:26188:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -561 00002000:02000040:0.0:1788872572.263986:0:26188:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:737) 00000004:00080000:3.0:1788872572.265879:0:85140:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:3.0:1788872572.265924:0:85140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85140:1875765327621888:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788872572.265982:0:85140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.266016:0:85140:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c73ec300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872572.268484:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327621888 00000100:00100000:1.0:1788872572.268501:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327621888 00000100:00100000:1.0:1788872572.268582:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5933 00000100:00100000:1.0:1788872572.268593:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:85140:x1875765327621888:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788872572.268632:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -63 00002000:02000040:1.0:1788872572.268637:0:8437:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:737) 00000001:02000400:3.0:1788872572.282139:0:85404:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00002000:00010000:0.0:1788872572.282344:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.282356:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092a37b12/0xe4e6e89fb01d97fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.282375:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e1:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.282380:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.282388:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092a37b12/0xe4e6e89fb01d97fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.282405:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092a37b12/0xe4e6e89fb01d97fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.282417:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092a37b12/0xe4e6e89fb01d97fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.282426:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092a37b12/0xe4e6e89fb01d97fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.282457:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872572.283339:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872572.283347:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092a37b12/0xe4e6e89fb01d97fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.283358:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.283363:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092a37b12/0xe4e6e89fb01d97fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.283373:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092a37b12/0xe4e6e89fb01d97fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.283399:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092a37b12/0xe4e6e89fb01d97fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.283419:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092a37b12/0xe4e6e89fb01d97fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.283440:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.283442:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.283444:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.286149:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.286165:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d588c795/0xe4e6e89fb01d9801 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.286183:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e0:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.286188:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.286206:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d588c795/0xe4e6e89fb01d9801 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.286220:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d588c795/0xe4e6e89fb01d9801 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.286232:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d588c795/0xe4e6e89fb01d9801 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.286240:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d588c795/0xe4e6e89fb01d9801 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.288114:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.288134:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.288142:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d588c795/0xe4e6e89fb01d9801 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.288153:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.288158:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d588c795/0xe4e6e89fb01d9801 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.288203:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d588c795/0xe4e6e89fb01d9801 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.288225:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d588c795/0xe4e6e89fb01d9801 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.288232:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d588c795/0xe4e6e89fb01d9801 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.289433:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.289438:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.289441:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.291364:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.291920:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9808 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.291946:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2df:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.291951:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.291959:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9808 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.291978:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9808 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.291990:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9808 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292014:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9808 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292045:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872572.292141:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1788872572.292155:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872572.292156:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9808 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292169:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000885bc137/0xe4e6e89fb01d980f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292202:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.292206:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2de:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:2.0:1788872572.292211:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9808 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292212:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.292229:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000885bc137/0xe4e6e89fb01d980f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292252:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000885bc137/0xe4e6e89fb01d980f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292262:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9808 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292263:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000885bc137/0xe4e6e89fb01d980f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292304:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000885bc137/0xe4e6e89fb01d980f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292334:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9808 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292334:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872572.292350:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d80d3e6/0xe4e6e89fb01d9808 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292387:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872572.292393:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000885bc137/0xe4e6e89fb01d980f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872572.292394:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.292403:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd414c3b/0xe4e6e89fb01d9816 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292448:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dd:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.292451:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872572.292455:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.292456:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd414c3b/0xe4e6e89fb01d9816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292466:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000885bc137/0xe4e6e89fb01d980f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292474:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd414c3b/0xe4e6e89fb01d9816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292480:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000885bc137/0xe4e6e89fb01d980f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292487:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd414c3b/0xe4e6e89fb01d9816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292511:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd414c3b/0xe4e6e89fb01d9816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292516:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000885bc137/0xe4e6e89fb01d980f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292527:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000885bc137/0xe4e6e89fb01d980f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292533:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872572.292545:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.292589:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.292597:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd414c3b/0xe4e6e89fb01d9816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292606:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58afc00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.292609:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd414c3b/0xe4e6e89fb01d9816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292618:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd414c3b/0xe4e6e89fb01d9816 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292636:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd414c3b/0xe4e6e89fb01d9816 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292653:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd414c3b/0xe4e6e89fb01d9816 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872572.292654:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.292673:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003444c81e/0xe4e6e89fb01d981d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.292685:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.292685:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dc:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:2.0:1788872572.292691:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.292693:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872572.292697:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.292700:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003444c81e/0xe4e6e89fb01d981d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292712:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003444c81e/0xe4e6e89fb01d981d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292730:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003444c81e/0xe4e6e89fb01d981d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292737:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003444c81e/0xe4e6e89fb01d981d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.292760:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872572.293366:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872572.293377:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003444c81e/0xe4e6e89fb01d981d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.293387:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.293391:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003444c81e/0xe4e6e89fb01d981d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.293399:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003444c81e/0xe4e6e89fb01d981d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.293415:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003444c81e/0xe4e6e89fb01d981d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.293422:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003444c81e/0xe4e6e89fb01d981d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.293441:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.293442:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.293454:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788872572.295806:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788872572.296114:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.296133:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d9824 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.296154:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2db:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.296160:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.296167:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d9824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.296184:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d9824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.296208:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d9824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.296217:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d9824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297037:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872572.297184:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.297201:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01d982b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297212:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2da:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.297216:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.297221:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01d982b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297234:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01d982b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297254:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01d982b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297261:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01d982b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297285:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788872572.297300:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872572.297307:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d9824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297315:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58afe00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.297332:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d9824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297341:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d9824 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297360:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d9824 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297367:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01d9824 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297397:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.297400:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01d982b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297407:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.297410:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01d982b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297419:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01d982b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297430:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01d982b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297437:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01d982b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297460:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.297462:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.297465:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.297496:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.297523:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.297530:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01d9832 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297538:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d9:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.297541:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.297546:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01d9832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297581:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01d9832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297589:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01d9832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297596:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01d9832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297615:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872572.297642:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872572.297655:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01d9832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872572.297662:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.297676:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01d9839 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.297680:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.297690:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01d9832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297734:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d8:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:2.0:1788872572.297739:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01d9832 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297740:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.297751:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01d9839 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297774:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01d9839 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297783:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01d9839 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.297786:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01d9832 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297797:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01d9839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.297811:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01d9832 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297826:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.297839:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.297845:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01d9839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.297854:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.297855:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.297861:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.297863:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01d9839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.297867:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.297877:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01d9839 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297902:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01d9839 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297909:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01d9839 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297927:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.297929:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.297931:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.297975:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.297981:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01d9840 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.297989:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d7:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.297992:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.297996:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01d9840 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.298005:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01d9840 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.298012:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01d9840 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.302358:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01d9840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.302458:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.302502:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.302511:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01d9840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.302521:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.302528:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01d9840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.302543:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01d9840 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.302598:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01d9840 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.302606:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01d9840 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.302655:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.302658:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.302661:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.302881:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.302890:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01d9847 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.302907:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d6:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.302920:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.302930:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01d9847 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.302946:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01d9847 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.302956:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01d9847 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.302963:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01d9847 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.302979:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872572.303024:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.303030:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d984e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303038:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d5:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.303042:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.303046:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d984e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303055:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d984e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303063:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d984e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303077:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d984e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303092:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788872572.303101:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872572.303107:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01d9847 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303115:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.303119:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01d9847 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303128:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01d9847 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303142:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01d9847 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303150:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01d9847 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303166:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.303169:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d984e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303186:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.303199:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d984e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303208:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d984e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303218:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d984e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303226:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01d984e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303239:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.303241:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.303242:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.303297:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.303303:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01d9855 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303312:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d4:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.303316:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.303320:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01d9855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303329:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01d9855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303343:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01d9855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303352:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01d9855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303366:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.303373:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.303377:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01d9855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303384:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.303387:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01d9855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303394:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01d9855 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303406:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01d9855 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303414:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01d9855 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303429:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.303437:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.303439:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.303486:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.303492:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01d985c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303500:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d3:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.303504:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.303508:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01d985c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303518:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01d985c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303525:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01d985c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303533:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01d985c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303582:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.303589:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.303593:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01d985c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303599:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.303603:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01d985c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303623:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01d985c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303634:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01d985c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303641:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01d985c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303656:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.303657:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.303659:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.303707:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.303712:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9863 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303721:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d2:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.303725:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.303729:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303738:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303747:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303761:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303774:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.303780:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.303784:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303792:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.303795:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303802:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9863 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303813:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9863 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303821:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01d9863 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303836:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.303838:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.303840:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.303887:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.303898:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01d986a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303906:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d1:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.303909:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.303913:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01d986a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303922:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01d986a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303931:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01d986a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303938:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01d986a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303951:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.303957:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.303961:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01d986a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303968:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.303971:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01d986a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303979:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01d986a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.303996:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01d986a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304003:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01d986a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304015:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.304017:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.304019:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.304069:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.304075:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9871 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304082:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d0:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.304086:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.304091:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9871 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304100:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9871 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304109:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9871 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304117:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9871 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304142:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.304150:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.304154:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9871 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304161:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.304165:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9871 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304173:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9871 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304185:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9871 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304203:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01d9871 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304219:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.304221:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.304223:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.304267:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.304273:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01d9878 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304280:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cf:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.304289:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.304294:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01d9878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304303:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01d9878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304311:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01d9878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304319:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01d9878 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304331:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.304337:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.304341:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01d9878 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304348:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.304351:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01d9878 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304358:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01d9878 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304369:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01d9878 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304388:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01d9878 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304403:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.304405:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.304407:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.304448:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.304453:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01d987f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304460:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ce:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.304463:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.304467:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01d987f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304476:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01d987f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304484:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01d987f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304491:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01d987f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304520:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.304534:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.304538:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01d987f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304546:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.304582:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01d987f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304591:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01d987f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304603:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01d987f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304610:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01d987f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304626:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.304629:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.304633:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.304684:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.304690:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9886 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304699:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cd:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.304702:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.304706:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304726:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304735:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304743:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.304753:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.304759:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.304770:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.304774:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304780:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.304783:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304790:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9886 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304799:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9886 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304805:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01d9886 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304826:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.304828:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.304830:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.304882:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.304888:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d988d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304896:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cc:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.304899:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.304903:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d988d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304913:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d988d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304920:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d988d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304927:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d988d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.304951:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872572.304991:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.304996:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01d9894 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.305012:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cb:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.305015:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.305019:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01d9894 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.305027:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01d9894 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.305034:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01d9894 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.305041:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01d9894 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.305054:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788872572.305072:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788872572.305088:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d988d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872572.305099:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872572.305128:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.305134:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d988d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.305146:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d988d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.305170:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d988d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.305178:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01d988d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.305229:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872572.305233:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01d9894 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.305240:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.305254:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01d9894 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.305263:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01d9894 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.305273:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01d9894 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.305287:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01d9894 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.305304:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.305306:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.305307:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.305314:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.306205:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.309217:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082197e5b/0xe4e6e89fb01d989b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.309257:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ca:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.309263:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.309272:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082197e5b/0xe4e6e89fb01d989b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.309297:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082197e5b/0xe4e6e89fb01d989b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.309351:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082197e5b/0xe4e6e89fb01d989b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.309361:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082197e5b/0xe4e6e89fb01d989b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.309403:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872572.309620:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.309627:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537c5646/0xe4e6e89fb01d98a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.309636:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c9:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.309639:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.309644:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000537c5646/0xe4e6e89fb01d98a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.309654:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000537c5646/0xe4e6e89fb01d98a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.309664:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537c5646/0xe4e6e89fb01d98a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.309842:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872572.309859:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082197e5b/0xe4e6e89fb01d989b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.309876:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98e800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.309882:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082197e5b/0xe4e6e89fb01d989b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.309894:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082197e5b/0xe4e6e89fb01d989b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.309920:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082197e5b/0xe4e6e89fb01d989b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.309929:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082197e5b/0xe4e6e89fb01d989b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.309968:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.309994:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.309996:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.310100:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000537c5646/0xe4e6e89fb01d98a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310138:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872572.310221:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.310228:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f32a5a45/0xe4e6e89fb01d98a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310243:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c8:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.310247:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.310251:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f32a5a45/0xe4e6e89fb01d98a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310260:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f32a5a45/0xe4e6e89fb01d98a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310269:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f32a5a45/0xe4e6e89fb01d98a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310278:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f32a5a45/0xe4e6e89fb01d98a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310305:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788872572.310321:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872572.310327:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000537c5646/0xe4e6e89fb01d98a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310336:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98fc00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.310347:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000537c5646/0xe4e6e89fb01d98a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310356:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000537c5646/0xe4e6e89fb01d98a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310372:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000537c5646/0xe4e6e89fb01d98a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310378:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000537c5646/0xe4e6e89fb01d98a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310399:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.310402:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f32a5a45/0xe4e6e89fb01d98a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310408:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98f800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.310411:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f32a5a45/0xe4e6e89fb01d98a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310419:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f32a5a45/0xe4e6e89fb01d98a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310429:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f32a5a45/0xe4e6e89fb01d98a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310438:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f32a5a45/0xe4e6e89fb01d98a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310459:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.310461:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.310463:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.310514:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.310520:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd02cea2/0xe4e6e89fb01d98b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310528:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c7:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.310530:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.310534:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd02cea2/0xe4e6e89fb01d98b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310542:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd02cea2/0xe4e6e89fb01d98b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310578:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd02cea2/0xe4e6e89fb01d98b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310587:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd02cea2/0xe4e6e89fb01d98b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310609:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872572.310652:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.310657:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e77efac/0xe4e6e89fb01d98b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310732:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c6:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.310736:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.310739:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e77efac/0xe4e6e89fb01d98b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310749:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e77efac/0xe4e6e89fb01d98b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310756:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e77efac/0xe4e6e89fb01d98b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310763:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e77efac/0xe4e6e89fb01d98b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310774:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788872572.310890:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.310895:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047ee5c07/0xe4e6e89fb01d98be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310903:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c5:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.310906:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.310910:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047ee5c07/0xe4e6e89fb01d98be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310918:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047ee5c07/0xe4e6e89fb01d98be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310937:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047ee5c07/0xe4e6e89fb01d98be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310944:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047ee5c07/0xe4e6e89fb01d98be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310957:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788872572.310965:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788872572.310969:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd02cea2/0xe4e6e89fb01d98b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310975:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98e000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.310979:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd02cea2/0xe4e6e89fb01d98b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310986:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd02cea2/0xe4e6e89fb01d98b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.310997:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd02cea2/0xe4e6e89fb01d98b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311005:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd02cea2/0xe4e6e89fb01d98b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311020:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872572.311029:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e77efac/0xe4e6e89fb01d98b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311036:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98fe00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.311039:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e77efac/0xe4e6e89fb01d98b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311047:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e77efac/0xe4e6e89fb01d98b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311058:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e77efac/0xe4e6e89fb01d98b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311066:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e77efac/0xe4e6e89fb01d98b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311080:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.311083:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047ee5c07/0xe4e6e89fb01d98be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311091:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98e600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.311094:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047ee5c07/0xe4e6e89fb01d98be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311102:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047ee5c07/0xe4e6e89fb01d98be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311124:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047ee5c07/0xe4e6e89fb01d98be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311131:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047ee5c07/0xe4e6e89fb01d98be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311144:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.311147:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.311149:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.311211:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.311216:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b6a891b/0xe4e6e89fb01d98c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311225:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c4:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.311228:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.311232:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b6a891b/0xe4e6e89fb01d98c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311241:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b6a891b/0xe4e6e89fb01d98c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311248:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b6a891b/0xe4e6e89fb01d98c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311256:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b6a891b/0xe4e6e89fb01d98c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311282:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.311290:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.311293:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b6a891b/0xe4e6e89fb01d98c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311300:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98e200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.311304:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b6a891b/0xe4e6e89fb01d98c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311313:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b6a891b/0xe4e6e89fb01d98c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311325:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b6a891b/0xe4e6e89fb01d98c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311333:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b6a891b/0xe4e6e89fb01d98c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311348:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.311350:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.311352:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.311394:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.311398:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c5324eb/0xe4e6e89fb01d98cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311407:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c3:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.311415:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.311420:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c5324eb/0xe4e6e89fb01d98cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311431:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c5324eb/0xe4e6e89fb01d98cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311439:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c5324eb/0xe4e6e89fb01d98cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311447:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c5324eb/0xe4e6e89fb01d98cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311460:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872572.311468:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872572.311471:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c5324eb/0xe4e6e89fb01d98cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311479:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98fa00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872572.311482:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c5324eb/0xe4e6e89fb01d98cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311490:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c5324eb/0xe4e6e89fb01d98cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311503:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c5324eb/0xe4e6e89fb01d98cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311522:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c5324eb/0xe4e6e89fb01d98cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311536:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.311537:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.311539:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872572.311615:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872572.311620:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01d98d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311628:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c2:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788872572.311632:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872572.311636:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01d98d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311646:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01d98d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311655:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01d98d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872572.311663:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01d98d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.312137:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.312149:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872572.312840:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872572.312879:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872572.312894:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01d98d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.312914:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98f600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.312920:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01d98d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.312933:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01d98d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.312968:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01d98d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.312978:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01d98d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.313023:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.313026:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.313029:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.313500:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872572.313588:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.313598:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d98da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.313610:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e1:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.313615:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.313622:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d98da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.313637:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d98da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.313647:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d98da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.313656:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d98da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.313704:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872572.314210:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.314215:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d98e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314225:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e0:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.314228:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.314232:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d98e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314241:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d98e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314260:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d98e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314267:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d98e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314283:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788872572.314291:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872572.314295:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d98da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314301:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.314310:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d98da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314319:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d98da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314333:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d98da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314340:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d98da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314355:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872572.314358:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d98e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314364:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.314410:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d98e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314419:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d98e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314429:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d98e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314436:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d98e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.314650:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.314651:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.314653:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.314873:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872572.315172:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.315179:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d98e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.315189:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2df:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.315201:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.315206:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d98e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.315217:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d98e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.315226:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d98e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.315315:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d98e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.315412:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872572.315472:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.315477:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d98ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.315513:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2de:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.315516:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.315521:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d98ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.315530:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d98ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.315538:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d98ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.315546:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d98ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.318520:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788872572.318541:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d98e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.318608:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.318616:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d98e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.318631:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d98e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.318675:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d98e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.318685:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d98e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.318725:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872572.318729:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d98ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.318737:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.318740:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d98ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.318748:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d98ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.318759:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d98ef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.318773:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.318775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.318778:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.322735:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788872572.322751:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d98ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.322871:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872572.323174:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.323181:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d98f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323207:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dd:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.323212:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.323218:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d98f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323239:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d98f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323322:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d98f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323330:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d98f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323346:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872572.323354:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872572.323359:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d98f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323366:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.323370:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d98f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323378:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d98f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323394:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d98f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323402:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d98f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323420:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.323422:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.323424:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872572.323522:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.323527:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d98fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323535:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dc:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.323539:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.323543:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d98fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323572:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d98fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323580:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d98fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323586:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d98fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323600:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872572.323607:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872572.323611:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d98fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323629:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.323633:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d98fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323640:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d98fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323651:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d98fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323658:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d98fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323738:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.323739:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.323741:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872572.323786:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.323791:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9904 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323800:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2db:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.323802:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.323806:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323816:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323829:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788872572.323834:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788872572.323837:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9904 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323863:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872572.323912:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.323918:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d990b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.323926:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2da:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.323929:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.323934:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d990b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324068:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d990b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324080:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d990b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324087:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d990b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324115:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788872572.324127:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872572.324130:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9904 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324137:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.324140:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9904 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324148:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9904 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324163:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9904 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324170:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9904 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324182:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872572.324184:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d990b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324201:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.324205:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d990b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324227:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d990b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324240:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d990b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324316:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d990b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.324323:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.324334:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.324337:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.324343:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872572.324402:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.324408:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9912 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324416:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d9:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.324419:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.324423:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324431:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324438:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324738:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324759:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872572.324773:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872572.324778:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.324786:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.324789:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.324797:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9912 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872572.324802:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.324806:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9919 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.324808:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9912 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324815:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d8:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:2.0:1788872572.324816:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9912 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324818:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.324822:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.324830:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.324831:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.324832:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.324833:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.324839:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324846:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324864:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872572.324895:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872572.324899:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872572.324900:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.324904:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9102515/0xe4e6e89fb01d9920 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.324914:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.324915:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d7:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:2.0:1788872572.324917:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324918:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.324923:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9102515/0xe4e6e89fb01d9920 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.324924:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.324932:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9102515/0xe4e6e89fb01d9920 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.324935:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9919 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.324942:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9919 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.324961:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.324963:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.324965:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.325078:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9102515/0xe4e6e89fb01d9920 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325088:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9102515/0xe4e6e89fb01d9920 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325109:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872572.325167:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.325175:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9927 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325184:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d6:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.325188:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.325203:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325214:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872572.325216:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325221:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9102515/0xe4e6e89fb01d9920 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325231:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.325235:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9102515/0xe4e6e89fb01d9920 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325235:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325244:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9102515/0xe4e6e89fb01d9920 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325262:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9102515/0xe4e6e89fb01d9920 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325268:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9102515/0xe4e6e89fb01d9920 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325291:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.325295:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.325298:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.325314:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325337:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872572.325355:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872572.325360:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.325368:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872572.325371:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872572.325377:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872572.325378:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9927 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325382:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d992e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325389:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d5:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.325393:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.325397:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d992e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.325402:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9927 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325406:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d992e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.325410:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9927 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325414:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d992e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325422:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d992e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.325431:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872572.325435:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872572.325439:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.325511:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872572.325585:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.325590:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9935 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325599:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d4:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.325602:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.325606:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325616:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325625:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325632:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325647:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788872572.325760:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.325766:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01d993c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325773:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d3:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.325781:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.325786:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01d993c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325794:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01d993c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325802:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01d993c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325808:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01d993c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325810:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788872572.325815:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d992e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325821:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.325822:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788872572.325825:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d992e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325828:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872572.325832:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325833:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d992e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325839:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.325842:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325845:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d992e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325851:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325852:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d992e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325860:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9935 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325875:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872572.325875:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9935 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325878:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01d993c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325885:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.325886:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.325888:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01d993c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.325888:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.325889:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.325896:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01d993c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325905:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01d993c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325912:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01d993c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325923:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.325925:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872572.325925:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872572.325927:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.325930:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9943 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.325933:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872572.325938:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d2:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.325941:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.326076:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326086:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326095:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326102:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326116:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872572.326150:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.326160:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d994a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326168:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d1:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.326172:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.326176:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d994a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326184:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d994a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326205:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d994a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326212:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d994a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326229:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788872572.326328:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.326333:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01d9951 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326340:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d0:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.326344:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.326348:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01d9951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326357:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01d9951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326370:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01d9951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326377:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01d9951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326387:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788872572.326417:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.326422:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000455c80f6/0xe4e6e89fb01d9958 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326429:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cf:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.326432:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.326436:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000455c80f6/0xe4e6e89fb01d9958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326508:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000455c80f6/0xe4e6e89fb01d9958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326517:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000455c80f6/0xe4e6e89fb01d9958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326524:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000455c80f6/0xe4e6e89fb01d9958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326544:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788872572.326604:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.326609:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000744aef61/0xe4e6e89fb01d995f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326617:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ce:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.326620:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.326624:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000744aef61/0xe4e6e89fb01d995f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326633:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000744aef61/0xe4e6e89fb01d995f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326641:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000744aef61/0xe4e6e89fb01d995f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326648:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000744aef61/0xe4e6e89fb01d995f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326656:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788872572.326766:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.326770:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bbe5635/0xe4e6e89fb01d9966 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326777:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cd:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.326786:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.326791:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bbe5635/0xe4e6e89fb01d9966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326800:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bbe5635/0xe4e6e89fb01d9966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326808:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bbe5635/0xe4e6e89fb01d9966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326815:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bbe5635/0xe4e6e89fb01d9966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326823:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788872572.326856:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.326860:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d996d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326867:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cc:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.326869:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.326873:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d996d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326882:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d996d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326889:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d996d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326901:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d996d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.326911:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788872572.327057:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.327064:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d9974 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327073:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cb:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.327076:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.327081:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d9974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327090:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d9974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327098:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d9974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327105:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d9974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327114:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1788872572.327151:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.327156:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01d997b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327170:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ca:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.327173:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.327178:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01d997b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327188:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01d997b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327207:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01d997b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327215:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01d997b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327225:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1788872572.327332:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.327338:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01d9982 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327346:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c9:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.327349:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.327354:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01d9982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327363:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01d9982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327382:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01d9982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327389:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01d9982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327398:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1788872572.327430:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.327435:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d9989 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327442:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c8:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.327501:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.327505:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d9989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327516:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d9989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327524:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d9989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327532:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d9989 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327583:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:2.0:1788872572.327600:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1788872572.327607:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327615:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3a00 already unused, calling callback (ffffffffc0dc5220) 00002000:00010000:1.0:1788872572.327622:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872572.327626:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327627:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce028ae/0xe4e6e89fb01d9990 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327635:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9943 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327635:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c7:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.327638:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872572.327642:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ce028ae/0xe4e6e89fb01d9990 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327650:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ce028ae/0xe4e6e89fb01d9990 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327651:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9943 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327658:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce028ae/0xe4e6e89fb01d9990 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327659:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9943 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327740:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1788872572.327740:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ce028ae/0xe4e6e89fb01d9990 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327744:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d994a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327749:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:2.0:1788872572.327751:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.327754:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d994a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327762:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d994a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327772:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d994a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327780:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089519355/0xe4e6e89fb01d994a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872572.327789:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.327793:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01d9997 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327797:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1788872572.327801:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01d9951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327801:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c6:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:2.0:1788872572.327808:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.327808:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872572.327811:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01d9951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327812:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01d9997 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327819:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01d9951 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327822:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01d9997 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327829:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01d9951 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327830:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01d9997 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327837:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01d9951 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327838:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01d9997 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327847:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:2.0:1788872572.327848:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1788872572.327851:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000455c80f6/0xe4e6e89fb01d9958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327856:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.327859:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000455c80f6/0xe4e6e89fb01d9958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327876:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000455c80f6/0xe4e6e89fb01d9958 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872572.327878:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.327882:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d999e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327886:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000455c80f6/0xe4e6e89fb01d9958 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327889:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c5:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.327892:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872572.327894:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000455c80f6/0xe4e6e89fb01d9958 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327896:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d999e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327904:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d999e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327906:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788872572.327909:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000744aef61/0xe4e6e89fb01d995f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327912:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d999e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327916:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.327919:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000744aef61/0xe4e6e89fb01d995f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327927:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000744aef61/0xe4e6e89fb01d995f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327928:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d999e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327936:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000744aef61/0xe4e6e89fb01d995f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.327936:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:2.0:1788872572.327942:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000744aef61/0xe4e6e89fb01d995f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327964:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788872572.327967:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bbe5635/0xe4e6e89fb01d9966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327973:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.327977:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bbe5635/0xe4e6e89fb01d9966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327984:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bbe5635/0xe4e6e89fb01d9966 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.327994:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bbe5635/0xe4e6e89fb01d9966 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328000:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bbe5635/0xe4e6e89fb01d9966 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328011:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788872572.328014:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d996d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328021:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9da00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.328024:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d996d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328044:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d996d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328055:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d996d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328062:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d996d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328075:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788872572.328079:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d9974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328085:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.328088:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d9974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328096:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d9974 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872572.328096:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.328101:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01d99a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328106:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d9974 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328109:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c4:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.328112:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872572.328113:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4359b0c/0xe4e6e89fb01d9974 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328117:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01d99a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328125:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01d99a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328133:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01d99a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328137:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788872572.328141:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01d997b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328141:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01d99a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328148:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.328150:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1788872572.328152:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01d997b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328159:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01d997b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328169:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01d997b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328175:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01d997b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872572.328182:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872572.328186:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d99ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328209:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c3:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.328212:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872572.328215:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788872572.328217:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d99ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328219:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01d9982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328226:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.328226:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d99ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328229:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01d9982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328235:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d99ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328246:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01d9982 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328257:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01d9982 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328263:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01d9982 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328275:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788872572.328278:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d9989 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328284:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.328288:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d9989 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328295:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d9989 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328305:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d9989 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328312:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01d9989 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328316:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d99ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328325:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788872572.328332:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788872572.328335:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ce028ae/0xe4e6e89fb01d9990 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328342:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ce00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.328345:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce028ae/0xe4e6e89fb01d9990 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328352:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce028ae/0xe4e6e89fb01d9990 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872572.328361:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872572.328362:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ce028ae/0xe4e6e89fb01d9990 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328366:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022e680a1/0xe4e6e89fb01d99b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328369:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ce028ae/0xe4e6e89fb01d9990 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328373:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c2:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788872572.328376:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872572.328379:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788872572.328380:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022e680a1/0xe4e6e89fb01d99b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328382:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01d9997 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328388:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9de00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872572.328390:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022e680a1/0xe4e6e89fb01d99b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328392:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01d9997 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328409:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01d9997 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328409:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022e680a1/0xe4e6e89fb01d99b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328417:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022e680a1/0xe4e6e89fb01d99b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328420:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01d9997 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872572.328426:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788872572.328427:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01d9997 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.328438:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788872572.328441:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d999e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788872572.329101:0:8437:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00000100:00100000:1.0:1788872572.329320:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:85140:x1875765327621888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 60651us (63258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872572.329331:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5933 00000100:00100000:1.0:1788872572.329413:0:85140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85140:1875765327621888:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788872572.329435:0:85140:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2e1:0x0] from OST, last_created [0x2c0000401:0x2e1:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:1.0:1788872572.329617:0:85140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d16d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85140:1875765327622144:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788872572.329735:0:85140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788872572.329753:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788872572.329761:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01d99a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872572.329764:0:85140:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5d10f00 going to sleep for 11 seconds 00010000:00010000:3.0:1788872572.329772:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ca00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872572.329776:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01d99a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872572.329782:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327622016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788872572.329784:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01d99a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.329800:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01d99a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.329808:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01d99a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872572.329810:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788872572.329845:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872572.329849:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d99ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.329856:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d200 already unused, calling callback (ffffffffc0dc5220) 00000100:00100000:1.0:1788872572.329859:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327622144 00010000:00010000:3.0:1788872572.329862:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d99ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872572.329866:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327622144 00010000:00010000:3.0:1788872572.329869:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d99ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.329880:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d99ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.329887:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d99ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.329902:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872572.329907:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022e680a1/0xe4e6e89fb01d99b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872572.329907:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5934 00010000:00010000:3.0:1788872572.329913:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d000 already unused, calling callback (ffffffffc0dc5220) 00000100:00100000:1.0:1788872572.329916:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:85140:x1875765327622144:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1788872572.329917:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022e680a1/0xe4e6e89fb01d99b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.329937:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022e680a1/0xe4e6e89fb01d99b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.329951:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022e680a1/0xe4e6e89fb01d99b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872572.329958:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022e680a1/0xe4e6e89fb01d99b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788872572.329970:0:26191:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 738 00010000:00010000:3.0:1788872572.329974:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872572.329976:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872572.329982:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.330239:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872572.330243:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d999e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.330253:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d999e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.330266:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d999e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.330272:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000846fbd6d/0xe4e6e89fb01d999e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872572.330304:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.330307:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.330308:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.330343:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872572.330354:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788872572.331709:0:26188:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:0.0:1788872572.331865:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:85138:x1875765327621760:12345-0@lo:5:osp-pre-0-0.0 Request processed in 67905us (68038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872572.331880:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5932 00000100:00100000:0.0:1788872572.331973:0:85138:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85138:1875765327621760:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788872572.332003:0:85138:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2e1:0x0] from OST, last_created [0x280000401:0x2e1:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1788872572.332458:0:85138:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85138:1875765327622400:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788872572.332511:0:85138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872572.332594:0:85138:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5ea8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788872572.332994:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327622272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872572.333094:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.333174:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327622016 00000100:00100000:3.0:1788872572.333182:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327622016 00000100:00100000:3.0:1788872572.333242:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327622272 00000100:00100000:3.0:1788872572.333247:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327622272 00000100:00100000:3.0:1788872572.333276:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:3.0:1788872572.333285:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327622016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872572.333312:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872572.333367:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327622016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (3556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872572.333374:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:3.0:1788872572.333396:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:3.0:1788872572.333404:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327622272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788872572.333435:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872572.333485:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327622272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872572.333491:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:3.0:1788872572.333546:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327622272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872572.334644:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327622400 00000100:00100000:2.0:1788872572.334653:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327622400 00000100:00100000:2.0:1788872572.334711:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5935 00000100:00100000:2.0:1788872572.334720:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:85138:x1875765327622400:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788872572.334757:0:26182:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 738 00000100:00100000:1.0:1788872572.336046:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:85140:x1875765327622144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6126us (6382us total) trans 4294969449 rc 0/0 00000100:00100000:1.0:1788872572.336056:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5934 00000100:00100000:1.0:1788872572.336114:0:85140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d16d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85140:1875765327622144:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788872572.336129:0:85140:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2e1:0x0]-[0x2c0000401:0x301:0x0] 00000100:00100000:2.0:1788872572.336408:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:85138:x1875765327622400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1689us (3896us total) trans 4294969449 rc 0/0 00000100:00100000:2.0:1788872572.336415:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5935 00000100:00100000:2.0:1788872572.336463:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327622016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872572.339372:0:85138:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85138:1875765327622400:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788872572.339396:0:85138:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2e1:0x0]-[0x280000401:0x301:0x0] 00000100:00100000:3.0:1788872572.607911:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327622528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872572.608000:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872572.608069:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327622528 00000100:00100000:3.0:1788872572.608077:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327622528 00000100:00100000:3.0:1788872572.608124:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:3.0:1788872572.608133:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327622528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872572.608154:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872572.608211:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327622528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872572.608218:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:3.0:1788872572.608278:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327622528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872572.608497:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872572.608509:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327622656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872572.608544:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872572.608607:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327622656 00000100:00100000:2.0:1788872572.608610:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327622656 00000100:00100000:2.0:1788872572.608635:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:2.0:1788872572.608642:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327622656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872572.608653:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872572.608696:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327622656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872572.608702:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:2.0:1788872572.608752:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327622656:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1788872572.628620:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788872572.694976:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872572.695013:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872572.695042:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311130496 00000100:00100000:3.0:1788872572.695052:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311130496 00000100:00100000:3.0:1788872572.695102:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311130624 00000100:00100000:3.0:1788872572.695105:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311130624 00000100:00100000:3.0:1788872572.699854:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1051 00000100:00100000:3.0:1788872572.699884:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311130496:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872572.700001:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311130496:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 131us (5035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872572.704132:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1052 00000100:00100000:2.0:1788872572.704155:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311130624:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872572.704249:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311130624:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 103us (9234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872572.704258:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1052 00000100:00100000:3.0:1788872572.706335:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1051 00000100:00080000:3.0:1788872572.706386:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788872573.176768:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788872573.593042:0:85458:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788872573.593757:0:85458:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788872574.211991:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788872574.877428:0:85508:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788872574.877760:0:85508:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788872575.226708:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872576.248819:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872577.181286:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872577.182610:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311130752 00000100:00100000:3.0:1788872577.182623:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311130752 00000100:00100000:3.0:1788872577.182713:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1072 00000100:00100000:3.0:1788872577.182723:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:65298:x1875765311130752:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872577.182744:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872577.182770:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debe00/0xe4e6e89fb01d99ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae09 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872577.182840:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d99c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872577.182854:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d99c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872577.182867:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d99c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872577.182919:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872577.182923:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872577.182950:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d99c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872577.182974:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debe00/0xe4e6e89fb01d99ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae09 expref: 8 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872577.183013:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d99c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae09 expref: 7 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872577.183021:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd26bb00) 00010000:00010000:3.0:1788872577.183024:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872577.183027:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5dea400, rc 0) 00000100:00100000:3.0:1788872577.183094:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:65298:x1875765311130752:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 371us (1818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.183111:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1072 00000100:00080000:0.0:1788872577.183373:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872577.199581:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872577.205011:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311130880 00000100:00100000:2.0:1788872577.205030:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311130880 00000100:00100000:2.0:1788872577.205132:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1073 00000100:00100000:2.0:1788872577.205143:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:65298:x1875765311130880:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:2.0:1788872577.205191:0:66979:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:2.0:1788872577.205292:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:65298:x1875765311130880:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 149us (5746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872577.205303:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1073 00000100:00100000:1.0:1788872577.209813:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872577.209900:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872577.209921:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327622784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872577.209977:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872577.210044:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327622784 00000100:00100000:0.0:1788872577.210051:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327622784 00000100:00100000:0.0:1788872577.210122:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:0.0:1788872577.210133:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327622784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788872577.210168:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:3.0:1788872577.210308:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311131008 00000100:00100000:3.0:1788872577.210313:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311131008 00000100:00100000:3.0:1788872577.210362:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1074 00000100:00100000:1.0:1788872577.210372:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327622784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872577.210374:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:65298:x1875765311131008:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872577.210393:0:66192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:3.0:1788872577.210450:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:65298:x1875765311131008:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 80us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.210461:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1074 00000100:00100000:2.0:1788872577.210576:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327622912:0@lo:400:kworker.0 00000100:00100000:0.0:1788872577.210917:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327622784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 785us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872577.210925:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00080000:0.0:1788872577.210946:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872577.210970:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f09d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327623040:0@lo:400:kworker.0 00000100:00100000:0.0:1788872577.211003:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872577.211040:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327623552:0@lo:400:kworker.0 00000100:00100000:0.0:1788872577.211080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872577.211108:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327623296:0@lo:400:kworker.0 00000100:00100000:0.0:1788872577.211116:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327624064:0@lo:400:kworker.0 00000100:00100000:1.0:1788872577.211154:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872577.211160:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872577.211182:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327623808:0@lo:400:kworker.0 00000100:00100000:0.0:1788872577.211209:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327624064 00000100:00100000:1.0:1788872577.211213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872577.211216:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327624064 00000100:00100000:1.0:1788872577.211236:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327624320:0@lo:400:kworker.0 00000100:00100000:0.0:1788872577.211258:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327623808 00000100:00100000:0.0:1788872577.211262:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327623808 00000100:00100000:1.0:1788872577.211267:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872577.211293:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788872577.211294:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425 00000100:00100000:1.0:1788872577.211302:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f09d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327623168:0@lo:400:kworker.0 00000100:00100000:0.0:1788872577.211307:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327624064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872577.211333:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872577.211353:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327623680:0@lo:400:kworker.0 00000100:00100000:0.0:1788872577.211367:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327624064:12345-0@lo:400:kworker.0 Request processed in 62us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872577.211375:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425 00000100:00100000:1.0:1788872577.211382:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872577.211438:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872577.211467:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327623424:0@lo:400:kworker.0 00000100:00100000:2.0:1788872577.211490:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872577.211733:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327623552 00000100:00100000:3.0:1788872577.211737:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327623552 00000100:00100000:3.0:1788872577.211766:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:3.0:1788872577.211772:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327623552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872577.211844:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327624192:0@lo:400:kworker.0 00000100:00100000:0.0:1788872577.211905:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327623680 00000100:00100000:0.0:1788872577.211909:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327623680 00000100:00100000:0.0:1788872577.211937:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426 00000100:00100000:0.0:1788872577.211944:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327623808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872577.212025:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327623936:0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.219032:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327623552:12345-0@lo:400:kworker.0 Request processed in 7247us (7938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.219048:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00100000:3.0:1788872577.219133:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327623040 00000100:00100000:3.0:1788872577.219142:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327623040 00000100:00100000:3.0:1788872577.219186:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327623296 00000100:00100000:3.0:1788872577.219190:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327623296 00000100:00100000:3.0:1788872577.219203:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327624320 00000100:00100000:3.0:1788872577.219206:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327624320 00000100:00100000:3.0:1788872577.219215:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327623168 00000100:00100000:3.0:1788872577.219218:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327623168 00000100:00100000:3.0:1788872577.219230:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327623424 00000100:00100000:3.0:1788872577.219233:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327623424 00000100:00100000:3.0:1788872577.219249:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1788872577.219256:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327623040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.219309:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327623040:12345-0@lo:400:kworker.0 Request processed in 53us (8305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.219315:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1788872577.219327:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1788872577.219333:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327623296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.219362:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327623296:12345-0@lo:400:kworker.0 Request processed in 29us (8209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.219368:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1788872577.219379:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1788872577.219384:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327624320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.219410:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327624320:12345-0@lo:400:kworker.0 Request processed in 26us (8145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.219416:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1788872577.219426:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1788872577.219431:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327623168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.219456:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327623168:12345-0@lo:400:kworker.0 Request processed in 25us (8124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.219468:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1788872577.219479:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1788872577.219485:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327623424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.219517:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327623424:12345-0@lo:400:kworker.0 Request processed in 32us (8026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.219523:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1788872577.219618:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872577.219665:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327622912 00000100:00100000:3.0:1788872577.219668:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327622912 00000100:00100000:3.0:1788872577.219695:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788872577.219702:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c7796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327622912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.219733:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c7796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327622912:12345-0@lo:400:kworker.0 Request processed in 32us (8295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.219739:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788872577.219807:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311131136 00000100:00100000:3.0:1788872577.219811:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311131136 00000100:00100000:3.0:1788872577.219830:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:3.0:1788872577.219837:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327623680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.219868:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327623680:12345-0@lo:400:kworker.0 Request processed in 32us (8488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.219875:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:3.0:1788872577.219890:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5936 00000100:00100000:3.0:1788872577.219895:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2403:x1875765311131136:12345-192.168.204.39@tcp:8:lfs.0 00010000:00080000:3.0:1788872577.219922:0:26187:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp t0 exp 0000000000000000 cur 3514 last 0 00000020:00000080:3.0:1788872577.219950:0:26187:0:(genops.c:1406:class_connect()) connect: client 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3, cookie 0xe4e6e89fb01d99c8 00002000:00100000:3.0:1788872577.219968:0:26187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3/ffff98a9ef255000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788872577.219986:0:26187:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788872577.220065:0:26187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788872577.220094:0:26187:0:(import.c:65:import_set_state_nolock()) ffff98a9ef256800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872577.220164:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311131136:12345-192.168.204.39@tcp:8:lfs.0 Request processed in 267us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.220172:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5936 00000100:00080000:3.0:1788872577.220204:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872577.220210:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872577.220213:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872577.220217:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872577.220255:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f09d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327623040:0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.220268:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327623552:0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.220281:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327624064:0@lo:400:kworker.0 00000100:00100000:1.0:1788872577.223927:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872577.224018:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327623296:0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.224033:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327624192 00000100:00100000:1.0:1788872577.224039:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327624320:0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.224042:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327624192 00000100:00100000:1.0:1788872577.224077:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f09d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327623168:0@lo:400:kworker.0 00000100:00100000:1.0:1788872577.224093:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327623680:0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.224130:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:3.0:1788872577.224142:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327624192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.224214:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327624192:12345-0@lo:400:kworker.0 Request processed in 74us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.224222:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00000100:00080000:3.0:1788872577.224243:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872577.224388:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327624192:0@lo:400:kworker.0 00000100:00100000:0.0:1788872577.225793:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327623808:12345-0@lo:400:kworker.0 Request processed in 13842us (14574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872577.225805:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426 00000100:00100000:1.0:1788872577.228760:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327623808:0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.234837:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872577.235603:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311131264 00000100:00100000:0.0:1788872577.235614:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311131264 00000100:00100000:0.0:1788872577.235700:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1953 00000100:00100000:0.0:1788872577.235711:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:65298:x1875765311131264:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:0.0:1788872577.235737:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872577.235807:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:65298:x1875765311131264:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 98us (981us total) trans 0 rc 0/0 00000100:00080000:3.0:1788872577.236038:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872577.236085:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1953 00000100:00100000:2.0:1788872577.236352:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872577.236414:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327623936 00000100:00100000:3.0:1788872577.236419:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327623936 00000100:00100000:2.0:1788872577.236422:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327622912:0@lo:400:kworker.0 00000100:00100000:2.0:1788872577.236444:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327623424:0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.236465:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1788872577.236484:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327623936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.236571:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327623936:12345-0@lo:400:kworker.0 Request processed in 99us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.236578:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1788872577.237826:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327623936:0@lo:400:kworker.0 00000100:00100000:3.0:1788872577.244503:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872577.245856:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311131392 00000100:00100000:0.0:1788872577.245870:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311131392 00000100:00100000:0.0:1788872577.245995:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5937 00000100:00100000:0.0:1788872577.246004:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1875765311131392:12345-192.168.204.39@tcp:8:lfs.0 00010000:00080000:0.0:1788872577.246043:0:9961:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp t0 exp 0000000000000000 cur 3514 last 0 00000020:00000080:0.0:1788872577.246074:0:9961:0:(genops.c:1406:class_connect()) connect: client 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3, cookie 0xe4e6e89fb01d99cf 00002000:00100000:0.0:1788872577.246087:0:9961:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3/ffff98a9ef0ab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788872577.246116:0:9961:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788872577.246185:0:9961:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788872577.246219:0:9961:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0ad000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872577.246307:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311131392:12345-192.168.204.39@tcp:8:lfs.0 Request processed in 302us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872577.246314:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5937 00000100:00100000:0.0:1788872577.262971:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872577.264628:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311131520 00000100:00100000:2.0:1788872577.264642:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311131520 00000100:00100000:2.0:1788872577.264728:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1954 00000100:00100000:2.0:1788872577.264738:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:65298:x1875765311131520:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:2.0:1788872577.264764:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872577.264845:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:65298:x1875765311131520:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 107us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872577.264853:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1954 00000100:00080000:3.0:1788872577.266146:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788872577.276020:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872577.721349:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872577.721378:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327624448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872577.721463:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872577.721516:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327624576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872577.721571:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872577.721619:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327624448 00000100:00100000:0.0:1788872577.721627:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327624448 00000100:00100000:0.0:1788872577.721683:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:0.0:1788872577.721694:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327624448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872577.721722:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872577.721774:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327624448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872577.721791:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000100:00100000:0.0:1788872577.721819:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327624576 00000100:00100000:0.0:1788872577.721824:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327624576 00000100:00100000:0.0:1788872577.721855:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:0.0:1788872577.721862:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327624576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872577.721882:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:0.0:1788872577.721927:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327624576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872577.721933:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000100:00100000:1.0:1788872577.721960:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327624832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872577.721998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872577.722024:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872577.722031:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327624704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872577.722053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872577.722076:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327624832 00000100:00100000:1.0:1788872577.722080:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327624832 00000100:00100000:1.0:1788872577.722117:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327624704 00000100:00100000:1.0:1788872577.722121:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327624704 00000100:00100000:1.0:1788872577.722139:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:1.0:1788872577.722146:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327624832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872577.722157:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872577.722185:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327624832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872577.722192:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:1.0:1788872577.722204:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:1.0:1788872577.722210:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327624704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872577.722227:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872577.722255:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327624704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872577.722261:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00100000:1.0:1788872577.722294:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327624704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872577.722307:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327624832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872577.723230:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327624960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872577.723368:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327624576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872577.723403:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327624448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872577.724028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872577.724719:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327624960 00000100:00100000:0.0:1788872577.724726:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327624960 00000100:00100000:0.0:1788872577.724770:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:0.0:1788872577.724779:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327624960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872577.724800:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872577.724865:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327624960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872577.724872:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1788872577.725433:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327624960:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1788872577.726849:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00080000:1.0:1788872577.726864:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969449 is committed 00000001:00100000:3.0:1788872577.729310:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00080000:3.0:1788872577.729326:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969449 is committed 00000100:00100000:1.0:1788872577.814353:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872577.814451:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311131648 00000100:00100000:3.0:1788872577.814461:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311131648 00000100:00100000:3.0:1788872577.814532:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1059 00000100:00100000:3.0:1788872577.814543:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311131648:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872577.815244:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311131648:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 699us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.815254:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1059 00000100:00100000:1.0:1788872577.819302:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872577.819352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872577.819440:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311131776 00000100:00100000:3.0:1788872577.819452:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311131776 00000100:00100000:3.0:1788872577.819524:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1060 00000100:00100000:3.0:1788872577.819535:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311131776:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872577.819667:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311131776:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 133us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872577.819691:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1060 00000100:00100000:2.0:1788872577.820475:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311132032 00000100:00100000:2.0:1788872577.820483:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311132032 00000100:00100000:2.0:1788872577.820533:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2429 00000100:00100000:2.0:1788872577.820542:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311132032:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872577.821050:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311132032:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 507us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872577.821058:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2429 00000100:00100000:3.0:1788872577.827289:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872577.828000:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311131904 00000100:00100000:0.0:1788872577.828013:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311131904 00000100:00100000:0.0:1788872577.828208:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2430 00000100:00100000:0.0:1788872577.828221:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311131904:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872577.828293:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311131904:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 73us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872577.828317:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2430 00000100:00100000:1.0:1788872578.252296:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872578.253228:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311132160 00000100:00100000:2.0:1788872578.253242:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311132160 00000100:00100000:2.0:1788872578.253307:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:2.0:1788872578.253315:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c7795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2403:x1875765311132160:12345-192.168.204.39@tcp:250:kworker.0 00010000:00080000:2.0:1788872578.253348:0:85125:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 8a09bb38-f574-4ce9-b65f-ec6facc58f7e@192.168.204.39@tcp t0 exp 0000000000000000 cur 3515 last 0 00000020:00000080:2.0:1788872578.253379:0:85125:0:(genops.c:1406:class_connect()) connect: client 8a09bb38-f574-4ce9-b65f-ec6facc58f7e, cookie 0xe4e6e89fb01d99d6 00000100:00080000:2.0:1788872578.253539:0:85125:0:(import.c:65:import_set_state_nolock()) ffff98a8c5115800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872578.253810:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c7795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+5:2403:x1875765311132160:12345-192.168.204.39@tcp:250:kworker.0 Request processed in 493us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872578.253838:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 62 00010000:00010000:3.0:1788872578.296739:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872579.325051:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872579.468761:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872579.468913:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311132288 00000100:00100000:2.0:1788872579.468923:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311132288 00000100:00100000:2.0:1788872579.468981:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:2.0:1788872579.468991:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c7795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+5:42482:x1875765311132288:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872579.469008:0:85130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872579.469028:0:85130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9f5441400/0xe4e6e89fb01d99dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae10 expref: -99 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872579.469069:0:85130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9f5441400/0xe4e6e89fb01d99dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae10 expref: 6 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872579.469081:0:85130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9f5441400/0xe4e6e89fb01d99dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae10 expref: 6 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872579.469090:0:85130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5441400, rc 0) 00000100:00100000:2.0:1788872579.469161:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c7795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311132288:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 171us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872579.469168:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:1.0:1788872579.473695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872579.475364:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311132416 00000100:00100000:0.0:1788872579.475378:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311132416 00000100:00100000:0.0:1788872579.475449:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 64 00000100:00100000:0.0:1788872579.475460:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311132416:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788872579.475487:0:85128:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788872579.475509:0:85128:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788872579.475513:0:85128:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788872579.475517:0:85128:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788872579.475520:0:85128:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788872579.475523:0:85128:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 107 00000100:00100000:1.0:1788872579.482225:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311132416:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 Request processed in 6753us (8525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872579.482244:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 64 00000100:00100000:1.0:1788872579.490272:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872579.490664:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311132544 00000100:00100000:3.0:1788872579.490675:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311132544 00000100:00100000:3.0:1788872579.490727:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 65 00000100:00100000:3.0:1788872579.490737:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311132544:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872579.490755:0:85123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872579.490775:0:85123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5debc00/0xe4e6e89fb01d99e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae17 expref: -99 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872579.490805:0:85123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5debc00/0xe4e6e89fb01d99e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae17 expref: 7 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872579.490817:0:85123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5debc00/0xe4e6e89fb01d99e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae17 expref: 7 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872579.490827:0:85123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5debc00, rc 0) 00000100:00100000:3.0:1788872579.491727:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+7:42482:x1875765311132544:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 986us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872579.491737:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 65 00000100:00100000:0.0:1788872579.522094:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872579.523066:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311132672 00000100:00100000:2.0:1788872579.523081:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311132672 00000100:00100000:2.0:1788872579.523139:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 66 00000100:00100000:2.0:1788872579.523149:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+7:42482:x1875765311132672:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872579.523332:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311132672:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 184us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872579.523350:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 66 00000100:00100000:0.0:1788872579.533219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872579.533271:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311132800 00000100:00100000:0.0:1788872579.533282:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311132800 00000100:00100000:0.0:1788872579.533337:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 67 00000100:00100000:0.0:1788872579.533347:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311132800:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872579.533514:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311132800:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 168us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872579.533522:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 67 00000100:00100000:3.0:1788872579.547098:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872579.547135:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311132928 00000100:00100000:3.0:1788872579.547145:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311132928 00000100:00100000:3.0:1788872579.547195:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 68 00000100:00100000:3.0:1788872579.547206:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311132928:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872579.547224:0:85123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872579.547248:0:85123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5debe00/0xe4e6e89fb01d99eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae1e expref: -99 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872579.547278:0:85123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5debe00/0xe4e6e89fb01d99eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae1e expref: 9 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872579.547290:0:85123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5debe00/0xe4e6e89fb01d99eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae1e expref: 9 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872579.547300:0:85123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5debe00, rc 0) 00000100:00100000:3.0:1788872579.547362:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311132928:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 158us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872579.547369:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 68 00000100:00100000:3.0:1788872579.558439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872579.558475:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311133056 00000100:00100000:3.0:1788872579.558484:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311133056 00000100:00100000:3.0:1788872579.558533:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 69 00000100:00100000:3.0:1788872579.558542:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311133056:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872579.558737:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311133056:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 194us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872579.558745:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 69 00000100:00100000:3.0:1788872579.566271:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872579.566311:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311133184 00000100:00100000:3.0:1788872579.566321:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311133184 00000100:00100000:3.0:1788872579.566371:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 70 00000100:00100000:3.0:1788872579.566382:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311133184:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872579.566544:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311133184:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 162us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872579.566577:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 70 00000100:00100000:3.0:1788872579.589394:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872579.591123:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311133312 00000100:00100000:3.0:1788872579.591138:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311133312 00000100:00100000:3.0:1788872579.591193:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 71 00000100:00100000:3.0:1788872579.591204:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311133312:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872579.591221:0:85126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872579.591240:0:85126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5dea800/0xe4e6e89fb01d99f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae25 expref: -99 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872579.591271:0:85126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5dea800/0xe4e6e89fb01d99f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae25 expref: 10 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872579.591282:0:85126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5dea800/0xe4e6e89fb01d99f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae25 expref: 10 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872579.591292:0:85126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5dea800, rc 0) 00000100:00100000:3.0:1788872579.591355:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:42482:x1875765311133312:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 153us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872579.591362:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 71 00000100:00100000:3.0:1788872579.593725:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872579.598092:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311133440 00000100:00100000:3.0:1788872579.598112:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311133440 00000100:00100000:3.0:1788872579.598185:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 72 00000100:00100000:3.0:1788872579.598196:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:42482:x1875765311133440:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872579.598330:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:42482:x1875765311133440:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 135us (4613us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788872579.598344:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 72 00010000:00010000:2.0:1788872580.345943:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872581.380934:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872582.328971:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872582.328999:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f09f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327625088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872582.329084:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872582.330241:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327625088 00000100:00100000:1.0:1788872582.330252:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327625088 00000100:00100000:1.0:1788872582.330320:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:1.0:1788872582.330331:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327625088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872582.330370:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872582.330591:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327625088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 261us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872582.330599:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:00100000:3.0:1788872582.330704:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f09f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327625088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872582.331051:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327625600:0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.331097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872582.331113:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327625216:0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.331127:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327626112:0@lo:400:kworker.0 00000100:00100000:3.0:1788872582.331143:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872582.331160:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872582.331171:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327625728:0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.331175:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327626624:0@lo:400:kworker.0 00000100:00100000:3.0:1788872582.331190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872582.331200:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327626112 00000100:00100000:2.0:1788872582.331203:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327626112 00000100:00100000:3.0:1788872582.331209:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327626240:0@lo:400:kworker.0 00000100:00100000:3.0:1788872582.331230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872582.331240:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431 00000100:00100000:3.0:1788872582.331247:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788872582.331247:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327626112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872582.331252:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327625344:0@lo:400:kworker.0 00000100:00100000:3.0:1788872582.331271:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872582.331277:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327626112:12345-0@lo:400:kworker.0 Request processed in 32us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872582.331284:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431 00000100:00100000:3.0:1788872582.331285:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327625856:0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.331304:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327625472:0@lo:400:kworker.0 00000100:00100000:3.0:1788872582.331305:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872582.331322:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327626368:0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.331324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872582.331339:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327625984:0@lo:400:kworker.0 00000100:00100000:3.0:1788872582.331341:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872582.331356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872582.331364:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327625216 00000100:00100000:3.0:1788872582.331368:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327625216 00000100:00100000:2.0:1788872582.331368:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327626496:0@lo:400:kworker.0 00000100:00100000:3.0:1788872582.331396:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788872582.331399:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872582.331402:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c69c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327625216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.331448:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327625600 00000100:00100000:2.0:1788872582.331452:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327625600 00000100:00100000:2.0:1788872582.331479:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327625728 00000100:00100000:2.0:1788872582.331482:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327625728 00000100:00100000:1.0:1788872582.331487:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327626240 00000100:00100000:2.0:1788872582.331494:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327625344 00000100:00100000:1.0:1788872582.331502:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327626240 00000100:00100000:2.0:1788872582.331504:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327625344 00000100:00100000:2.0:1788872582.331517:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327625472 00000100:00100000:2.0:1788872582.331520:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327625472 00000100:00100000:1.0:1788872582.331520:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1788872582.331526:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327625600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.331531:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1788872582.331535:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327625728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872582.331580:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327625600:12345-0@lo:400:kworker.0 Request processed in 55us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872582.331587:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1788872582.331600:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1788872582.331606:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327626240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872582.331748:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1788872582.331757:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327625344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872582.332066:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c69c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327625216:12345-0@lo:400:kworker.0 Request processed in 662us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872582.332081:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788872582.332120:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1788872582.332126:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327625472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872582.332165:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327625472:12345-0@lo:400:kworker.0 Request processed in 39us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872582.332171:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1788872582.332194:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327625856 00000100:00100000:3.0:1788872582.332198:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327625856 00000100:00100000:3.0:1788872582.332227:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:3.0:1788872582.332233:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327625856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.339324:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327625728:12345-0@lo:400:kworker.0 Request processed in 7777us (8122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872582.339341:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1788872582.344774:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327625472:0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.344869:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327626368 00000100:00100000:2.0:1788872582.344876:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327626368 00000100:00100000:2.0:1788872582.344938:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327625984 00000100:00100000:2.0:1788872582.344942:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327625984 00000100:00100000:2.0:1788872582.344960:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327626496 00000100:00100000:2.0:1788872582.344963:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327626496 00000100:00100000:2.0:1788872582.344985:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432 00000100:00100000:2.0:1788872582.344994:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327626368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.345092:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327626368:12345-0@lo:400:kworker.0 Request processed in 99us (13749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872582.345100:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432 00000100:00100000:2.0:1788872582.345119:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:2.0:1788872582.345125:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327625984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.345158:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327625984:12345-0@lo:400:kworker.0 Request processed in 33us (13801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872582.345163:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00100000:2.0:1788872582.345174:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:2.0:1788872582.345180:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327626496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.345224:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327626496:12345-0@lo:400:kworker.0 Request processed in 44us (13823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872582.345229:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000100:00100000:2.0:1788872582.345264:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327625984:0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.345275:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:2.0:1788872582.345288:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327626496:0@lo:400:kworker.0 00000100:00100000:1.0:1788872582.345573:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327626240:12345-0@lo:400:kworker.0 Request processed in 13964us (14339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872582.345583:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00080000:1.0:1788872582.345610:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872582.345614:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872582.345617:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872582.345620:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872582.345636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872582.345679:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327625600:0@lo:400:kworker.0 00000100:00100000:1.0:1788872582.345693:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327626112:0@lo:400:kworker.0 00000100:00100000:1.0:1788872582.345718:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327626624 00000100:00100000:1.0:1788872582.345721:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327626624 00000100:00100000:1.0:1788872582.345747:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1788872582.345754:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327626624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872582.345791:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327626624:12345-0@lo:400:kworker.0 Request processed in 38us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872582.345798:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1788872582.345820:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327626624:0@lo:400:kworker.0 00000100:00100000:0.0:1788872582.355692:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327625344:12345-0@lo:400:kworker.0 Request processed in 23924us (24407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872582.355708:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1788872582.358958:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327625856:12345-0@lo:400:kworker.0 Request processed in 26710us (27637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872582.358974:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000100:00100000:2.0:1788872582.364300:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327625344:0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.364321:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327625856:0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.364333:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:2.0:1788872582.364350:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327626368:0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.364360:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327625216:0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.364371:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327625728:0@lo:400:kworker.0 00000100:00100000:2.0:1788872582.364393:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327626240:0@lo:400:kworker.0 00010000:00010000:3.0:1788872582.395699:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872582.840859:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872582.840893:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327626752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872582.841019:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872582.843321:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327626752 00000100:00100000:2.0:1788872582.843349:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327626752 00000100:00100000:2.0:1788872582.843473:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:2.0:1788872582.843487:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327626752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872582.843591:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872582.843750:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327626752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 265us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872582.843758:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:2.0:1788872582.845835:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327627008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872582.845962:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872582.846065:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327627008 00000100:00100000:2.0:1788872582.846075:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327627008 00000100:00100000:0.0:1788872582.848030:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872582.848074:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327626880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872582.848170:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872582.848274:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327626880 00000100:00100000:0.0:1788872582.848285:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327626880 00000100:00100000:3.0:1788872582.858361:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327626752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872582.858506:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f09f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327627136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872582.858592:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872582.860892:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327627264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872582.874130:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:2.0:1788872582.874158:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327627008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872582.874203:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:2.0:1788872582.874300:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327627008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (28338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872582.874308:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000100:00100000:1.0:1788872582.874517:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327627008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872582.880186:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872582.880307:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327627136 00000100:00100000:0.0:1788872582.880319:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327627136 00000100:00100000:0.0:1788872582.880398:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:0.0:1788872582.880409:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327626880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872582.880448:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872582.880582:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327626880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 175us (32411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872582.880590:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00100000:0.0:1788872582.880609:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:0.0:1788872582.880616:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327627136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872582.880626:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872582.880662:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327627136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (22070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872582.880667:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00100000:0.0:1788872582.880741:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f09f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327627136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872582.900756:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327626880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872582.900901:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327627264 00000100:00100000:0.0:1788872582.900910:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327627264 00000100:00100000:0.0:1788872582.900989:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962 00000100:00100000:0.0:1788872582.901010:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327627264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872582.901036:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872582.901141:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327627264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (20963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872582.901166:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962 00000100:00100000:3.0:1788872582.901429:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327627264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788872583.417286:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872583.440130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872583.440201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872583.440362:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311133568 00000100:00100000:0.0:1788872583.440375:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311133568 00000100:00100000:0.0:1788872583.440431:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 74 00000100:00100000:0.0:1788872583.440441:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2407:x1875765311133568:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872583.440518:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2407:x1875765311133568:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 78us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872583.440527:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 74 00000100:00100000:2.0:1788872583.440656:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311133824 00000100:00100000:2.0:1788872583.440660:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311133824 00000100:00100000:2.0:1788872583.440714:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1067 00000100:00100000:2.0:1788872583.440722:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311133824:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872583.440753:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311133824:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 32us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872583.440760:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1067 00000100:00080000:0.0:1788872583.440829:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872583.444741:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872583.444892:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872583.444939:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872583.444998:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311133696 00000100:00100000:0.0:1788872583.445008:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311133696 00000100:00100000:0.0:1788872583.445086:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1068 00000100:00100000:0.0:1788872583.445097:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2407:x1875765311133696:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872583.445178:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2407:x1875765311133696:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 81us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872583.445186:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1068 00000100:00080000:2.0:1788872583.445369:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788872583.447636:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311134080 00000100:00100000:1.0:1788872583.447652:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311134080 00000100:00100000:1.0:1788872583.447730:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311133952 00000100:00100000:1.0:1788872583.447733:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311133952 00000100:00100000:1.0:1788872583.447761:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2435 00000100:00080000:0.0:1788872583.447858:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872583.447863:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872583.447975:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311134080:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872583.448080:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311134080:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 177us (3350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872583.448088:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2435 00000100:00100000:1.0:1788872583.449357:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2436 00000100:00100000:1.0:1788872583.449377:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311133952:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872583.449450:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311133952:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 81us (4509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872583.449458:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2436 00010000:00010000:3.0:1788872584.440872:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788872584.863771:0:85701:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1788872585.466533:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872586.489041:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872587.452306:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327627776:0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.452378:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872587.452413:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327628288:0@lo:400:kworker.0 00000100:00100000:0.0:1788872587.452422:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327627648:0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.452440:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872587.452449:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872587.452457:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327628800:0@lo:400:kworker.0 00000100:00100000:0.0:1788872587.452491:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327628160:0@lo:400:kworker.0 00000100:00100000:2.0:1788872587.453474:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327627392:0@lo:400:kworker.0 00000100:00100000:1.0:1788872587.454740:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327627520:0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.462008:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872587.462021:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327627776 00000100:00100000:0.0:1788872587.462043:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327627776 00000100:00100000:0.0:1788872587.462106:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327627648 00000100:00100000:0.0:1788872587.462110:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327627648 00000100:00100000:3.0:1788872587.462120:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1788872587.462134:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327627776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872587.462137:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:0.0:1788872587.462159:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327627648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.467499:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327627776:12345-0@lo:400:kworker.0 Request processed in 5356us (15107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872587.467519:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1788872587.467649:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327627776:0@lo:400:kworker.0 00000100:00080000:3.0:1788872587.468725:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872587.468736:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872587.468773:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327628288 00000100:00100000:3.0:1788872587.468783:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327628288 00000100:00100000:3.0:1788872587.468881:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327628800 00000100:00100000:3.0:1788872587.468886:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327628800 00000100:00100000:3.0:1788872587.468949:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437 00000100:00100000:3.0:1788872587.468960:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327628288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.469076:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327628288:12345-0@lo:400:kworker.0 Request processed in 119us (16634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872587.469082:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437 00000100:00100000:3.0:1788872587.469110:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438 00000100:00100000:3.0:1788872587.469117:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327628800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.469149:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327628800:12345-0@lo:400:kworker.0 Request processed in 32us (7152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872587.469154:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438 00000100:00080000:3.0:1788872587.469176:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872587.469209:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327628288:0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.469224:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327628800:0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.469271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872587.469333:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327628672:0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.469372:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872587.469764:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327627648:0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.469790:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327628160 00000100:00100000:3.0:1788872587.469794:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327628160 00000100:00100000:3.0:1788872587.469831:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327628672 00000100:00100000:3.0:1788872587.469835:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327628672 00000100:00100000:3.0:1788872587.469856:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439 00000100:00100000:3.0:1788872587.469862:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327628160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.469904:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327628160:12345-0@lo:400:kworker.0 Request processed in 42us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872587.469934:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439 00000100:00100000:3.0:1788872587.469952:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440 00000100:00100000:3.0:1788872587.469958:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327628672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.469988:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327628672:12345-0@lo:400:kworker.0 Request processed in 30us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872587.469992:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440 00000100:00080000:3.0:1788872587.470202:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872587.470222:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327628160:0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.470232:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327628672:0@lo:400:kworker.0 00000100:00100000:0.0:1788872587.474489:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327627648:12345-0@lo:400:kworker.0 Request processed in 12315us (22023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872587.474510:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1788872587.474684:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872587.476545:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327627904:0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.476599:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327627392 00000100:00100000:3.0:1788872587.476609:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327627392 00000100:00100000:2.0:1788872587.476666:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872587.476678:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788872587.476687:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327627392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.476740:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327627392:12345-0@lo:400:kworker.0 Request processed in 53us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872587.476747:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788872587.476804:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327627904 00000100:00100000:2.0:1788872587.476915:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327627904 00000100:00100000:2.0:1788872587.476972:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1788872587.476979:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327627904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872587.477028:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327627904:12345-0@lo:400:kworker.0 Request processed in 50us (362us total) trans 0 rc 0/0 00000100:00080000:3.0:1788872587.477080:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872587.477101:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1788872587.477144:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327627904:0@lo:400:kworker.0 00000100:00100000:2.0:1788872587.477152:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327628416:0@lo:400:kworker.0 00000100:00100000:2.0:1788872587.477175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872587.477201:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327628928:0@lo:400:kworker.0 00000100:00100000:2.0:1788872587.477223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872587.477225:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327628416 00000100:00100000:3.0:1788872587.477229:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327628416 00000100:00100000:3.0:1788872587.477250:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327628928 00000100:00100000:3.0:1788872587.477253:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327628928 00000100:00100000:3.0:1788872587.477267:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1788872587.477267:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327627392:0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.477272:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327628416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.477308:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327628416:12345-0@lo:400:kworker.0 Request processed in 34us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872587.477314:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:3.0:1788872587.477338:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1788872587.477344:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327628928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.477375:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327628928:12345-0@lo:400:kworker.0 Request processed in 30us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872587.477381:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1788872587.477381:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327628416:0@lo:400:kworker.0 00000100:00100000:2.0:1788872587.477389:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327628928:0@lo:400:kworker.0 00000100:00100000:1.0:1788872587.482413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872587.482526:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327628032:0@lo:400:kworker.0 00000100:00100000:1.0:1788872587.482603:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872587.482633:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327628544:0@lo:400:kworker.0 00000100:00100000:1.0:1788872587.482659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872587.482784:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327628032 00000100:00100000:3.0:1788872587.482794:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327628032 00000100:00100000:3.0:1788872587.482852:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327628544 00000100:00100000:3.0:1788872587.482855:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327628544 00000100:00100000:3.0:1788872587.482880:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:3.0:1788872587.482889:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327628032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.482967:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327628032:12345-0@lo:400:kworker.0 Request processed in 79us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872587.482975:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:3.0:1788872587.483000:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:3.0:1788872587.483006:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327628544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872587.483030:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327628544:12345-0@lo:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872587.483035:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00100000:1.0:1788872587.483823:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327628544:0@lo:400:kworker.0 00000100:00100000:1.0:1788872587.483918:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327629056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872587.483953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872587.483981:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327629056 00000100:00100000:1.0:1788872587.483985:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327629056 00000100:00100000:1.0:1788872587.484013:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00100000:1.0:1788872587.484019:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327629056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872587.484112:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872587.484144:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327629056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872587.484151:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000100:00100000:1.0:1788872587.484179:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327629056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872587.484206:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327628032:0@lo:400:kworker.0 00000100:00100000:0.0:1788872587.488152:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327627520 00000100:00100000:0.0:1788872587.488166:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327627520 00000100:00100000:0.0:1788872587.488240:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1788872587.488250:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327627520:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788872587.488321:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872587.489981:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327627520:12345-0@lo:400:kworker.0 Request processed in 1724us (7566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872587.489995:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1788872587.490155:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327627520:0@lo:400:kworker.0 00010000:00010000:2.0:1788872587.513790:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788872587.666379:0:85750:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:3.0:1788872587.961164:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327629184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872587.961794:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327629440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872587.961859:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872587.961912:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872587.961919:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327629312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872587.961943:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872587.961979:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327629440 00000100:00100000:2.0:1788872587.961988:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327629440 00000100:00100000:2.0:1788872587.962037:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327629312 00000100:00100000:2.0:1788872587.962040:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327629312 00000100:00100000:2.0:1788872587.962062:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:2.0:1788872587.962071:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327629440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872587.962105:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872587.962170:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327629440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872587.962193:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00100000:2.0:1788872587.962214:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:2.0:1788872587.962229:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327629312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872587.962239:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872587.962262:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327629312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872587.962269:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:2.0:1788872587.962319:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327629312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872587.962331:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327629440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872587.962965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872587.964209:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327629184 00000100:00100000:2.0:1788872587.964221:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327629184 00000100:00100000:2.0:1788872587.964266:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965 00000100:00100000:2.0:1788872587.964665:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327629184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872587.964701:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872587.964781:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327629184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 507us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872587.964789:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965 00000100:00100000:2.0:1788872587.964860:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327629184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872587.966213:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327629568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872587.966355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872587.966475:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327629568 00000100:00100000:2.0:1788872587.966481:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327629568 00000100:00100000:2.0:1788872587.966529:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1788872587.966570:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327629568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872587.966606:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:2.0:1788872587.966665:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327629568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872587.966673:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1788872587.966724:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327629568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872587.967725:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327629696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872587.967777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872587.967823:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327629696 00000100:00100000:1.0:1788872587.968049:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327629696 00000100:00100000:1.0:1788872587.968094:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:1.0:1788872587.968119:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327629696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872587.968138:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872587.968185:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327629696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872587.968192:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00100000:1.0:1788872587.968238:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327629696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788872588.537124:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872588.555398:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872588.555446:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872588.555507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872588.555538:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872588.555616:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872588.555831:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311134208 00000100:00100000:1.0:1788872588.555843:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311134208 00000100:00100000:1.0:1788872588.555910:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 76 00000100:00100000:1.0:1788872588.555920:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311134208:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872588.555989:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311134208:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 71us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872588.555997:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 76 00000100:00100000:2.0:1788872588.556326:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311134336 00000100:00100000:2.0:1788872588.556331:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311134336 00000100:00100000:2.0:1788872588.556390:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311134464 00000100:00100000:2.0:1788872588.556394:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311134464 00000100:00100000:2.0:1788872588.556416:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1075 00000100:00100000:2.0:1788872588.556423:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311134336:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872588.556453:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311134336:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 31us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872588.556460:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1075 00000100:00100000:2.0:1788872588.556474:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1076 00000100:00100000:2.0:1788872588.556480:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311134464:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872588.556499:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311134464:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 20us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872588.556505:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1076 00000100:00100000:2.0:1788872588.556522:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311134592 00000100:00100000:2.0:1788872588.556525:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311134592 00000100:00100000:2.0:1788872588.556583:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311134720 00000100:00100000:2.0:1788872588.556586:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311134720 00000100:00100000:2.0:1788872588.556607:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2441 00000100:00100000:2.0:1788872588.556614:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311134592:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872588.556647:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311134592:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 34us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872588.556654:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2441 00000100:00100000:2.0:1788872588.556677:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2442 00000100:00100000:2.0:1788872588.556684:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311134720:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872588.556705:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311134720:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 22us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872588.556711:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2442 00000100:00080000:1.0:1788872588.558223:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872588.558232:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872588.558235:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872588.558238:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788872589.565635:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872590.009106:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872590.009346:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311134848 00000100:00100000:1.0:1788872590.009360:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311134848 00000100:00100000:1.0:1788872590.009454:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1075 00000100:00100000:1.0:1788872590.009465:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:65770:x1875765311134848:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:1.0:1788872590.009525:0:68674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:1.0:1788872590.009834:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:65770:x1875765311134848:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 369us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872590.009843:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1075 00000100:00080000:3.0:1788872590.010271:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872590.018427:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872590.018774:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311134976 00000100:00100000:2.0:1788872590.018789:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311134976 00000100:00100000:2.0:1788872590.018897:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1076 00000100:00100000:2.0:1788872590.018911:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:65770:x1875765311134976:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:2.0:1788872590.018969:0:66192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872590.019155:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:65770:x1875765311134976:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 246us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872590.019164:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1076 00000100:00080000:3.0:1788872590.019315:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872590.031329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872590.032121:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311135104 00000100:00100000:3.0:1788872590.032137:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311135104 00000100:00100000:3.0:1788872590.032386:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1967 00000100:00100000:3.0:1788872590.032400:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:65770:x1875765311135104:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872590.032450:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872590.032584:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:65770:x1875765311135104:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 187us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872590.032593:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1967 00000100:00080000:1.0:1788872590.037889:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872590.053769:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872590.053972:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311135232 00000100:00100000:2.0:1788872590.053988:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311135232 00000100:00100000:2.0:1788872590.054097:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1968 00000100:00100000:2.0:1788872590.054111:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:65770:x1875765311135232:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:2.0:1788872590.054156:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872590.054441:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:65770:x1875765311135232:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 333us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872590.054449:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1968 00000100:00080000:1.0:1788872590.055155:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872590.114511:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872590.114891:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311135488 00000100:00100000:2.0:1788872590.114911:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311135488 00000100:00100000:2.0:1788872590.115010:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1077 00000100:00100000:2.0:1788872590.115026:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:65787:x1875765311135488:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788872590.115059:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872590.115100:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d99f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae2c expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.115278:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.115297:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.115314:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.115333:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.115341:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.115348:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.115466:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a00 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.115475:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a00 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.115508:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116272:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116287:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872590.116292:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116301:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a00 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116319:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd26bb00) 00010000:00010000:2.0:1788872590.116323:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872590.116329:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a00 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116336:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116353:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116360:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116366:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116371:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872590.116385:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116392:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116402:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff98a9e1f8f100) 00010000:00010000:2.0:1788872590.116406:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872590.116409:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116415:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116474:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d99f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae2c expref: 8 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116486:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd26bb00) 00010000:00010000:2.0:1788872590.116488:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788872590.116493:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d99f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae2c expref: 8 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872590.116503:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8600, rc 0) 00000100:00100000:2.0:1788872590.116841:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:65787:x1875765311135488:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 1817us (2342us total) trans 0 rc 301/301 00000100:00100000:2.0:1788872590.116852:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1077 00000100:00100000:0.0:1788872590.123842:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872590.124084:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311135616 00000100:00100000:1.0:1788872590.124101:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311135616 00000100:00100000:1.0:1788872590.124227:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1078 00000100:00100000:1.0:1788872590.124243:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:65787:x1875765311135616:12345-192.168.204.39@tcp:34:lfs.0 00010000:00010000:1.0:1788872590.124353:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.124395:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.124411:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.124433:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c000/0xe4e6e89fb01d9a15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.124443:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c000/0xe4e6e89fb01d9a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.124450:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c000/0xe4e6e89fb01d9a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.124621:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9a1c lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.124629:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9a1c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126213:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9a1c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872590.126319:0:68674:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788872590.126341:0:68674:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9a1c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126366:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a0e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126373:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a0e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126405:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126414:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126421:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872590.126426:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126436:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a0e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126458:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd26bb00) 00010000:00010000:1.0:1788872590.126461:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872590.126467:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a0e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126474:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126498:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c000/0xe4e6e89fb01d9a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126505:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c000/0xe4e6e89fb01d9a15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126511:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c000/0xe4e6e89fb01d9a15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126516:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872590.126525:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c000/0xe4e6e89fb01d9a15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126532:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c000/0xe4e6e89fb01d9a15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126540:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff98a9c8112400) 00010000:00010000:1.0:1788872590.126544:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872590.126572:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c000/0xe4e6e89fb01d9a15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126579:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c000/0xe4e6e89fb01d9a15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126601:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9a1c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126608:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9a1c lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126614:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9a1c lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126619:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ce00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872590.126622:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9a1c lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.126628:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9a1c lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.127187:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff98a9c8112200) 00010000:00010000:1.0:1788872590.127193:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872590.127208:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9a1c lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872590.127217:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9a1c lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872590.127372:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:65787:x1875765311135616:12345-192.168.204.39@tcp:34:lfs.0 Request processed in 3125us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872590.127385:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1078 00010000:00010000:3.0:1788872590.586020:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872591.613127:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872592.569323:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327629952:0@lo:400:kworker.0 00000100:00100000:2.0:1788872592.569405:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872592.569518:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327630464:0@lo:400:kworker.0 00000100:00100000:3.0:1788872592.569687:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327629824:0@lo:400:kworker.0 00000100:00100000:3.0:1788872592.569726:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872592.569760:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327630336:0@lo:400:kworker.0 00000100:00100000:3.0:1788872592.569784:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872592.569878:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872592.569977:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327630848:0@lo:400:kworker.0 00000100:00100000:3.0:1788872592.570002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872592.570022:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327631360:0@lo:400:kworker.0 00000100:00100000:3.0:1788872592.570044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872592.570086:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327629824 00000100:00100000:3.0:1788872592.570095:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327629824 00000100:00100000:3.0:1788872592.570143:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788872592.570151:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327629824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872592.570210:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327629824:12345-0@lo:400:kworker.0 Request processed in 59us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872592.570217:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788872592.570257:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327629952 00000100:00100000:3.0:1788872592.570260:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327629952 00000100:00100000:3.0:1788872592.570294:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327630336 00000100:00100000:3.0:1788872592.570297:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327630336 00000100:00100000:3.0:1788872592.570313:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327630848 00000100:00100000:3.0:1788872592.570315:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327630848 00000100:00100000:3.0:1788872592.570324:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327631360 00000100:00100000:3.0:1788872592.570325:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327631360 00000100:00100000:3.0:1788872592.570339:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:3.0:1788872592.570345:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327629952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872592.570378:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327629952:12345-0@lo:400:kworker.0 Request processed in 33us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872592.570385:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:3.0:1788872592.570401:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1788872592.570407:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327630336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872592.570707:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327630976:0@lo:400:kworker.0 00000100:00100000:2.0:1788872592.570739:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872592.570784:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327629952:0@lo:400:kworker.0 00000100:00100000:1.0:1788872592.570953:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327630080:0@lo:400:kworker.0 00000100:00100000:1.0:1788872592.570989:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872592.571004:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327630592:0@lo:400:kworker.0 00000100:00100000:1.0:1788872592.571027:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872592.571046:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327631104:0@lo:400:kworker.0 00000100:00100000:1.0:1788872592.571068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872592.571090:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788872592.571097:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327630208:0@lo:400:kworker.0 00000100:00100000:1.0:1788872592.571120:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872592.571132:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327630720:0@lo:400:kworker.0 00000100:00100000:1.0:1788872592.571155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872592.571173:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327631232:0@lo:400:kworker.0 00000100:00100000:1.0:1788872592.571194:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872592.571226:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327630464 00000100:00100000:1.0:1788872592.571230:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327630464 00000100:00100000:1.0:1788872592.571261:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327630976 00000100:00100000:1.0:1788872592.571264:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327630976 00000100:00100000:1.0:1788872592.571280:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:1.0:1788872592.571286:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327630464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872592.571330:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327630464:12345-0@lo:400:kworker.0 Request processed in 44us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872592.571336:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00100000:1.0:1788872592.571349:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:1.0:1788872592.571354:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327630976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872592.571376:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327630976:12345-0@lo:400:kworker.0 Request processed in 22us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872592.571380:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00080000:1.0:1788872592.571394:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872592.571399:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788872592.571408:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327630080 00000100:00100000:1.0:1788872592.571411:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327630080 00000100:00100000:2.0:1788872592.572054:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327630464:0@lo:400:kworker.0 00000100:00100000:2.0:1788872592.572067:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327630976:0@lo:400:kworker.0 00000100:00100000:3.0:1788872592.572180:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327630336:12345-0@lo:400:kworker.0 Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872592.572188:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:1.0:1788872592.572237:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327630208 00000100:00100000:1.0:1788872592.572242:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327630208 00000100:00100000:1.0:1788872592.572270:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1788872592.572277:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327630848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872592.572321:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327630848:12345-0@lo:400:kworker.0 Request processed in 44us (2317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872592.572326:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1788872592.574158:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1788872592.574600:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327631360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872592.574711:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327631360:12345-0@lo:400:kworker.0 Request processed in 541us (4665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872592.574719:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1788872592.574743:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788872592.574750:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327630080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872592.574799:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327630080:12345-0@lo:400:kworker.0 Request processed in 49us (3808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872592.574833:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788872592.574848:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1788872592.574855:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327630208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872592.574887:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327630208:12345-0@lo:400:kworker.0 Request processed in 33us (3766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872592.574893:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1788872592.574987:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327630208:0@lo:400:kworker.0 00000100:00100000:0.0:1788872592.575002:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327630080:0@lo:400:kworker.0 00000100:00100000:0.0:1788872592.575039:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327631488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872592.575076:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872592.575119:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327631488 00000100:00100000:0.0:1788872592.575125:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327631488 00000100:00100000:0.0:1788872592.575152:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:0.0:1788872592.575158:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327631488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788872592.575191:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:0.0:1788872592.575231:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327631488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872592.575237:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:0.0:1788872592.575269:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327631488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872592.575453:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327630592 00000100:00100000:0.0:1788872592.575458:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327630592 00000100:00100000:0.0:1788872592.577474:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327631104 00000100:00100000:0.0:1788872592.577490:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327631104 00000100:00100000:0.0:1788872592.577572:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327630720 00000100:00100000:0.0:1788872592.577577:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327630720 00000100:00100000:0.0:1788872592.577613:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327631232 00000100:00100000:0.0:1788872592.577616:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327631232 00000100:00100000:0.0:1788872592.577650:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:0.0:1788872592.577660:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327630592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872592.577771:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327630592:12345-0@lo:400:kworker.0 Request processed in 112us (6742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872592.577779:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00000100:00100000:0.0:1788872592.577796:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:0.0:1788872592.577802:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327631104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872592.577853:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327631104:12345-0@lo:400:kworker.0 Request processed in 45us (6777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872592.577859:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000100:00100000:0.0:1788872592.578189:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:0.0:1788872592.578203:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327630720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872592.578238:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327630720:12345-0@lo:400:kworker.0 Request processed in 39us (7082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872592.578670:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446 00000100:00100000:2.0:1788872592.578684:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327631232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872592.578730:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327631232:12345-0@lo:400:kworker.0 Request processed in 51us (7535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872592.578738:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446 00000100:00100000:2.0:1788872592.578849:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327629824:0@lo:400:kworker.0 00000100:00100000:2.0:1788872592.578866:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327630336:0@lo:400:kworker.0 00000100:00100000:2.0:1788872592.578879:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327630848:0@lo:400:kworker.0 00000100:00100000:2.0:1788872592.578893:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327631360:0@lo:400:kworker.0 00000100:00100000:2.0:1788872592.579146:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327630720:0@lo:400:kworker.0 00000100:00100000:2.0:1788872592.579158:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327631232:0@lo:400:kworker.0 00000100:00100000:2.0:1788872592.579172:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327630592:0@lo:400:kworker.0 00000100:00100000:2.0:1788872592.579184:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327631104:0@lo:400:kworker.0 00000100:00100000:0.0:1788872592.581209:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00080000:3.0:1788872592.585157:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872592.585167:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872592.585172:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872592.585175:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788872592.634707:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872593.080993:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327631616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872593.081090:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872593.081136:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872593.081142:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327631744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872593.081167:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872593.081204:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327631616 00000100:00100000:2.0:1788872593.081213:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327631616 00000100:00100000:2.0:1788872593.081258:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327631744 00000100:00100000:2.0:1788872593.081261:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327631744 00000100:00100000:2.0:1788872593.081283:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:2.0:1788872593.081292:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327631616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872593.081322:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872593.081368:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327631616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872593.081375:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:2.0:1788872593.081396:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1788872593.081403:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327631744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872593.081419:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872593.081450:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327631744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872593.081456:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1788872593.081483:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327631872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872593.081508:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872593.081534:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327631872 00000100:00100000:2.0:1788872593.081538:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327631872 00000100:00100000:2.0:1788872593.081586:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1788872593.081593:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327631872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872593.081613:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872593.081643:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327631872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872593.081649:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1788872593.081689:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327631872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872593.081721:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327631744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872593.081734:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327631616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872593.082011:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327632000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872593.082042:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872593.082091:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327632000 00000100:00100000:0.0:1788872593.082096:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327632000 00000100:00100000:0.0:1788872593.082125:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:0.0:1788872593.082131:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327632000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872593.082142:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872593.082177:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327632000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872593.082195:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00100000:0.0:1788872593.082240:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327632000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872593.082305:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327632128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872593.082339:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872593.082411:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327632128 00000100:00100000:0.0:1788872593.082415:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327632128 00000100:00100000:0.0:1788872593.082452:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:0.0:1788872593.082459:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327632128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872593.082486:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:0.0:1788872593.082523:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327632128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872593.082530:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:1.0:1788872593.082617:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327632128:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788872593.664487:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872593.677838:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872593.677878:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872593.677917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872593.677942:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872593.678003:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872593.678031:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311136256 00000100:00100000:1.0:1788872593.678041:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311136256 00000100:00100000:1.0:1788872593.678099:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311136128 00000100:00100000:1.0:1788872593.678104:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311136128 00000100:00100000:1.0:1788872593.678129:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2447 00000100:00100000:1.0:1788872593.678140:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311136256:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872593.678205:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311136256:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 67us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872593.678211:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2447 00000100:00100000:1.0:1788872593.678226:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2448 00000100:00100000:1.0:1788872593.678232:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311136128:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872593.678253:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311136128:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 22us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872593.678258:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2448 00000100:00080000:1.0:1788872593.678289:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872593.678293:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872593.678441:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311135744 00000100:00100000:0.0:1788872593.678445:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311135744 00000100:00100000:0.0:1788872593.678475:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 78 00000100:00100000:0.0:1788872593.678481:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311135744:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872593.678512:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311135744:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 30us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872593.678518:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 78 00000100:00100000:0.0:1788872593.678564:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311136000 00000100:00100000:0.0:1788872593.678567:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311136000 00000100:00100000:0.0:1788872593.678611:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311135872 00000100:00100000:0.0:1788872593.678614:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311135872 00000100:00100000:0.0:1788872593.678639:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1083 00000100:00100000:0.0:1788872593.678646:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311136000:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872593.678674:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311136000:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 29us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872593.678691:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1083 00000100:00100000:0.0:1788872593.678705:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1084 00000100:00100000:0.0:1788872593.678712:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311135872:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872593.678743:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311135872:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 30us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872593.678750:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1084 00000100:00080000:0.0:1788872593.678924:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872593.678927:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788872594.687307:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872595.707646:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872596.730254:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872597.691594:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872597.691631:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327632256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872597.691735:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872597.691857:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327632256 00000100:00100000:2.0:1788872597.691869:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327632256 00000100:00100000:2.0:1788872597.691959:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1788872597.691972:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327632256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872597.692022:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872597.692097:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327632256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872597.692105:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00100000:0.0:1788872597.692407:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327632256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872597.694464:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327632768:0@lo:400:kworker.0 00000100:00100000:0.0:1788872597.694654:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327632512:0@lo:400:kworker.0 00000100:00100000:3.0:1788872597.694797:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327632384:0@lo:400:kworker.0 00000100:00100000:1.0:1788872597.698296:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327632640:0@lo:400:kworker.0 00000100:00100000:0.0:1788872597.706511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872597.708003:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327633024:0@lo:400:kworker.0 00000100:00100000:0.0:1788872597.708074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872597.708124:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327633024 00000100:00100000:0.0:1788872597.708134:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327633024 00000100:00100000:0.0:1788872597.708214:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:0.0:1788872597.708232:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327633024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872597.708300:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327633024:12345-0@lo:400:kworker.0 Request processed in 69us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872597.708309:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:0.0:1788872597.708386:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327633024:0@lo:400:kworker.0 00000100:00100000:0.0:1788872597.708395:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327633536:0@lo:400:kworker.0 00000100:00100000:0.0:1788872597.708424:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872597.722988:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872597.723082:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327633280:0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.723136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872597.723160:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327633792:0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.723181:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872597.727354:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872597.727456:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327632896:0@lo:400:kworker.0 00000100:00100000:3.0:1788872597.727562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872597.727594:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327633408:0@lo:400:kworker.0 00000100:00100000:3.0:1788872597.727620:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872597.727674:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327632512 00000100:00100000:3.0:1788872597.727685:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327632512 00000100:00100000:3.0:1788872597.727773:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327632768 00000100:00100000:3.0:1788872597.727777:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327632768 00000100:00100000:3.0:1788872597.727793:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327633792 00000100:00100000:3.0:1788872597.727796:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327633792 00000100:00100000:3.0:1788872597.727807:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327632896 00000100:00100000:3.0:1788872597.727809:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327632896 00000100:00100000:3.0:1788872597.727824:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327633408 00000100:00100000:3.0:1788872597.727826:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327633408 00000100:00100000:3.0:1788872597.727841:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1788872597.727850:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327632512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872597.728476:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327632512:12345-0@lo:400:kworker.0 Request processed in 623us (21977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872597.728486:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1788872597.729366:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:3.0:1788872597.729382:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327632768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872597.729446:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327632768:12345-0@lo:400:kworker.0 Request processed in 70us (6471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872597.729452:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:3.0:1788872597.729478:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1788872597.730740:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327633792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872597.730829:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327633792:12345-0@lo:400:kworker.0 Request processed in 1320us (7646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872597.730838:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1788872597.731808:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1788872597.731834:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327632896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872597.731920:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327632896:12345-0@lo:400:kworker.0 Request processed in 99us (4357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872597.731927:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1788872597.731951:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1788872597.731958:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327633408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.732252:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327632768:0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.732272:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327633792:0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.732359:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327633536 00000100:00100000:2.0:1788872597.732367:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327633536 00000100:00100000:2.0:1788872597.732421:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327633280 00000100:00100000:2.0:1788872597.732425:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327633280 00000100:00100000:2.0:1788872597.732464:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449 00000100:00100000:2.0:1788872597.732482:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327633536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.732528:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327633536:12345-0@lo:400:kworker.0 Request processed in 50us (24103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872597.732581:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449 00000100:00100000:2.0:1788872597.732602:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:2.0:1788872597.732610:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327633280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.732648:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327633280:12345-0@lo:400:kworker.0 Request processed in 39us (9510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872597.732654:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00100000:2.0:1788872597.732730:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327633280:0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.732794:0:85125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327632384 00000100:00100000:2.0:1788872597.732798:0:85125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327632384 00000100:00100000:2.0:1788872597.732829:0:85125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788872597.732835:0:85125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327632384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.732877:0:85125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327632384:12345-0@lo:400:kworker.0 Request processed in 42us (5537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872597.732897:0:85125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788872597.733089:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872597.733096:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872597.733099:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872597.733103:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788872597.733145:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327632512:0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.733171:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327633536:0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.733238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872597.733275:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327632640 00000100:00100000:2.0:1788872597.733280:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327632640 00000100:00100000:1.0:1788872597.733289:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327633408:12345-0@lo:400:kworker.0 Request processed in 1326us (5661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872597.733298:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:2.0:1788872597.733315:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1788872597.733324:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327632640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872597.733349:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327632384:0@lo:400:kworker.0 00000100:00100000:1.0:1788872597.733369:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327632896:0@lo:400:kworker.0 00000100:00080000:3.0:1788872597.736932:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872597.738324:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327632640:12345-0@lo:400:kworker.0 Request processed in 4990us (5081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872597.738342:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1788872597.738394:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327633408:0@lo:400:kworker.0 00000100:00100000:3.0:1788872597.748824:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327632640:0@lo:400:kworker.0 00000100:00100000:3.0:1788872597.748847:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327633152:0@lo:400:kworker.0 00000100:00100000:3.0:1788872597.748947:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872597.749062:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327633664:0@lo:400:kworker.0 00000100:00100000:3.0:1788872597.749087:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872597.752768:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327633152 00000100:00100000:1.0:1788872597.752789:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327633152 00000100:00080000:3.0:1788872597.752886:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872597.753037:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327633664 00000100:00100000:2.0:1788872597.753043:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327633664 00000100:00100000:2.0:1788872597.755952:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:2.0:1788872597.755975:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327633152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.756201:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327633152:12345-0@lo:400:kworker.0 Request processed in 233us (7252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872597.756209:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00100000:2.0:1788872597.756231:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452 00000100:00100000:2.0:1788872597.756238:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327633664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.756273:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327633664:12345-0@lo:400:kworker.0 Request processed in 35us (7184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872597.756280:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452 00000100:00100000:2.0:1788872597.756348:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327633152:0@lo:400:kworker.0 00000100:00100000:2.0:1788872597.756363:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327633664:0@lo:400:kworker.0 00000100:00080000:3.0:1788872597.757858:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788872597.769024:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872598.200821:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872598.200847:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327633920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872598.200925:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872598.200981:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327633920 00000100:00100000:3.0:1788872598.200989:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327633920 00000100:00100000:3.0:1788872598.201041:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1788872598.201050:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327633920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872598.201086:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:3.0:1788872598.201133:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327633920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872598.201140:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1788872598.201188:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327633920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872598.201510:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872598.201522:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327634048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872598.201586:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872598.201679:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327634048 00000100:00100000:1.0:1788872598.201684:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327634048 00000100:00100000:1.0:1788872598.201737:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:1.0:1788872598.201744:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327634048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872598.201765:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872598.201806:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327634048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872598.201813:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:1.0:1788872598.201841:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327634048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872598.205018:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327634176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872598.205117:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872598.206818:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327634176 00000100:00100000:0.0:1788872598.206828:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327634176 00000100:00100000:0.0:1788872598.206884:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:0.0:1788872598.206896:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327634176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872598.206931:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872598.207016:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327634176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872598.207024:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:0.0:1788872598.207056:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327634304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872598.207095:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872598.207165:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327634176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872598.207196:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327634304 00000100:00100000:0.0:1788872598.207200:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327634304 00000100:00100000:0.0:1788872598.207225:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:0.0:1788872598.207231:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327634304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872598.207242:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872598.207276:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327634304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872598.207282:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00100000:0.0:1788872598.207326:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327634304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872598.208359:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327634432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872598.208409:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872598.208588:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327634432 00000100:00100000:3.0:1788872598.208603:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327634432 00000100:00100000:3.0:1788872598.208642:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:3.0:1788872598.208653:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327634432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872598.208670:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872598.208728:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327634432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872598.208736:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:0.0:1788872598.208890:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327634432:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788872598.657154:0:85945:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 09:03:17 (1788872597) 00000100:00100000:2.0:1788872598.777346:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872598.777415:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311136384 00000100:00100000:3.0:1788872598.777424:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311136384 00000100:00100000:3.0:1788872598.777504:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1079 00000100:00100000:3.0:1788872598.777515:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:66372:x1875765311136384:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872598.777540:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872598.777590:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9a23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae33 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777659:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9a2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777672:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9a2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777685:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9a2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777712:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777719:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777743:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777790:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9a2a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777797:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9a2a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777804:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9a2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777810:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9a2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777815:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872598.777819:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9a2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777827:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9a2a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777838:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd26bb00) 00010000:00010000:3.0:1788872598.777841:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872598.777846:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9a2a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777853:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9a2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777868:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777880:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777886:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777890:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deae00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872598.777893:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777898:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777906:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff98a9e7bf4700) 00010000:00010000:3.0:1788872598.777908:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872598.777911:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777917:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777949:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9a23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae33 expref: 8 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777959:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd26bb00) 00010000:00010000:3.0:1788872598.777961:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872598.777964:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9a23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae33 expref: 8 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.777985:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5deb800, rc 0) 00000100:00100000:3.0:1788872598.778060:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:66372:x1875765311136384:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 548us (724us total) trans 0 rc 301/301 00000100:00100000:3.0:1788872598.778068:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1079 00000100:00080000:2.0:1788872598.778153:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788872598.779256:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872598.783623:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872598.783719:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311136640 00000100:00100000:2.0:1788872598.783731:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311136640 00000100:00100000:2.0:1788872598.783793:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1080 00000100:00100000:2.0:1788872598.783804:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:66372:x1875765311136640:12345-192.168.204.39@tcp:36:lfs.0 00010000:00010000:2.0:1788872598.783859:0:68674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872598.783884:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d99c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae09 expref: 7 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.783902:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd26bb00) 00010000:00010000:2.0:1788872598.783914:0:68674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872598.783978:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a38 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.784007:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.784018:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.784031:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a3f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.784038:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.784045:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787234:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a46 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787256:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a46 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787267:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a46 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872598.787283:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000013650e4 reply state 000000002cc30392 transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a46 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787293:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a46 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787301:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98a8ca1a0e00) 00010000:00010000:2.0:1788872598.787303:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872598.787307:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788872598.787312:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788872598.787321:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a38 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787329:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a38 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787336:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787343:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a38 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787348:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872598.787357:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a38 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787364:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a38 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787375:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e1f8f400) 00010000:00010000:2.0:1788872598.787377:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872598.787380:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a38 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787387:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a38 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872598.787403:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000013650e4 reply state 000000002cc30392 transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787411:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.787417:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff98a9e1f8f500) 00010000:00010000:2.0:1788872598.787419:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872598.787421:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788872598.787526:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:66372:x1875765311136640:12345-192.168.204.39@tcp:36:lfs.0 Request processed in 3720us (3909us total) trans 103079215105 rc 0/0 00000100:00100000:2.0:1788872598.787534:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1080 00000100:00100000:0.0:1788872598.799541:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872598.799616:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872598.799652:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872598.799683:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872598.799729:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311136896 00000100:00100000:0.0:1788872598.799740:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311136896 00000100:00100000:0.0:1788872598.799804:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1091 00000100:00100000:0.0:1788872598.799815:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311136896:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872598.799893:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311136896:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872598.799902:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1091 00000100:00100000:0.0:1788872598.799927:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311137024 00000100:00100000:0.0:1788872598.799931:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311137024 00000100:00100000:0.0:1788872598.799959:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311137152 00000100:00100000:0.0:1788872598.799962:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311137152 00000100:00100000:0.0:1788872598.799985:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2453 00000100:00100000:0.0:1788872598.799993:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311137024:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872598.800021:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311137024:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872598.800027:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2453 00000100:00100000:0.0:1788872598.800041:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2454 00000100:00100000:0.0:1788872598.800059:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311137152:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872598.800086:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311137152:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872598.800092:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2454 00000100:00080000:0.0:1788872598.800110:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872598.800114:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872598.800116:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872598.800311:0:85130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311136768 00000100:00100000:3.0:1788872598.800316:0:85130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311136768 00000100:00100000:3.0:1788872598.800355:0:85130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 80 00000100:00100000:3.0:1788872598.800363:0:85130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2406:x1875765311136768:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872598.800399:0:85130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2406:x1875765311136768:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 37us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872598.800406:0:85130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 80 00000100:00100000:0.0:1788872598.805723:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872598.805929:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311137280 00000100:00100000:3.0:1788872598.805941:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311137280 00000100:00100000:3.0:1788872598.806000:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1081 00000100:00100000:3.0:1788872598.806009:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:66375:x1875765311137280:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872598.806034:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872598.806061:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9a4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae3a expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.806132:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.806146:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.806187:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872598.806235:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872598.806239:0:66192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872598.806258:0:66192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.806281:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9a4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae3a expref: 10 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.806298:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae3a expref: 9 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872598.806307:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4700) 00010000:00010000:3.0:1788872598.806310:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872598.806313:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5deae00, rc 0) 00000100:00100000:3.0:1788872598.806376:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:66375:x1875765311137280:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 367us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872598.806382:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1081 00000100:00100000:3.0:1788872598.820666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872598.820729:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311137408 00000100:00100000:1.0:1788872598.820739:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311137408 00000100:00100000:1.0:1788872598.820797:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1082 00000100:00100000:1.0:1788872598.820807:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:66375:x1875765311137408:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:1.0:1788872598.820828:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872598.820848:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9a5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae41 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.820916:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01d9a62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.820930:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01d9a62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.820940:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01d9a62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.820951:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9a69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.820958:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9a69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.820964:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9a69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821039:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a70 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821048:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a70 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821055:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a70 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872598.821096:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788872598.821101:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788872598.821118:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a70 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821141:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01d9a62 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821147:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01d9a62 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821153:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01d9a62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821159:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01d9a62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821165:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872598.821168:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01d9a62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821176:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01d9a62 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821188:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4700) 00010000:00010000:1.0:1788872598.821191:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872598.821195:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01d9a62 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821202:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01d9a62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821213:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9a69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821219:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9a69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821231:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9a69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821237:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9de00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872598.821240:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9a69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821246:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9a69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821254:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff98a9e1f8f500) 00010000:00010000:1.0:1788872598.821257:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872598.821260:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9a69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821265:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9a69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821290:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9a5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae41 expref: 11 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821303:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a70 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae41 expref: 10 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872598.821310:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98a8ca1a0e00) 00010000:00010000:1.0:1788872598.821312:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788872598.821315:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d800, rc 0) 00000100:00100000:1.0:1788872598.821379:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:66375:x1875765311137408:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 573us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872598.821395:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1082 00000100:00100000:0.0:1788872598.834263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872598.834641:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311137664 00000100:00100000:2.0:1788872598.834654:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311137664 00000100:00100000:2.0:1788872598.834760:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1083 00000100:00100000:2.0:1788872598.834771:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:66375:x1875765311137664:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788872598.834794:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872598.834828:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae48 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872598.834955:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788872598.835066:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae48 expref: 12 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.835081:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4700) 00010000:00010000:2.0:1788872598.835084:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788872598.835090:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9a77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae48 expref: 12 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.835104:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9e00, rc 0) 00000100:00100000:2.0:1788872598.835185:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:66375:x1875765311137664:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 407us (923us total) trans 103079215106 rc 301/301 00000100:00100000:2.0:1788872598.835193:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1083 00000100:00100000:0.0:1788872598.838842:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872598.839762:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311137920 00000100:00100000:2.0:1788872598.839774:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311137920 00000100:00100000:2.0:1788872598.839877:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1084 00000100:00100000:2.0:1788872598.839888:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:66375:x1875765311137920:12345-192.168.204.39@tcp:36:lfs.0 00010000:00010000:2.0:1788872598.839954:0:66192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872598.839984:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d800/0xe4e6e89fb01d9a70 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae41 expref: 11 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.840018:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98a8ca1a0e00) 00010000:00010000:2.0:1788872598.840023:0:66192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872598.840044:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9a85 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.840062:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9a85 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.840071:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9a85 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872598.840220:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005d19e57d reply state 00000000c9df9f42 transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9a85 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.840233:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9a85 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872598.840239:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98a8ca1a0e00) 00010000:00010000:2.0:1788872598.840242:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1788872598.840245:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788872598.840252:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000100:00100000:2.0:1788872598.840334:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:66375:x1875765311137920:12345-192.168.204.39@tcp:36:lfs.0 Request processed in 448us (1501us total) trans 103079215107 rc 0/0 00000100:00100000:2.0:1788872598.840341:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1084 00000100:00100000:3.0:1788872598.842427:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872598.842531:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311138176 00000100:00100000:0.0:1788872598.842540:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311138176 00000100:00100000:0.0:1788872598.842686:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 217 00000100:00100000:0.0:1788872598.842709:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:66375:x1875765311138176:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:0.0:1788872598.843002:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:66375:x1875765311138176:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 298us (573us total) trans 103079215108 rc 0/0 00000100:00100000:0.0:1788872598.843010:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 217 00000001:00080000:0.0:1788872599.799134:0:85118:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215108 is committed 00010000:00010000:2.0:1788872599.799255:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799269:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a3f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799276:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799281:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872599.799286:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799304:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a3f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799323:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff98a9e1f8f500) 00010000:00010000:2.0:1788872599.799326:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872599.799330:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a3f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799336:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a3f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799358:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a46 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799364:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a46 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799370:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a46 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799374:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872599.799376:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a46 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799381:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a46 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799388:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98a8ca1a0e00) 00010000:00010000:2.0:1788872599.799390:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872599.799392:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a46 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799403:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a46 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799418:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9a85 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799423:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9a85 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799428:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9a85 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799434:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872599.799437:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9a85 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799442:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9a85 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799449:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98a8ca1a0e00) 00010000:00010000:2.0:1788872599.799451:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788872599.799464:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9a85 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872599.799471:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9a85 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872599.803541:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872599.879482:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872599.879597:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311138304 00000100:00100000:1.0:1788872599.879606:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311138304 00000100:00100000:1.0:1788872599.879667:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1085 00000100:00100000:1.0:1788872599.879688:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:66385:x1875765311138304:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:1.0:1788872599.879730:0:66979:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:1.0:1788872599.879801:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:66385:x1875765311138304:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 114us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872599.879808:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1085 00000100:00100000:3.0:1788872599.890655:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872599.890710:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311138432 00000100:00100000:3.0:1788872599.890720:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311138432 00000100:00100000:3.0:1788872599.890775:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1086 00000100:00100000:3.0:1788872599.890786:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:66385:x1875765311138432:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872599.890841:0:66193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:3.0:1788872599.890910:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:66385:x1875765311138432:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 126us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872599.890917:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1086 00000100:00100000:3.0:1788872599.902913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872599.903033:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311138560 00000100:00100000:1.0:1788872599.903044:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311138560 00000100:00100000:1.0:1788872599.903098:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1977 00000100:00100000:1.0:1788872599.903109:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:66385:x1875765311138560:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:1.0:1788872599.903142:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872599.903218:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:66385:x1875765311138560:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 111us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872599.903225:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1977 00000100:00100000:1.0:1788872599.911936:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872599.913668:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311138688 00000100:00100000:3.0:1788872599.913693:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311138688 00000100:00100000:3.0:1788872599.914803:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1978 00000100:00100000:3.0:1788872599.914819:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:66385:x1875765311138688:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872599.914858:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872599.914946:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:66385:x1875765311138688:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 131us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872599.914953:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1978 00000100:00100000:3.0:1788872600.001465:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872600.001543:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311138944 00000100:00100000:2.0:1788872600.001586:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311138944 00000100:00100000:2.0:1788872600.001656:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1087 00000100:00100000:2.0:1788872600.001666:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:66392:x1875765311138944:12345-192.168.204.39@tcp:36:mcreate.0 00010000:00010000:2.0:1788872600.001745:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872600.001772:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9a54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae3a expref: 7 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.001790:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4700) 00010000:00010000:2.0:1788872600.001800:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872600.001863:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a8c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.001876:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.001886:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.001901:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a93 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.001907:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.001914:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.002290:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.002298:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a8c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.002305:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.002317:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872600.002322:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.002329:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a8c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.002338:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a8ca1a0e00) 00010000:00010000:2.0:1788872600.002341:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872600.002344:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a8c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.002350:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9a8c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872600.002365:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b59f65aa reply state 000000000e5d36c0 transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.002374:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872600.002381:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a8ca1a0000) 00010000:00010000:2.0:1788872600.002383:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872600.002385:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872600.002462:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:66392:x1875765311138944:12345-192.168.204.39@tcp:36:mcreate.0 Request processed in 797us (1014us total) trans 103079215109 rc 0/0 00000100:00100000:2.0:1788872600.002469:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1087 00000100:00080000:3.0:1788872600.002762:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788872600.036894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872600.037334:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311139072 00000100:00100000:3.0:1788872600.037344:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311139072 00000100:00100000:3.0:1788872600.037462:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1088 00000100:00100000:3.0:1788872600.037476:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:66395:x1875765311139072:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:3.0:1788872600.037505:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872600.037530:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9a9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae4f expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.037649:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9aa1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.037664:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.037693:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872600.037741:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872600.037745:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872600.037763:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.037789:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9a9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae4f expref: 10 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.037808:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae4f expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.037817:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4a00) 00010000:00010000:3.0:1788872600.037820:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872600.037824:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5deb600, rc 0) 00000100:00100000:3.0:1788872600.037888:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:66395:x1875765311139072:12345-192.168.204.39@tcp:101:rm.0 Request processed in 416us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872600.037895:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1088 00000100:00100000:2.0:1788872600.051427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872600.051591:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311139200 00000100:00100000:3.0:1788872600.051602:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311139200 00000100:00100000:3.0:1788872600.051661:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1089 00000100:00100000:3.0:1788872600.051684:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:66395:x1875765311139200:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:3.0:1788872600.051706:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872600.051729:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deaa00/0xe4e6e89fb01d9aa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae56 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.051814:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea000/0xe4e6e89fb01d9aaf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.051829:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea000/0xe4e6e89fb01d9aaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.051841:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea000/0xe4e6e89fb01d9aaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.051855:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deba00/0xe4e6e89fb01d9ab6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.051863:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deba00/0xe4e6e89fb01d9ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.051870:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deba00/0xe4e6e89fb01d9ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.051954:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deac00/0xe4e6e89fb01d9abd lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.051961:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deac00/0xe4e6e89fb01d9abd lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.051968:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deac00/0xe4e6e89fb01d9abd lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872600.052011:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788872600.052016:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872600.052036:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deac00/0xe4e6e89fb01d9abd lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.052059:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deac00/0xe4e6e89fb01d9abd lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.052068:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea000/0xe4e6e89fb01d9aaf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.052074:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea000/0xe4e6e89fb01d9aaf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.052081:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea000/0xe4e6e89fb01d9aaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.052088:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea000/0xe4e6e89fb01d9aaf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.052094:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5dea000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872600.052098:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea000/0xe4e6e89fb01d9aaf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.052105:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea000/0xe4e6e89fb01d9aaf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.052116:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4a00) 00010000:00010000:3.0:1788872600.052119:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872600.052123:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea000/0xe4e6e89fb01d9aaf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.052129:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea000/0xe4e6e89fb01d9aaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.052140:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deba00/0xe4e6e89fb01d9ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.052153:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deba00/0xe4e6e89fb01d9ab6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.053292:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deba00/0xe4e6e89fb01d9ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.053300:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deba00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872600.053304:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deba00/0xe4e6e89fb01d9ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.053312:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deba00/0xe4e6e89fb01d9ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.053323:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a8ca1a0000) 00010000:00010000:3.0:1788872600.053325:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872600.053328:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deba00/0xe4e6e89fb01d9ab6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.053334:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deba00/0xe4e6e89fb01d9ab6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.053369:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deaa00/0xe4e6e89fb01d9aa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae56 expref: 11 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.053384:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deac00/0xe4e6e89fb01d9abd lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae56 expref: 10 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.053390:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff98a9e7bf4600) 00010000:00010000:3.0:1788872600.053393:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788872600.053402:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5deac00, rc 0) 00000100:00100000:3.0:1788872600.053890:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:66395:x1875765311139200:12345-192.168.204.39@tcp:101:rm.0 Request processed in 2217us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872600.053900:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1089 00000100:00100000:3.0:1788872600.059937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872600.059983:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311139456 00000100:00100000:3.0:1788872600.060003:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311139456 00000100:00100000:3.0:1788872600.060061:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1090 00000100:00100000:3.0:1788872600.060071:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:66395:x1875765311139456:12345-192.168.204.39@tcp:36:rm.0 00010000:00010000:3.0:1788872600.060125:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788872600.060154:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deac00/0xe4e6e89fb01d9abd lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae56 expref: 10 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060186:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff98a9e7bf4600) 00010000:00010000:3.0:1788872600.060202:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb600/0xe4e6e89fb01d9aa1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae4f expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060210:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4a00) 00010000:00010000:3.0:1788872600.060215:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872600.060241:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9ac4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060254:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9ac4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060263:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9ac4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060275:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9acb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060295:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9acb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060301:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9acb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060377:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d9ad2 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060385:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d9ad2 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060391:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d9ad2 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060643:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d9ad9 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060652:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d9ad9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060660:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d9ad9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060666:0:83669:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d9ad9 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060685:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d9ad9 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060690:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d9ad9 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060720:0:83669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872600.060737:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d9ad2 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060743:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d9ad2 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060748:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d9ad2 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060754:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5dea400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872600.060758:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d9ad2 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060765:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d9ad2 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060773:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff98a9e7bf4300) 00010000:00010000:3.0:1788872600.060776:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788872600.060780:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d9ad2 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060786:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea400/0xe4e6e89fb01d9ad2 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060801:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9ac4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060807:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9ac4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060822:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9ac4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060827:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872600.060831:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9ac4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060837:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9ac4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060845:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4c00) 00010000:00010000:3.0:1788872600.060848:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872600.060852:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9ac4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060857:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb800/0xe4e6e89fb01d9ac4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872600.060869:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003085505e reply state 00000000d8be94d7 transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9acb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060879:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9acb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.060886:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a8ca1a0000) 00010000:00010000:3.0:1788872600.060888:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872600.060891:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788872600.060969:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:66395:x1875765311139456:12345-192.168.204.39@tcp:36:rm.0 Request processed in 898us (1041us total) trans 103079215110 rc 0/0 00000100:00100000:3.0:1788872600.060977:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1090 00010000:00010000:3.0:1788872600.061033:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872600.061039:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d9ad9 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.061045:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5dea200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872600.061049:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d9ad9 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.061055:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d9ad9 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.061065:0:14981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff98a9e7bf4300) 00010000:00010000:3.0:1788872600.061067:0:14981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788872600.061069:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d9ad9 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.061074:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5dea200/0xe4e6e89fb01d9ad9 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872600.061084:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872600.061086:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872600.061087:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872600.826164:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872601.854379:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872602.811079:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327634560:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.811141:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327634688:0@lo:400:kworker.0 00000100:00100000:1.0:1788872602.811226:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327634944:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.814214:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872602.814299:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327635200:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.814349:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872602.814376:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327635712:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.814401:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872602.814441:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788872602.814473:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327634816:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.814499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872602.814521:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327635328:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.814568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872602.814591:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327635840:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.814613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872602.814690:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327634688 00000100:00100000:3.0:1788872602.814701:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327634688 00000100:00100000:3.0:1788872602.814776:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327634816 00000100:00100000:3.0:1788872602.814780:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327634816 00000100:00100000:3.0:1788872602.814806:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:3.0:1788872602.814817:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327634688:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872602.814852:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a4bb80 x1875765327634688/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:528/0 lens 224/224 e 0 to 0 dl 1788872613 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872602.814904:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327634688:12345-0@lo:400:kworker.0 Request processed in 89us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872602.814914:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:3.0:1788872602.814934:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1788872602.814940:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327634816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.814968:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327634816:12345-0@lo:400:kworker.0 Request processed in 29us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872602.814974:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1788872602.814995:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327635200 00000100:00100000:3.0:1788872602.814999:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327635200 00000100:00100000:3.0:1788872602.815027:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327635712 00000100:00100000:3.0:1788872602.815030:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327635712 00000100:00100000:3.0:1788872602.815048:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:3.0:1788872602.815064:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327635200:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872602.815085:0:8447:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a48380 x1875765327635200/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:528/0 lens 224/224 e 0 to 0 dl 1788872613 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872602.815114:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327635200:12345-0@lo:400:kworker.0 Request processed in 51us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872602.815119:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00100000:3.0:1788872602.815131:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:3.0:1788872602.815137:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327635712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.815162:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327635712:12345-0@lo:400:kworker.0 Request processed in 26us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872602.815169:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00100000:3.0:1788872602.815198:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327635328 00000100:00100000:3.0:1788872602.815202:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327635328 00000100:00100000:3.0:1788872602.815234:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327635840 00000100:00100000:3.0:1788872602.815238:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327635840 00000100:00100000:3.0:1788872602.815274:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455 00000100:00100000:3.0:1788872602.815280:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f098bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327635328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.815315:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f098bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327635328:12345-0@lo:400:kworker.0 Request processed in 36us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872602.815322:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455 00000100:00100000:3.0:1788872602.815333:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456 00000100:00100000:3.0:1788872602.815339:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327635840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.815365:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327635840:12345-0@lo:400:kworker.0 Request processed in 27us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872602.815371:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456 00000100:00080000:3.0:1788872602.815394:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872602.815407:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872602.815410:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872602.815474:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327634816:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.815485:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327635328:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.815495:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327635840:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.815506:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327634688:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.815517:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327635200:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.815525:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327635712:0@lo:400:kworker.0 00000100:00100000:0.0:1788872602.819359:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872602.819955:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872602.819980:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327636224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872602.820149:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327635072:0@lo:400:kworker.0 00000100:00100000:0.0:1788872602.820273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872602.820329:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327636224 00000100:00100000:0.0:1788872602.820352:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327636224 00000100:00100000:3.0:1788872602.820546:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872602.820798:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327635584:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.820827:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872602.820912:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327635072 00000100:00100000:2.0:1788872602.820924:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327635072 00000100:00100000:2.0:1788872602.820980:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327635584 00000100:00100000:2.0:1788872602.820984:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327635584 00000100:00100000:2.0:1788872602.821008:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:2.0:1788872602.821019:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327635072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872602.821032:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:2.0:1788872602.821092:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327635072:12345-0@lo:400:kworker.0 Request processed in 74us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872602.821101:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:2.0:1788872602.821124:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1788872602.821130:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327635584:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788872602.821146:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9faa7bb80 x1875765327635584/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:528/0 lens 224/224 e 0 to 0 dl 1788872613 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872602.821268:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872602.821311:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327635584:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.821320:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327636096:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.821347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872602.821372:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327636096 00000100:00100000:3.0:1788872602.821376:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327636096 00000100:00100000:3.0:1788872602.821406:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:3.0:1788872602.821413:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327636096:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872602.821427:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9faa79500 x1875765327636096/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:528/0 lens 224/224 e 0 to 0 dl 1788872613 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872602.821443:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327636224:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872602.821462:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327636096:12345-0@lo:400:kworker.0 Request processed in 49us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872602.821479:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000004:00000024:0.0:1788872602.821490:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:3.0:1788872602.821517:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327636096:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.821586:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327635072:0@lo:400:kworker.0 00000100:00100000:0.0:1788872602.821598:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327636224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 546us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872602.821607:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000100:00100000:0.0:1788872602.821669:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327636224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872602.821859:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327635584:12345-0@lo:400:kworker.0 Request processed in 45us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872602.821866:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1788872602.821949:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327634560 00000100:00100000:3.0:1788872602.821958:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327634560 00000100:00100000:3.0:1788872602.822040:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788872602.822048:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327634560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.822104:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327634560:12345-0@lo:400:kworker.0 Request processed in 57us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872602.822111:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788872602.822186:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327634560:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.822438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872602.822472:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327635456:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.822500:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872602.822523:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327635968:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.822544:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872602.822743:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327635456 00000100:00100000:2.0:1788872602.822748:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327635456 00000100:00100000:2.0:1788872602.822783:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327635968 00000100:00100000:2.0:1788872602.822786:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327635968 00000100:00100000:2.0:1788872602.822807:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457 00000100:00100000:2.0:1788872602.822815:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327635456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872602.822856:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327635456:12345-0@lo:400:kworker.0 Request processed in 42us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872602.822863:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457 00000100:00100000:2.0:1788872602.822876:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458 00000100:00100000:2.0:1788872602.822882:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327635968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872602.822909:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327635968:12345-0@lo:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872602.822928:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458 00000100:00080000:3.0:1788872602.823036:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872602.823062:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327635456:0@lo:400:kworker.0 00000100:00100000:3.0:1788872602.823073:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327635968:0@lo:400:kworker.0 00000100:00100000:1.0:1788872602.824019:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327634944 00000100:00100000:1.0:1788872602.824030:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327634944 00000100:00100000:1.0:1788872602.824088:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1788872602.824097:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327634944:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788872602.824122:0:66192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9faa78700 x1875765327634944/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:528/0 lens 224/224 e 0 to 0 dl 1788872613 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872602.824193:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327634944:12345-0@lo:400:kworker.0 Request processed in 98us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872602.824201:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1788872602.824243:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327634944:0@lo:400:kworker.0 00000100:00080000:3.0:1788872602.825755:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788872602.881642:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872603.321289:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872603.321325:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327636352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872603.321433:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872603.321627:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327636352 00000100:00100000:3.0:1788872603.321647:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327636352 00000100:00100000:3.0:1788872603.321722:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:3.0:1788872603.321733:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327636352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872603.321780:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00010000:00000080:3.0:1788872603.321821:0:8446:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c49fbb80 x1875765327636352/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:529/0 lens 224/368 e 0 to 0 dl 1788872614 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872603.321881:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327636352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872603.321888:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:2.0:1788872603.322268:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327636352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872603.322750:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872603.322889:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872603.322905:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327636608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872603.322967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872603.323010:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327636608 00000100:00100000:1.0:1788872603.323016:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327636608 00000100:00100000:1.0:1788872603.323085:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:1.0:1788872603.323104:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327636608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872603.323134:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872603.323176:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327636608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872603.323183:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:1.0:1788872603.323224:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327636608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872603.327337:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872603.327368:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327636736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872603.327466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872603.327524:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327636736 00000100:00100000:1.0:1788872603.327533:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327636736 00000100:00100000:1.0:1788872603.327621:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:1.0:1788872603.327632:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327636736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872603.327669:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872603.327720:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327636736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872603.327745:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:1.0:1788872603.327800:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327636736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872603.328124:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327636480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872603.328167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872603.328248:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327636480 00000100:00100000:1.0:1788872603.328253:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327636480 00000100:00100000:1.0:1788872603.328331:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:1.0:1788872603.328339:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327636480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872603.328354:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872603.328399:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327636480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872603.328406:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:3.0:1788872603.328469:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327636480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872603.328660:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327636864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872603.328695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872603.328763:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327636864 00000100:00100000:3.0:1788872603.328767:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327636864 00000100:00100000:3.0:1788872603.328796:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:3.0:1788872603.328802:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327636864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872603.328814:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872603.329180:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327636864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 375us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872603.329188:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:2.0:1788872603.329914:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327636864:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788872603.898078:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872603.914764:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872603.914901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872603.914936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872603.914964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872603.914993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872603.915027:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311139840 00000100:00100000:3.0:1788872603.915030:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311139712 00000100:00100000:3.0:1788872603.915044:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311139712 00000100:00100000:0.0:1788872603.915044:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311139840 00000100:00100000:0.0:1788872603.915134:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1098 00000100:00100000:0.0:1788872603.915147:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311139840:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872603.915223:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1099 00000100:00100000:3.0:1788872603.915234:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2405:x1875765311139712:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872603.915253:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311139840:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 107us (349us total) trans 0 rc 0/0 00010000:00000080:3.0:1788872603.915260:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9ff7f2a00 x1875765311139712/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:529/0 lens 224/224 e 0 to 0 dl 1788872614 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872603.915265:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1098 00000100:00100000:3.0:1788872603.915296:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2405:x1875765311139712:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 65us (331us total) trans 0 rc 0/0 00000100:00080000:0.0:1788872603.915297:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872603.915305:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872603.915307:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1099 00000100:00100000:2.0:1788872603.916758:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311139584 00000100:00100000:2.0:1788872603.916771:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311139584 00000100:00100000:2.0:1788872603.916922:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 82 00000100:00100000:2.0:1788872603.916933:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311139584:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872603.917000:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311139584:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 71us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872603.917008:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 82 00000100:00100000:2.0:1788872603.917210:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311140096 00000100:00100000:2.0:1788872603.917215:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311140096 00000100:00100000:2.0:1788872603.917285:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311139968 00000100:00100000:2.0:1788872603.917289:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311139968 00000100:00100000:3.0:1788872603.917327:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2459 00000100:00080000:0.0:1788872603.917343:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872603.917345:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311140096:12345-192.168.204.39@tcp:400:kworker.0 00000100:00080000:0.0:1788872603.917350:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872603.917393:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311140096:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 51us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872603.917399:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2459 00000100:00100000:3.0:1788872603.917412:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2460 00000100:00100000:3.0:1788872603.917418:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311139968:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872603.917439:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311139968:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 21us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872603.917446:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2460 00010000:00010000:3.0:1788872604.923681:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872605.946021:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788872606.699111:0:85118:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:3.0:1788872606.700838:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700854:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a93 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700862:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700868:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872606.700873:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700889:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a93 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700907:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a8ca1a0000) 00010000:00010000:3.0:1788872606.700910:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872606.700917:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a93 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700923:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9a93 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700942:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9acb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700949:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9acb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700955:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9acb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700959:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deae00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872606.700962:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9acb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700967:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9acb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700973:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a8ca1a0000) 00010000:00010000:3.0:1788872606.700976:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872606.700978:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9acb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872606.700990:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9acb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872606.972798:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872607.932177:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327636992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872607.932246:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.932277:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327637504:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.932314:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.932334:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327638016:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.932357:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.932374:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327638528:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.932394:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.932420:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788872607.932426:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327637120:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.932451:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.932477:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327637632:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.932498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.932513:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327638144:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.932545:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.932586:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327638656:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.932608:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.932639:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327637248:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.933920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.933955:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327637760:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.933983:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.934003:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327638272:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.934021:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.934049:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788872607.934056:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327637376:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.934078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.934094:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327637888:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.934126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.934146:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327638400:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.934164:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872607.934207:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327636992 00000100:00100000:2.0:1788872607.934215:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327636992 00000100:00100000:2.0:1788872607.934261:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327637760 00000100:00100000:2.0:1788872607.934264:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327637760 00000100:00100000:2.0:1788872607.934276:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327638272 00000100:00100000:2.0:1788872607.934278:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327638272 00000100:00100000:2.0:1788872607.934293:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:2.0:1788872607.934301:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327636992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872607.934339:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872607.934389:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327636992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (2143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872607.934397:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00100000:2.0:1788872607.934416:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:2.0:1788872607.934422:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327637760:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788872607.934438:0:8447:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c38b7480 x1875765327637760/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:533/0 lens 224/224 e 0 to 0 dl 1788872618 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872607.934468:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327637760:12345-0@lo:400:kworker.0 Request processed in 46us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872607.934474:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00100000:2.0:1788872607.934486:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:2.0:1788872607.934491:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327638272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.934516:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327638272:12345-0@lo:400:kworker.0 Request processed in 24us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872607.934547:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00100000:2.0:1788872607.934597:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327637504 00000100:00100000:2.0:1788872607.934602:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327637504 00000100:00100000:2.0:1788872607.934636:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327637632 00000100:00100000:2.0:1788872607.934640:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327637632 00000100:00100000:3.0:1788872607.936474:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327638144 00000100:00100000:3.0:1788872607.936488:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327638144 00000100:00100000:3.0:1788872607.936539:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327638656 00000100:00100000:3.0:1788872607.936543:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327638656 00000100:00100000:3.0:1788872607.936570:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327637248 00000100:00100000:3.0:1788872607.936573:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327637248 00000100:00100000:3.0:1788872607.936585:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327637376 00000100:00100000:3.0:1788872607.936588:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327637376 00000100:00100000:3.0:1788872607.936605:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1788872607.936613:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327637504:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872607.936637:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f5ee9500 x1875765327637504/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:533/0 lens 224/224 e 0 to 0 dl 1788872618 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872607.936714:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327637504:12345-0@lo:400:kworker.0 Request processed in 101us (4398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872607.936722:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1788872607.936739:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1788872607.936746:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327637632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872607.937112:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327637632:12345-0@lo:400:kworker.0 Request processed in 366us (4612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872607.937120:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1788872607.937132:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1788872607.937139:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327638144:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872607.937150:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f5ee8000 x1875765327638144/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:533/0 lens 224/224 e 0 to 0 dl 1788872618 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872607.937191:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327638144:12345-0@lo:400:kworker.0 Request processed in 52us (4645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872607.937197:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1788872607.937209:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1788872607.937215:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327638656:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872607.937226:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f5eeaa00 x1875765327638656/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:533/0 lens 224/224 e 0 to 0 dl 1788872618 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872607.937251:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327638656:12345-0@lo:400:kworker.0 Request processed in 36us (4642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872607.937257:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1788872607.937267:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:3.0:1788872607.937273:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327637248:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872607.937282:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c38b6a00 x1875765327637248/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:533/0 lens 224/224 e 0 to 0 dl 1788872618 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872607.937308:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327637248:12345-0@lo:400:kworker.0 Request processed in 36us (3393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872607.937314:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:3.0:1788872607.937324:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:3.0:1788872607.937330:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327637376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872607.937353:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327637376:12345-0@lo:400:kworker.0 Request processed in 24us (3275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872607.937359:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1788872607.937626:0:85123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327637120 00000100:00100000:0.0:1788872607.937633:0:85123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327637120 00000100:00100000:0.0:1788872607.937687:0:85123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788872607.937695:0:85123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327637120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872607.937899:0:85123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327637120:12345-0@lo:400:kworker.0 Request processed in 55us (5296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872607.937909:0:85123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788872607.937946:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327638016 00000100:00100000:0.0:1788872607.937950:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327638016 00000100:00100000:0.0:1788872607.937978:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327638528 00000100:00100000:0.0:1788872607.937981:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327638528 00000100:00100000:0.0:1788872607.938002:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327637888 00000100:00100000:0.0:1788872607.938005:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327637888 00000100:00100000:0.0:1788872607.938022:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327638400 00000100:00100000:0.0:1788872607.938025:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327638400 00000100:00100000:0.0:1788872607.938046:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:0.0:1788872607.938052:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327638016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872607.938088:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327638016:12345-0@lo:400:kworker.0 Request processed in 36us (5730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872607.938095:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00100000:0.0:1788872607.938107:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462 00000100:00100000:0.0:1788872607.938113:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327638528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872607.938140:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327638528:12345-0@lo:400:kworker.0 Request processed in 28us (5745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872607.938146:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462 00000100:00100000:0.0:1788872607.938159:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463 00000100:00100000:0.0:1788872607.938164:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327637888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872607.938191:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327637888:12345-0@lo:400:kworker.0 Request processed in 27us (4064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872607.938197:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463 00000100:00100000:0.0:1788872607.938207:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1788872607.938220:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327638400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872607.938250:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327638400:12345-0@lo:400:kworker.0 Request processed in 32us (4085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872607.938256:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464 00000100:00080000:2.0:1788872607.938422:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872607.938426:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872607.938430:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872607.938432:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872607.938610:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327637120:0@lo:400:kworker.0 00000100:00100000:3.0:1788872607.938725:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327637632:0@lo:400:kworker.0 00000100:00100000:3.0:1788872607.938743:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327638144:0@lo:400:kworker.0 00000100:00100000:3.0:1788872607.939161:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327638656:0@lo:400:kworker.0 00000100:00100000:3.0:1788872607.939182:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327636992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872607.939193:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327637504:0@lo:400:kworker.0 00000100:00100000:3.0:1788872607.939204:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327638016:0@lo:400:kworker.0 00000100:00100000:3.0:1788872607.939215:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327638528:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.940998:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327637376:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.941027:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327637888:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.941039:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327638400:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.941049:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327637248:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.941061:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327637760:0@lo:400:kworker.0 00000100:00100000:2.0:1788872607.941072:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327638272:0@lo:400:kworker.0 00010000:00010000:2.0:1788872607.994932:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788872608.050543:0:86341:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1788872608.208647:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872608.208769:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311140224 00000100:00100000:1.0:1788872608.208780:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311140224 00000100:00100000:1.0:1788872608.208853:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1091 00000100:00100000:1.0:1788872608.208864:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:66462:x1875765311140224:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:1.0:1788872608.208884:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872608.208908:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9ae0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae5d expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872608.208970:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9ae7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872608.208986:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872608.208999:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872608.209051:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788872608.209070:0:66190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788872608.209108:0:66190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872608.209131:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9ae0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae5d expref: 8 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872608.209149:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae5d expref: 7 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872608.209158:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c8112a00) 00010000:00010000:1.0:1788872608.209161:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788872608.209164:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9de00, rc 0) 00010000:00000080:1.0:1788872608.209172:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4f37800 x1875765311140224/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:534/0 lens 576/688 e 0 to 0 dl 1788872619 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872608.209227:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:66462:x1875765311140224:12345-192.168.204.39@tcp:101:touch.0 Request processed in 365us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872608.209235:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1091 00000100:00080000:2.0:1788872608.209854:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788872608.215675:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872608.215718:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311140352 00000100:00100000:2.0:1788872608.215728:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311140352 00000100:00100000:2.0:1788872608.215790:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1092 00000100:00100000:2.0:1788872608.215801:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:66462:x1875765311140352:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:2.0:1788872608.215825:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872608.215847:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9aee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae64 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.215939:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9af5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.215955:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.215967:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.215985:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9afc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.215992:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216000:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216104:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9b03 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216113:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9b03 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216121:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9b03 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872608.216158:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788872608.216162:0:68674:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788872608.216183:0:68674:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9b03 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216206:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9af5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216213:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9af5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216220:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9af5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216227:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9af5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216234:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872608.216238:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9af5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216246:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9af5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216258:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c8112a00) 00010000:00010000:2.0:1788872608.216262:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872608.216266:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9af5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216273:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01d9af5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216285:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216292:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9afc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216303:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9afc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216308:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872608.216311:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9afc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216318:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9afc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216326:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff98a9e1f8f400) 00010000:00010000:2.0:1788872608.216329:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872608.216332:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9afc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216338:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01d9afc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216365:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9c00/0xe4e6e89fb01d9aee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae64 expref: 9 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216379:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9b03 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae64 expref: 8 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.216387:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98a9e1f8fb00) 00010000:00010000:2.0:1788872608.216389:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788872608.216392:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9000, rc 0) 00010000:00000080:2.0:1788872608.216399:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c38b4000 x1875765311140352/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:534/0 lens 592/688 e 0 to 0 dl 1788872619 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872608.216474:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:66462:x1875765311140352:12345-192.168.204.39@tcp:101:touch.0 Request processed in 675us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872608.216481:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1092 00000100:00100000:2.0:1788872608.234186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872608.234224:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311140608 00000100:00100000:2.0:1788872608.234235:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311140608 00000100:00100000:2.0:1788872608.234294:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1093 00000100:00100000:2.0:1788872608.234305:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:66462:x1875765311140608:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:2.0:1788872608.234328:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872608.234351:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01d9b0a lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae6b expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.234462:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01d9b11 lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.234477:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01d9b11 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.234488:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01d9b11 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.234503:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01d9b18 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.234511:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01d9b18 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.234532:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01d9b18 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235000:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235010:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235017:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872608.235054:0:66192:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1788872608.235057:0:66192:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 0 -> 1788872608 00000004:00010000:2.0:1788872608.235060:0:66192:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 0 -> 1788872608 00000004:00010000:2.0:1788872608.235062:0:66192:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 0 -> 1788872608 00000004:00010000:2.0:1788872608.235065:0:66192:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:2.0:1788872608.235069:0:66192:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:2.0:1788872608.235075:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01d9b11 lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235082:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01d9b11 lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235089:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01d9b11 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235096:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01d9b11 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235103:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872608.235107:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01d9b11 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235125:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01d9b11 lrc: 5/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235138:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98a9e1f8fb00) 00010000:00010000:2.0:1788872608.235141:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872608.235145:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01d9b11 lrc: 3/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235153:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01d9b11 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872608.235167:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000346af18f reply state 00000000dd31dd23 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01d9b18 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235178:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01d9b18 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235184:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff98a9e1f8f100) 00010000:00010000:2.0:1788872608.235187:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872608.235189:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788872608.235219:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01d9b0a lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 11 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235233:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 10 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872608.235240:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:2.0:1788872608.235243:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1788872608.235245:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5e00, rc 0) 00010000:00000080:2.0:1788872608.235259:0:66192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c38b6300 x1875765311140608/t103079215111(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:534/0 lens 752/824 e 0 to 0 dl 1788872619 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872608.235328:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:66462:x1875765311140608:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1025us (1153us total) trans 103079215111 rc 0/0 00000100:00100000:2.0:1788872608.235336:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1093 00000100:00100000:2.0:1788872608.248788:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872608.248861:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311140864 00000100:00100000:3.0:1788872608.248872:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311140864 00000100:00100000:3.0:1788872608.248928:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1094 00000100:00100000:3.0:1788872608.248938:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:66462:x1875765311140864:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:3.0:1788872608.249066:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872608.249084:0:66190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 11 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872608.249095:0:66190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872608.249135:0:66190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 11 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872608.249169:0:66190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 11 pid: 66192 timeout: 3645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872608.249186:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66190:1875765327638784:192.168.204.39@tcp:104: 00000100:00100000:3.0:1788872608.249282:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788872608.257928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872608.258068:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311140992 00000100:00100000:1.0:1788872608.258079:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311140992 00010000:00010000:1.0:1788872608.258119:0:26197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 12 pid: 66192 timeout: 3645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872608.258161:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2552 00000100:00100000:1.0:1788872608.258171:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2404:x1875765311140992:12345-192.168.204.39@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1788872608.258186:0:26197:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 12 pid: 66192 timeout: 3645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872608.258211:0:26197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 12 pid: 66192 timeout: 3645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872608.258223:0:26197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 12 pid: 66192 timeout: 3645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872608.258232:0:26197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:1.0:1788872608.258235:0:26197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1788872608.258239:0:26197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872608.258247:0:26197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872608.258253:0:26197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872608.258275:0:26197:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 12 pid: 66192 timeout: 3645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872608.258332:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2404:x1875765311140992:12345-192.168.204.39@tcp:102:ldlm_bl.0 Request processed in 162us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872608.258340:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2552 00000100:00100000:3.0:1788872608.258583:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66190:1875765327638784:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788872608.258603:0:66190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872608.258613:0:66190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872608.258619:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872608.258769:0:66190:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1788872608.258772:0:66190:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 1788872608 -> 1788872608 00000004:00010000:3.0:1788872608.258775:0:66190:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 1788872608 -> 1788872608 00000004:00010000:3.0:1788872608.258777:0:66190:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 1788872608 -> 1788872608 00000004:00010000:3.0:1788872608.258779:0:66190:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:3.0:1788872608.258786:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c7b5cb5 reply state 00000000ab16bbee transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872608.258798:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872608.258805:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:3.0:1788872608.258815:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872608.258818:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1788872608.258936:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c38b5c00 x1875765311140864/t103079215112(0) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:534/0 lens 488/456 e 0 to 0 dl 1788872619 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872608.258979:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:66462:x1875765311140864:12345-192.168.204.39@tcp:36:touch.0 Request processed in 10043us (10201us total) trans 103079215112 rc 0/0 00000100:00100000:3.0:1788872608.258987:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1094 00000100:00100000:0.0:1788872608.264898:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872608.264979:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311141248 00000100:00100000:3.0:1788872608.264989:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311141248 00000100:00100000:3.0:1788872608.265049:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 218 00000100:00100000:3.0:1788872608.265063:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:66462:x1875765311141248:12345-192.168.204.39@tcp:35:touch.0 00010000:00000080:3.0:1788872608.265281:0:66194:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4f34e00 x1875765311141248/t103079215113(0) o35->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:534/0 lens 392/456 e 0 to 0 dl 1788872619 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872608.265383:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+14:66462:x1875765311141248:12345-192.168.204.39@tcp:35:touch.0 Request processed in 324us (493us total) trans 103079215113 rc 0/0 00000100:00100000:3.0:1788872608.265392:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 218 00000100:00100000:2.0:1788872608.441150:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327638912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872608.441231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872608.441277:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872608.441284:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327639040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872608.441321:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872608.441357:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327638912 00000100:00100000:2.0:1788872608.441364:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327638912 00000100:00100000:2.0:1788872608.441411:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327639040 00000100:00100000:2.0:1788872608.441414:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327639040 00000100:00100000:2.0:1788872608.441434:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:2.0:1788872608.441442:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327638912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872608.441476:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872608.441536:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327638912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872608.441544:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:0.0:1788872608.441833:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327639168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872608.441866:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872608.442007:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327639168 00000100:00100000:2.0:1788872608.442012:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327639168 00000100:00100000:2.0:1788872608.442030:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:2.0:1788872608.442036:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327639040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872608.442048:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872608.442076:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327639040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872608.442098:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:2.0:1788872608.442111:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:2.0:1788872608.442117:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327639168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872608.442132:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872608.442269:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327639168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872608.442276:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:2.0:1788872608.442334:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327639040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872608.442350:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327638912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872608.442864:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872608.442874:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327639424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872608.442908:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872608.442934:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327639424 00000100:00100000:1.0:1788872608.442938:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327639424 00000100:00100000:1.0:1788872608.442972:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:1.0:1788872608.442978:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327639424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872608.442990:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872608.443020:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327639424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872608.443026:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00100000:1.0:1788872608.443054:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327639424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872608.443852:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327639296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872608.443895:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872608.444179:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327639296 00000100:00100000:1.0:1788872608.444185:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327639296 00000100:00100000:1.0:1788872608.444229:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:1.0:1788872608.444236:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327639296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788872608.444268:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00010000:00000080:1.0:1788872608.444283:0:8447:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c38b4a80 x1875765327639296/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:534/0 lens 224/368 e 0 to 0 dl 1788872619 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872608.444338:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327639296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872608.444345:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00100000:2.0:1788872608.444504:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327639296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872608.447521:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327639168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788872609.016879:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872609.034408:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872609.034471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872609.034526:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872609.034603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872609.034636:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872609.034681:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311141760 00000100:00100000:0.0:1788872609.034695:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311141760 00000100:00100000:0.0:1788872609.034781:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311141888 00000100:00100000:0.0:1788872609.034785:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311141888 00000100:00100000:0.0:1788872609.034813:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2465 00000100:00100000:0.0:1788872609.034825:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311141760:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872609.034921:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311141760:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 99us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872609.034930:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2465 00000100:00100000:0.0:1788872609.034949:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2466 00000100:00100000:0.0:1788872609.034956:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311141888:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872609.035005:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311141888:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 49us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872609.035013:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2466 00000100:00080000:0.0:1788872609.035034:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872609.035038:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872609.035255:0:85126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311141376 00000100:00100000:1.0:1788872609.035261:0:85126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311141376 00000100:00100000:1.0:1788872609.035304:0:85126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 84 00000100:00100000:1.0:1788872609.035312:0:85126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311141376:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872609.035348:0:85126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311141376:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 37us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872609.035355:0:85126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 84 00000100:00100000:2.0:1788872609.036229:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311141504 00000100:00100000:2.0:1788872609.036239:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311141504 00000100:00100000:2.0:1788872609.036296:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311141632 00000100:00100000:2.0:1788872609.036300:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311141632 00000100:00100000:2.0:1788872609.036403:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1106 00000100:00100000:2.0:1788872609.036414:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+14:2404:x1875765311141504:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000080:2.0:1788872609.036455:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4f37b80 x1875765311141504/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:535/0 lens 224/224 e 0 to 0 dl 1788872620 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872609.036523:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+14:2404:x1875765311141504:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 111us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872609.036532:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1106 00000100:00100000:2.0:1788872609.036613:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1107 00000100:00100000:2.0:1788872609.036620:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311141632:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872609.036648:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311141632:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 29us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872609.036654:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1107 00000100:00080000:3.0:1788872609.036712:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788872610.045379:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788872611.025695:0:86439:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788872611.025795:0:86439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.025816:0:86439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.025825:0:86439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.025833:0:86439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.025862:0:86439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872611.026035:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872611.026045:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872611.026054:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872611.026059:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872611.026070:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872611.026098:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872611.026104:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788872611.026107:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:3.0:1788872611.026156:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872611.026163:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872611.026201:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872611.026209:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01d96aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d96b1 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872611.026225:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872611.026227:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872611.026228:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872611.026245:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872611.026269:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327639552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872611.026367:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788872611.026401:0:86439:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 10000000:01000000:0.0:1788872611.026407:0:86439:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788872611.026439:0:86439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788872611.026444:0:86439:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788872611.026451:0:86439:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788872611.026478:0:86439:0:(import.c:65:import_set_state_nolock()) ffff98a9ff63f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788872611.029652:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327639680:0@lo:39:umount.0 00000100:00100000:0.0:1788872611.029759:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872611.029844:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327639680 00000100:00100000:0.0:1788872611.030012:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327639680 00000100:00100000:0.0:1788872611.030075:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1788872611.030084:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875765327639680:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788872611.030122:0:66193:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d97a6 00000100:00080000:0.0:1788872611.030140:0:66193:0:(import.c:65:import_set_state_nolock()) ffff98a9ff60b800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1788872611.030181:0:66193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4f36d80 x1875765327639680/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:537/0 lens 224/224 e 0 to 0 dl 1788872622 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872611.030228:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1875765327639680:12345-0@lo:39:umount.0 Request processed in 145us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872611.030247:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000020:00000080:0.0:1788872611.030261:0:66193:0:(genops.c:906:class_export_put()) final put ffff98a9ff609800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1788872611.030399:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ff63f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788872611.030411:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327639680:0@lo:39:umount.0 00000100:00080000:0.0:1788872611.030450:0:86439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788872611.030453:0:86439:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788872611.030458:0:86439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788872611.031978:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872611.034168:0:86439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034192:0:86439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034200:0:86439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034209:0:86439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034258:0:86439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872611.034266:0:86439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034274:0:86439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034280:0:86439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034286:0:86439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034310:0:86439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788872611.034317:0:86439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034324:0:86439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034330:0:86439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034337:0:86439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034350:0:86439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788872611.034356:0:86439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034370:0:86439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034376:0:86439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034384:0:86439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.034397:0:86439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788872611.034401:0:86439:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788872611.034438:0:86439:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788872611.034445:0:86439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1788872611.034450:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788872611.034456:0:86439:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1788872611.035637:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788872611.035653:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.035664:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440a00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872611.035669:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.035680:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872611.035688:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872611.035694:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788872611.035698:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788872611.035701:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788872611.036006:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036013:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872611.036051:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036080:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5440a00/0xe4e6e89fb01d95c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d95ca expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036099:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788872611.036103:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036109:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8e00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872611.036112:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036119:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872611.036126:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872611.036132:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788872611.036140:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788872611.036142:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788872611.036158:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036164:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872611.036171:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036177:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01d96cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d96d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036198:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788872611.036201:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036206:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872611.036209:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036215:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872611.036221:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872611.036226:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788872611.036228:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788872611.036231:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788872611.036243:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036248:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872611.036264:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036270:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8800/0xe4e6e89fb01d969c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d96a3 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788872611.036271:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff609800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1788872611.036278:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872611.036282:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036305:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872611.036309:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036315:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872611.036321:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872611.036326:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788872611.036328:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788872611.036330:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788872611.036343:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788872611.036345:0:30879:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ff60b800 for lustre-MDT0000 00010000:00010000:2.0:1788872611.036349:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872611.036354:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872611.036359:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872611.036361:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01d95b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d95bc expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872611.036366:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872611.036369:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872611.036371:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872611.036372:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872611.036379:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872611.036400:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327639808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872611.036498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872611.036543:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872611.036574:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327639936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872611.036606:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872611.036647:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327639552 00000100:00100000:2.0:1788872611.036656:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327639552 00000100:00100000:2.0:1788872611.036710:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327639808 00000100:00100000:2.0:1788872611.036714:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327639808 00000100:00100000:2.0:1788872611.036732:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327639936 00000100:00100000:2.0:1788872611.036734:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327639936 00000100:00100000:2.0:1788872611.036772:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1788872611.036783:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+26:3646:x1875765327639552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872611.036799:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872611.036818:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5441200/0xe4e6e89fb01d96b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d96aa expref: 26 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.036833:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872611.036931:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1788872611.036939:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3644:x1875765327639808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872611.036950:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872611.036966:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01d95ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d95c3 expref: 25 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872611.036976:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872611.037000:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1788872611.037011:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327639936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872611.037026:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872611.037035:0:26197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c58af600/0xe4e6e89fb01d96d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d96cd expref: 24 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872611.037046:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872611.037420:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3646:x1875765327639552:12345-0@lo:103:ldlm_bl.0 Request processed in 638us (11052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872611.037428:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1788872611.037458:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327640192:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1788872611.040006:0:86439:0:(mdt_handler.c:8248:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:0.0:1788872611.040992:0:85118:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00000020:00000080:0.0:1788872611.041069:0:86439:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1788872611.041080:0:86439:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9e98d5000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788872611.041086:0:86439:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9e98d0800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788872611.041091:0:86439:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9c5f15000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788872611.041096:0:86439:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9e99ab800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788872611.041104:0:86439:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9e99ab000 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 192.168.204.39@tcp 10 (0 0 3) 0 0 0 2: ffff98a9c4878000 103079215113 stale:0 00000020:00080000:0.0:1788872611.041111:0:86439:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff98a8c72e99c0) has exports, disconnecting them 00000020:00080000:0.0:1788872611.041118:0:86439:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9e98d5000), last request at 1788872572 00000020:00000080:0.0:1788872611.041126:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d979f 00000100:00080000:0.0:1788872611.041148:0:86439:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788872611.041174:0:86439:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9e98d5000): rc 0 00000020:00000080:0.0:1788872611.041177:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9e98d5000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788872611.041190:0:86439:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9e98d0800), last request at 1788872607 00000020:00000080:0.0:1788872611.041194:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9798 00000100:00080000:0.0:1788872611.041199:0:86439:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d6000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788872611.041209:0:86439:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9e98d0800): rc 0 00000020:00000080:0.0:1788872611.041211:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9e98d0800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788872611.041215:0:86439:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9c5f15000), last request at 1788872607 00000020:00000080:0.0:1788872611.041218:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9791 00000100:00080000:0.0:1788872611.041223:0:86439:0:(import.c:65:import_set_state_nolock()) ffff98a9c5f16800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788872611.041234:0:86439:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9c5f15000): rc 0 00000020:00000080:0.0:1788872611.041236:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9c5f15000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788872611.041240:0:86439:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9e99ab800), last request at 1788872566 00000020:00000080:0.0:1788872611.041247:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d961e 00000100:00080000:0.0:1788872611.041259:0:86439:0:(import.c:65:import_set_state_nolock()) ffff98a9ff60d000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788872611.041423:0:86439:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9e99ab800): rc 0 00000020:00000080:0.0:1788872611.041425:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9e99ab800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1788872611.041431:0:86439:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.39@tcp (ffff98a9e99ab000), last request at 1788872609 00000020:00000080:0.0:1788872611.041435:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9617 00000020:00010000:0.0:1788872611.041442:0:86439:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9e99ab000: total 4 00000100:00080000:0.0:1788872611.041446:0:86439:0:(import.c:65:import_set_state_nolock()) ffff98a8c6777000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788872611.041452:0:86439:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a9e99ab000): rc 0 00000004:00000080:0.0:1788872611.041460:0:86439:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb002c1a1fae0 00000100:00080000:0.0:1788872611.041494:0:86439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788872611.041498:0:86439:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788872611.043263:0:86439:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788872611.043406:0:86439:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe91800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788872611.043485:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327640320:0@lo:39:umount.0 00000100:00100000:2.0:1788872611.047007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872611.047030:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3644:x1875765327639808:12345-0@lo:103:ldlm_bl.0 Request processed in 10087us (10528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872611.047047:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1788872611.047082:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872611.047098:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327640064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872611.047150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872611.047198:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327640192 00000100:00100000:2.0:1788872611.047209:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327640192 00000100:00100000:2.0:1788872611.047282:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327640064 00000100:00100000:2.0:1788872611.047286:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327640064 00000100:00100000:2.0:1788872611.047316:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1788872611.047346:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df440a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327640192:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872611.047364:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00010000:00010000:2.0:1788872611.047366:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788872611.047370:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df441880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3647:x1875765327640064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872611.047377:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872611.047393:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d96a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d969c expref: 23 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.047393:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c58afa00/0xe4e6e89fb01d95bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d95b5 expref: 23 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872611.047413:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872611.047413:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872611.047447:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df441880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3647:x1875765327640064:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872611.047455:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000020:00010000:3.0:1788872611.047490:0:6508:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9e99ab000: total 4 00000100:00100000:0.0:1788872611.047667:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872611.047842:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327640320 00000100:00100000:0.0:1788872611.047847:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327640320 00000100:00100000:0.0:1788872611.047956:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:0.0:1788872611.047965:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327640320:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788872611.047998:0:8446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d965d 00000100:00080000:0.0:1788872611.048009:0:8446:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788872611.048027:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411435 00000100:00100000:0.0:1788872611.048210:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3643:x1875765327640320:12345-0@lo:39:umount.0 Request processed in 247us (543us total) trans 77309411436 rc 0/0 00000100:00100000:0.0:1788872611.048217:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00010000:00010000:3.0:1788872611.048693:0:6508:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9e99ab000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1788872611.048743:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9b03 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae64 expref: 6 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872611.048776:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01d9ae7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae5d expref: 5 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872611.048797:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01d9b1f lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 4 pid: 66192 timeout: 3645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872611.048828:0:6508:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9e99ab000, canceled 3 locks, left on hash table 0. 00000100:00080000:0.0:1788872611.051524:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe91800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788872611.051546:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327640320:0@lo:39:umount.0 00000100:00100000:2.0:1788872611.052228:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df440a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3647:x1875765327640192:12345-0@lo:103:ldlm_bl.0 Request processed in 4878us (5226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872611.052427:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00010000:00010000:2.0:1788872611.052513:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01d9b18 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052525:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01d9b18 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052534:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01d9b18 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052542:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872611.052568:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01d9b18 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052578:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01d9b18 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052598:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff98a9e1f8f100) 00010000:00010000:2.0:1788872611.052601:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872611.052606:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01d9b18 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052613:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01d9b18 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052665:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052672:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052678:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052683:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deae00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872611.052687:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052693:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052703:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:2.0:1788872611.052706:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872611.052709:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872611.052714:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deae00/0xe4e6e89fb01d9b2d lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872611.052990:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:3644:x1875765327639936:12345-0@lo:103:ldlm_bl.0 Request processed in 15979us (16380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872611.053001:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000020:00000080:1.0:1788872611.053084:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e98d5000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788872611.053167:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e98d0800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788872611.053201:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c5f15000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788872611.053221:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ab800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00010000:00010000:2.0:1788872611.054444:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872611.054452:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872611.054509:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327639936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872611.054521:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327639808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872611.054682:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872611.054721:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327640064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872611.054732:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327640192:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788872611.055005:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e98d3000 for lustre-MDT0000 00000020:00000080:1.0:1788872611.055015:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e98d6000 for lustre-MDT0000 00000020:00000080:1.0:1788872611.055020:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c5f16800 for lustre-MDT0000 00000020:00000080:1.0:1788872611.055024:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ff60d000 for lustre-MDT0000 00000100:00080000:0.0:1788872611.056193:0:86439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788872611.056202:0:86439:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 3 00000004:00080000:0.0:1788872611.056228:0:86439:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788872611.056567:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327639552:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788872611.057395:0:86439:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788872611.057448:0:86439:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788872611.057495:0:86439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788872611.057499:0:86439:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 3 00000004:00080000:0.0:1788872611.057520:0:86439:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:0.0:1788872611.057628:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327640448:0@lo:9:umount.0 00000100:00100000:0.0:1788872611.057740:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872611.057959:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327640448 00000100:00100000:2.0:1788872611.057970:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327640448 00000100:00100000:2.0:1788872611.058054:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5938 00000100:00100000:2.0:1788872611.058067:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327640448:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788872611.058102:0:26199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d966b 00000100:00080000:2.0:1788872611.058115:0:26199:0:(import.c:65:import_set_state_nolock()) ffff98a8c5117800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788872611.058169:0:26199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:2.0:1788872611.059002:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+2:3643:x1875765327640448:12345-0@lo:9:umount.0 Request processed in 935us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872611.059012:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5938 00000100:00080000:2.0:1788872611.059042:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788872611.059054:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788872611.059481:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788872611.059503:0:3643:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:0.0:1788872611.059505:0:3643:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:0.0:1788872611.059509:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327640448:0@lo:9:umount.0 00000100:00080000:0.0:1788872611.059589:0:86439:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788872611.060067:0:86439:0:(import.c:65:import_set_state_nolock()) ffff98a9ee838000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788872611.060157:0:86439:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98a8c72e99c0) has no exports 00000100:00100000:1.0:1788872611.061076:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327640576:0@lo:9:umount.0 00000100:00100000:1.0:1788872611.061161:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872611.061231:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327640576 00000100:00100000:1.0:1788872611.061254:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327640576 00000100:00100000:1.0:1788872611.061385:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5939 00000100:00100000:1.0:1788872611.061396:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327640576:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788872611.061428:0:26192:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9687 00000100:00080000:1.0:1788872611.061439:0:26192:0:(import.c:65:import_set_state_nolock()) ffff98a9ee83d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788872611.061508:0:26192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:1.0:1788872611.061702:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3643:x1875765327640576:12345-0@lo:9:umount.0 Request processed in 307us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872611.061729:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5939 00000100:00080000:1.0:1788872611.061752:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788872611.061767:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788872611.061796:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ee838000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788872611.061810:0:3643:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:1.0:1788872611.061812:0:3643:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872611.061815:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327640576:0@lo:9:umount.0 00010000:00010000:1.0:1788872611.065280:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788872611.065539:0:86439:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98a8c72e99c0) has no exports 00000020:00000080:3.0:1788872611.101729:0:6508:0:(genops.c:906:class_export_put()) final put ffff98a9e99ab000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00010000:00010000:3.0:1788872611.101819:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872611.101822:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872611.101825:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788872611.102414:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ab000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-MDT0000 00000020:00000080:1.0:1788872611.102506:0:30879:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c6777000 for lustre-MDT0000 00000020:00000080:0.0:1788872611.219162:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9633 00000020:00000080:0.0:1788872611.219186:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9df96b000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788872611.219538:0:86439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788872611.223054:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788872611.223083:0:86439:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788872611.223090:0:86439:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98a9e9b0cd40) has no exports 00000020:00000080:0.0:1788872611.223980:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d962c 00000020:00000080:0.0:1788872611.223993:0:86439:0:(genops.c:906:class_export_put()) final put ffff98aa002c7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788872611.232611:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9df96b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788872611.235893:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa002c7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788872611.236505:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872611.236528:0:86439:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788872611.236536:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9fbfab800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788872611.236540:0:86439:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9fbfab800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788872611.236565:0:86439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788872611.236793:0:86439:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9c5d23c00 - data ffff98a9e90df870/ffff98a8c5c2fc00 00000020:01000000:2.0:1788872611.236977:0:86439:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9ef8d0840 - data ffff98a9e9140e58/ffff98a9c5d55000 00000100:00080000:3.0:1788872611.344472:0:86439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788872611.344487:0:86439:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788872611.344509:0:86439:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98a8c4f34a80 x1875765327640320/t77309411436(77309411436) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872621 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872611.344572:0:86439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788872611.361161:0:86439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788872611.361172:0:86439:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 4 00000004:00080000:3.0:1788872611.361196:0:86439:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872611.361200:0:86439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788872611.362222:0:85137:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788872611.362230:0:85137:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:0.0:1788872611.362264:0:85137:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:3.0:1788872611.363631:0:86439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788872611.363640:0:86439:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 4 00000004:00080000:3.0:1788872611.363659:0:86439:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872611.363662:0:86439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788872611.365425:0:85139:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788872611.365434:0:85139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:0.0:1788872611.365454:0:85139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:2.0:1788872611.374285:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d95df 00000020:00000080:2.0:1788872611.374304:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9c8f55000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788872611.375480:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d95f4 00000020:00000080:2.0:1788872611.375492:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a8c37f2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872611.376486:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c8f55000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788872611.379041:0:86439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788872611.379070:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872611.379088:0:86439:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788872611.379095:0:86439:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff98a8c72eb380) has no exports 00000004:01000000:2.0:1788872611.379343:0:86439:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788872611.379354:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9680 00000020:00000080:2.0:1788872611.379365:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a8c37f1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872611.384167:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c37f2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788872611.384471:0:86439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788872611.384484:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872611.384505:0:86439:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788872611.384512:0:86439:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff98a9f6714d40) has no exports 00000020:00000080:2.0:1788872611.384523:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9679 00000020:00000080:2.0:1788872611.384534:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9ee83d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788872611.385500:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c37f1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788872611.385520:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ee83d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788872611.386797:0:86439:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788872611.386805:0:86439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788872611.386811:0:86439:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 5 00000004:00080000:2.0:1788872611.386820:0:86439:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788872611.386823:0:86439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788872611.386947:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ee838000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788872611.387010:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872611.387027:0:86439:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872611.387034:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9cb5ed800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788872611.387038:0:86439:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb5ed800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788872611.387045:0:86439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872611.387161:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9664 00000020:00000080:2.0:1788872611.387169:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9cb5ec000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788872611.387215:0:86439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788872611.387220:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872611.387227:0:86439:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788872611.387231:0:86439:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff98a9f6713380) has no exports 00000020:00000080:2.0:1788872611.387248:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9656 00000020:00000080:2.0:1788872611.387254:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9c8f4a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788872611.391987:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb5ec000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788872611.396407:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c8f4a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788872611.397111:0:86439:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788872611.397118:0:86439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788872611.397147:0:86439:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 5 00000004:00080000:2.0:1788872611.397157:0:86439:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788872611.397160:0:86439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788872611.397474:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872611.397493:0:86439:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788872611.397512:0:86439:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788872611.397521:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9648 00000020:00000080:2.0:1788872611.397534:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9cb5ec800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872611.402990:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c37f5000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788872611.403021:0:52416:0:(genops.c:906:class_export_put()) final put ffff98a9cb5e8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872611.403026:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb5e8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788872611.403036:0:52416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788872611.404052:0:86439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788872611.404082:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872611.404101:0:86439:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788872611.404107:0:86439:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff98a8c72e8000) has no exports 00000020:00000080:2.0:1788872611.404118:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9641 00000020:00000080:2.0:1788872611.404127:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9f0837800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788872611.406032:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb5ec800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788872611.406050:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f0837800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788872611.407634:0:86439:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788872611.407644:0:86439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788872611.407649:0:86439:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788872611.407658:0:86439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788872611.407727:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872611.407747:0:86439:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872611.407780:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872611.407785:0:86439:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872611.407791:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9f0830000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872611.407795:0:86439:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f0830000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788872611.407828:0:86439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872611.407978:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d95fb 00000020:00000080:3.0:1788872611.407988:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a8c37f0000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788872611.407995:0:86439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788872611.407999:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872611.408004:0:86439:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788872611.408009:0:86439:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff98a8c72ecd40) has no exports 00000020:00000080:3.0:1788872611.408032:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872611.408035:0:86439:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788872611.408040:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9602 00000020:00000080:3.0:1788872611.408044:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a8c37f1800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788872611.408054:0:86439:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9fa733800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788872611.408058:0:86439:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9fa733800 3 00000020:01000004:3.0:1788872611.408062:0:86439:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a9fa733800 from lustre-MDT0000 00000020:00000080:3.0:1788872611.408081:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872611.408085:0:86439:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788872611.408088:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9c8f56800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788872611.408091:0:86439:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c8f56800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788872611.408098:0:86439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788872611.408130:0:86439:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788872611.408135:0:86439:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788872611.408138:0:86439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788872611.408141:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872611.408144:0:86439:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788872611.408155:0:86439:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98a9c5f12000 8a09bb38-f574-4ce9-b65f-ec6facc58f7e 192.168.204.39@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788872611.408162:0:86439:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98a9fbfa9800 f2e885a0-f180-4b85-9f87-6a01e20afd1a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788872611.408167:0:86439:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff98a9efa78000) has exports, disconnecting them 00000020:00080000:3.0:1788872611.408172:0:86439:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.39@tcp (ffff98a9c5f12000), last request at 1788872578 00000020:00000080:3.0:1788872611.408197:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d99d6 00000020:00010000:3.0:1788872611.408202:0:86439:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9c5f12000: total 2 00000100:00080000:3.0:1788872611.408206:0:86439:0:(import.c:65:import_set_state_nolock()) ffff98a8c5115800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788872611.408227:0:86439:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a9c5f12000): rc 0 00000020:00080000:3.0:1788872611.408230:0:86439:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98a9fbfa9800), last request at 1788872566 00000020:00000080:3.0:1788872611.408300:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d95ae 00000020:00010000:3.0:1788872611.408305:0:86439:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9fbfa9800: total 2 00000100:00080000:3.0:1788872611.408308:0:86439:0:(import.c:65:import_set_state_nolock()) ffff98a9fbfae800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788872611.408319:0:86439:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9fbfa9800): rc 0 00000020:00080000:3.0:1788872611.408324:0:86439:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff98a9efa78000) has no exports 00000100:00100000:3.0:1788872611.408395:0:85125:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98a8c4e12000:85125] 1 exiting: rc = 0 00000100:00100000:0.0:1788872611.411051:0:85123:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98aa0029ce00:85123] 0 exiting: rc = 1 00000100:00100000:0.0:1788872611.411199:0:85130:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff98a9f67d6e00:85130] 4 exiting: rc = 0 00000020:00000080:0.0:1788872611.412506:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9dfe91800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788872611.412520:0:52416:0:(genops.c:906:class_export_put()) final put ffff98a9c6ae2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872611.412525:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c6ae2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788872611.412532:0:52416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872611.412669:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c37f0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788872611.412675:0:52416:0:(genops.c:906:class_export_put()) final put ffff98a8c37f7000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788872611.412677:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c37f7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788872611.412681:0:52416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788872611.412715:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c37f1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788872611.413602:0:14981:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9c5f12000: total 0 00010000:00010000:0.0:1788872611.413609:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872611.413658:0:14981:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9c5f12000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788872611.413702:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5dea800/0xe4e6e89fb01d99f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae25 expref: 5 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.413726:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5441400/0xe4e6e89fb01d99dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae10 expref: 4 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.413740:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5debe00/0xe4e6e89fb01d99eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae1e expref: 3 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.413752:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5debc00/0xe4e6e89fb01d99e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae17 expref: 2 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.413761:0:14981:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9c5f12000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788872611.413799:0:14981:0:(genops.c:906:class_export_put()) final put ffff98a9c5f12000/8a09bb38-f574-4ce9-b65f-ec6facc58f7e 00000020:00010000:0.0:1788872611.413820:0:14981:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9fbfa9800: total 1 00010000:00010000:0.0:1788872611.413838:0:14981:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9fbfa9800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788872611.413855:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c58aec00/0xe4e6e89fb01d970c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9705 expref: 14 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788872611.414092:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c5f12000/8a09bb38-f574-4ce9-b65f-ec6facc58f7e for MGS 00000020:00000080:3.0:1788872611.414127:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c5115800 for MGS 00010000:00010000:0.0:1788872611.414173:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5441a00/0xe4e6e89fb01d978a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9783 expref: 13 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.414184:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c9600/0xe4e6e89fb01d971a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9713 expref: 12 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.414195:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c58ae200/0xe4e6e89fb01d9728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9721 expref: 11 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.414204:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5440800/0xe4e6e89fb01d9736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d972f expref: 10 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.414215:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c58aea00/0xe4e6e89fb01d9744 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d973d expref: 9 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.414225:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c8200/0xe4e6e89fb01d96e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d96db expref: 8 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.414234:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5deb400/0xe4e6e89fb01d9760 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9759 expref: 7 pid: 85126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.414252:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01d9752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d974b expref: 6 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.414264:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5deb200/0xe4e6e89fb01d96f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d96e9 expref: 5 pid: 85130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.414287:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5440600/0xe4e6e89fb01d976e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9767 expref: 4 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.414300:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c8a00/0xe4e6e89fb01d96fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d96f7 expref: 3 pid: 85125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.414311:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5440200/0xe4e6e89fb01d977c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9775 expref: 2 pid: 85123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872611.414321:0:14981:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9fbfa9800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788872611.414336:0:14981:0:(genops.c:906:class_export_put()) final put ffff98a9fbfa9800/f2e885a0-f180-4b85-9f87-6a01e20afd1a 00010000:00010000:0.0:1788872611.414350:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872611.414352:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872611.414354:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788872611.414441:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9fbfa9800/f2e885a0-f180-4b85-9f87-6a01e20afd1a for MGS 00000020:00000080:3.0:1788872611.414469:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9fbfae800 for MGS 00000100:00100000:0.0:1788872611.418486:0:85126:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98aa002ef000:85126] 2 exiting: rc = 0 00010000:00010000:3.0:1788872611.440748:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872611.445766:0:85128:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff98a8c5d47a00:85128] 3 exiting: rc = 0 00000100:00100000:0.0:1788872611.446160:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446182:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446190:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446198:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446205:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446213:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446219:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446226:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446233:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446856:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446926:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446933:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446940:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446948:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446956:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446963:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.446997:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447003:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447011:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447018:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447024:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447031:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447037:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447046:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447053:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447060:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447066:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447072:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447077:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447084:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447090:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447097:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447104:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447110:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447116:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447123:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447130:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447136:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447142:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447148:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447154:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447161:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447168:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447174:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447180:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447186:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447193:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447200:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447207:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447213:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447219:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447544:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447570:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447578:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447586:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447592:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447598:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447604:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447610:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447617:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447635:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447644:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447651:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872611.447658:0:86439:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788872611.463495:0:86439:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9ef8d0420 - data ffff98a9c6cbad80/ffff98a9c88be400 00000020:01000000:0.0:1788872611.463723:0:86439:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9ef8d0c00 - data ffff98a9e900bca8/ffff98a8c3a86800 00000020:00000080:0.0:1788872611.464942:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d95a7 00000020:00000080:0.0:1788872611.464956:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9f6789800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788872611.464982:0:86439:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9fa733800 from MGS, refs=2 00000020:01000004:0.0:1788872611.464987:0:86439:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9fa733800 2 00000020:01000004:0.0:1788872611.464990:0:86439:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a9fa733800 from MGS 00000020:00000080:0.0:1788872611.465018:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872611.465029:0:86439:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788872611.465032:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9f678e800/MGS 00000020:00000080:0.0:1788872611.465035:0:86439:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f678e800/MGS for MGS 00000020:01000000:0.0:1788872611.465044:0:86439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788872611.465143:0:86439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788872611.465147:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788872611.465160:0:86439:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788872611.465169:0:86439:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98a9ff63d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788872611.465175:0:86439:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff98a9f67119c0) has exports, disconnecting them 00000020:00080000:0.0:1788872611.465181:0:86439:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98a9ff63d800), last request at 1788872566 00000020:00000080:0.0:1788872611.465185:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d96bf 00000020:00080000:0.0:1788872611.465211:0:86439:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9ff63d800): rc 0 00000020:00000080:0.0:1788872611.465218:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9ff63d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788872611.466473:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f6789800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788872611.466490:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff63d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788872611.502638:0:86439:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788872611.502652:0:86439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788872611.502658:0:86439:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788872611.502668:0:86439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788872611.502706:0:30879:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ff63f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788872611.502888:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872611.502907:0:86439:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788872611.502915:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9ee83e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788872611.502919:0:86439:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ee83e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788872611.502933:0:86439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788872611.503042:0:86439:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9fa733800 1 00000020:00000080:3.0:1788872611.503050:0:86439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9599 00000020:00000080:3.0:1788872611.503059:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9f678e000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788872611.503083:0:86439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788872611.503092:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f678e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788872611.503102:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872611.503108:0:86439:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788872611.503112:0:86439:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff98a9f6710000) has no exports 00000020:00000080:3.0:1788872611.597214:0:86439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872611.597334:0:86439:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788872611.597343:0:86439:0:(genops.c:906:class_export_put()) final put ffff98a9fa732000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788872611.597349:0:86439:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9fa732000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788872611.597357:0:86439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788872611.597542:0:86439:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98a9fa734000 00000020:02000400:3.0:1788872611.597706:0:86439:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788872612.090019:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872613.052893:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327640960:0@lo:400:kworker.0 00000100:00100000:2.0:1788872613.052976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872613.053008:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327641472:0@lo:400:kworker.0 00000100:00100000:2.0:1788872613.053034:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872613.053061:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788872613.053067:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327641088:0@lo:400:kworker.0 00000100:00100000:2.0:1788872613.053088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872613.053103:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327641600:0@lo:400:kworker.0 00000100:00100000:2.0:1788872613.053120:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872613.053154:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327641472 00000100:00100000:2.0:1788872613.053164:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327641472 00000100:00100000:2.0:1788872613.053218:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327641600 00000100:00100000:2.0:1788872613.053222:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327641600 00000100:00100000:2.0:1788872613.053245:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:2.0:1788872613.053253:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327641472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872613.053321:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327641472:12345-0@lo:400:kworker.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872613.053535:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327640704:0@lo:400:kworker.0 00000400:00000100:0.0:1788872613.053581:0:3644:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327640704 offset 0 length 224: 4 00000100:00100000:0.0:1788872613.053614:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327641216:0@lo:400:kworker.0 00000100:00100000:0.0:1788872613.053635:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872613.053657:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327641728:0@lo:400:kworker.0 00000100:00100000:0.0:1788872613.053678:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872613.053698:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788872613.053703:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327640832:0@lo:400:kworker.0 00000100:00100000:0.0:1788872613.053724:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872613.053742:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327641344:0@lo:400:kworker.0 00000100:00100000:0.0:1788872613.053765:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872613.053792:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327640960 00000100:00100000:0.0:1788872613.053795:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327640960 00000100:00100000:0.0:1788872613.053825:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327641088 00000100:00100000:0.0:1788872613.053828:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327641088 00000100:00100000:0.0:1788872613.053838:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327641216 00000100:00100000:0.0:1788872613.053840:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327641216 00000100:00100000:0.0:1788872613.053852:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327641728 00000100:00100000:0.0:1788872613.053853:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327641728 00000100:00100000:0.0:1788872613.053860:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327640832 00000100:00100000:0.0:1788872613.053862:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327640832 00000100:00100000:0.0:1788872613.053871:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1788872613.053877:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327640960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872613.053912:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327640960:12345-0@lo:400:kworker.0 Request processed in 35us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872613.053919:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1788872613.053944:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1788872613.053950:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327641216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872613.053984:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327641216:12345-0@lo:400:kworker.0 Request processed in 34us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872613.053990:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1788872613.054003:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1788872613.054006:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875765327641088:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788872613.054012:0:66979:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788872613.054039:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875765327641088:12345-0@lo:400:kworker.0 Request processed in 31us (950us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788872613.054044:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1788872613.054055:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1788872613.054058:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875765327641728:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788872613.054063:0:66979:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788872613.054084:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875765327641728:12345-0@lo:400:kworker.0 Request processed in 25us (406us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788872613.054089:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1788872613.054099:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1788872613.054102:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875765327640832:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788872613.054106:0:66979:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788872613.054127:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875765327640832:12345-0@lo:400:kworker.0 Request processed in 23us (402us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788872613.054132:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00080000:0.0:1788872613.054172:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788872613.054177:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788872613.054180:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788872613.054192:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872613.054196:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3509 00000100:00080000:0.0:1788872613.054202:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872613.054226:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff53e300 x1875765327641856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872613.054246:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327640832:0@lo:400:kworker.0 00000100:00100000:0.0:1788872613.054262:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327641216:0@lo:400:kworker.0 00000100:00080000:0.0:1788872613.054270:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788872613.054273:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788872613.054276:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788872613.054278:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872613.054281:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3509 00000100:00080000:0.0:1788872613.054285:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872613.054295:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff53c380 x1875765327641984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872613.054306:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327641728:0@lo:400:kworker.0 00000100:00100000:2.0:1788872613.054388:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000100:00080000:1.0:1788872613.054693:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872613.054698:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872613.054700:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872613.054712:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327641344 00000100:00100000:1.0:1788872613.054717:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327641344 00000100:00100000:1.0:1788872613.054751:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:1.0:1788872613.054756:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1875765327641344:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788872613.054762:0:8447:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788872613.054799:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1875765327641344:12345-0@lo:400:kworker.0 Request processed in 42us (1033us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788872613.054806:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00100000:1.0:1788872613.054825:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327641856:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788872613.054853:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872613.054870:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327641984:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788872613.054902:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872613.055017:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468 00000100:00100000:2.0:1788872613.055027:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327641600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872613.055061:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327641600:12345-0@lo:400:kworker.0 Request processed in 38us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872613.055066:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468 00000100:00100000:2.0:1788872613.055085:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327641856 00000100:00100000:2.0:1788872613.055088:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327641856 00000100:00100000:2.0:1788872613.055106:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327641984 00000100:00100000:2.0:1788872613.055109:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327641984 00000100:00100000:2.0:1788872613.055122:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1788872613.055127:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327641856:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788872613.055145:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872613.055177:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327641856:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 49us (323us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872613.055184:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1788872613.055195:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1788872613.055199:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327641984:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788872613.055208:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872613.055231:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327641984:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (328us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872613.055236:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00080000:2.0:1788872613.055277:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788872613.055288:0:3646:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788872613.055292:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788872613.055296:0:3646:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872613.055299:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3509 00000100:00080000:2.0:1788872613.055304:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872613.055322:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3b49880 x1875765327642112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872613.055336:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327641088:0@lo:400:kworker.0 00000100:00100000:2.0:1788872613.055352:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327641600:0@lo:400:kworker.0 00000100:00100000:2.0:1788872613.055364:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327640960:0@lo:400:kworker.0 00000100:00100000:2.0:1788872613.055374:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327641472:0@lo:400:kworker.0 00000100:00080000:0.0:1788872613.055497:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788872613.055500:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788872613.055503:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788872613.055507:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872613.055510:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3509 00000100:00080000:0.0:1788872613.055514:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872613.055538:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff53ea00 x1875765327642240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872613.055574:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327641344:0@lo:400:kworker.0 00000100:00100000:0.0:1788872613.055606:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327642112:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788872613.055633:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872613.055664:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327642240:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788872613.055687:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788872613.055711:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872613.055716:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872613.055719:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327641856:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788872613.055728:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872613.055731:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872613.055733:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327641984:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788872613.055756:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327642240 00000100:00100000:0.0:1788872613.055759:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327642240 00000100:00100000:0.0:1788872613.055779:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:0.0:1788872613.055784:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327642240:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788872613.055794:0:8446:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872613.055826:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327642240:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (137us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872613.055832:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000100:00080000:0.0:1788872613.055852:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872613.055856:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872613.055859:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327642240:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788872613.059525:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327642112 00000100:00100000:2.0:1788872613.059542:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327642112 00000100:00100000:2.0:1788872613.059677:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1788872613.059685:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327642112:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788872613.059707:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872613.059792:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327642112:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 107us (4158us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872613.059800:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00080000:1.0:1788872613.066033:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872613.066046:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872613.066051:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327642112:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1788872613.118913:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872613.570944:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327642368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872613.571016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872613.571078:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327642368 00000100:00100000:2.0:1788872613.571095:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327642368 00000100:00100000:2.0:1788872613.571143:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:2.0:1788872613.571151:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327642368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872613.571179:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872613.572035:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327642368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 882us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872613.572044:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00100000:2.0:1788872613.572094:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327642368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872613.573847:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327642496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872613.573920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872613.575513:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327642496 00000100:00100000:1.0:1788872613.575525:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327642496 00000100:00100000:1.0:1788872613.575610:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:1.0:1788872613.575619:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327642496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872613.575651:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872613.575722:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327642496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872613.575729:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1788872613.576333:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327642496:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788872614.136837:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872614.153957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872614.154004:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000400:00000100:0.0:1788872614.154038:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311142016 offset 0 length 224: 4 00000100:00100000:0.0:1788872614.154057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872614.154090:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872614.154128:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311142144 00000100:00100000:0.0:1788872614.154142:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311142144 00000100:00100000:0.0:1788872614.154192:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311142272 00000100:00100000:0.0:1788872614.154196:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311142272 00000100:00100000:0.0:1788872614.154249:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1110 00000100:00100000:0.0:1788872614.154261:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311142272:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872614.154360:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311142272:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872614.154369:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1110 00000100:00100000:0.0:1788872614.154388:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1102 00000100:00100000:0.0:1788872614.154393:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2405:x1875765311142144:12345-192.168.204.39@tcp:400:kworker.0 00000020:00080000:0.0:1788872614.154399:0:66190:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.39@tcp 00000100:00100000:0.0:1788872614.154435:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2405:x1875765311142144:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 41us (489us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788872614.154444:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1102 00000100:00100000:0.0:1788872614.154466:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311142400 00000100:00100000:0.0:1788872614.154469:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311142400 00000100:00100000:0.0:1788872614.154495:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311142528 00000100:00100000:0.0:1788872614.154498:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311142528 00000100:00100000:0.0:1788872614.154520:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2469 00000100:00100000:0.0:1788872614.154526:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311142400:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872614.154602:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311142400:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 76us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872614.154609:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2469 00000100:00100000:0.0:1788872614.154623:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2470 00000100:00100000:0.0:1788872614.154628:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311142528:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872614.154651:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311142528:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 22us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872614.154657:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2470 00000100:00080000:3.0:1788872614.154925:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872614.154930:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872614.154933:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872614.161375:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872614.161441:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311142656 00000100:00100000:3.0:1788872614.161462:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311142656 00000100:00100000:3.0:1788872614.161514:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1103 00000100:00100000:3.0:1788872614.161522:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311142656:12345-192.168.204.39@tcp:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788872614.161546:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872614.161638:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311142656:12345-192.168.204.39@tcp:38:ptlrpcd_00_01.0 Request processed in 115us (273us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872614.161646:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1103 00010000:00010000:3.0:1788872615.162138:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872616.187177:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788872616.634724:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872616.634734:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a8c5113800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788872616.634901:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c5113800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788872616.634959:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c5117800 for lustre-OST0000 00000001:00100000:0.0:1788872616.639972:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872616.639983:0:9516:0:(genops.c:906:class_export_put()) final put ffff98a9ee838800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788872616.640921:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788872616.640934:0:75620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411436 is committed 00000020:00000080:1.0:1788872616.640938:0:75620:0:(genops.c:906:class_export_put()) final put ffff98a9e99a0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872616.643834:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ee838800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788872616.643913:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788872616.643958:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ee83d000 for lustre-OST0001 00000020:00000080:3.0:1788872616.643980:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e99a1000 for lustre-MDT0001 00010000:00010000:2.0:1788872617.208990:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788872618.168884:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872618.168890:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872618.168894:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872618.168902:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3550 00000100:00080000:3.0:1788872618.168907:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788872618.168914:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872618.168939:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1ca9f80 x1875765327642752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872618.168985:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872618.168989:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872618.168991:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872618.168995:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3550 00000100:00080000:3.0:1788872618.168998:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788872618.169001:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872618.169013:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f5eebb80 x1875765327643008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872618.169040:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872618.169043:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872618.169045:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872618.169048:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3550 00000100:00080000:3.0:1788872618.169051:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788872618.169054:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872618.169065:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f85c7480 x1875765327643264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872618.169117:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872618.169120:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872618.169122:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872618.169125:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3550 00000100:00080000:3.0:1788872618.169128:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788872618.169131:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872618.169142:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f85c4e00 x1875765327643648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872618.169178:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327642880:0@lo:400:kworker.0 00000100:00100000:3.0:1788872618.169247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872618.169287:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788872618.169293:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327643136:0@lo:400:kworker.0 00000100:00100000:3.0:1788872618.169316:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872618.169626:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327643392:0@lo:400:kworker.0 00000100:00100000:0.0:1788872618.169662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872618.169713:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788872618.169730:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327642624:0@lo:400:kworker.0 00000400:00000100:0.0:1788872618.169750:0:3646:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327642624 offset 0 length 224: 4 00000100:00100000:0.0:1788872618.169774:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327643520:0@lo:400:kworker.0 00000100:00100000:0.0:1788872618.169796:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872618.169829:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327642880 00000100:00100000:0.0:1788872618.169836:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327642880 00000100:00100000:0.0:1788872618.169882:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327643136 00000100:00100000:0.0:1788872618.169885:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327643136 00000100:00100000:0.0:1788872618.169911:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:0.0:1788872618.169919:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327642880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872618.169973:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327642880:12345-0@lo:400:kworker.0 Request processed in 55us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872618.169993:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:0.0:1788872618.170010:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1788872618.170016:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327643136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872618.170059:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327643136:12345-0@lo:400:kworker.0 Request processed in 43us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872618.170064:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1788872618.170097:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327643392 00000100:00100000:0.0:1788872618.170101:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327643392 00000100:00100000:0.0:1788872618.170126:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327643520 00000100:00100000:0.0:1788872618.170129:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327643520 00000100:00100000:0.0:1788872618.170145:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:0.0:1788872618.170152:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327643392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872618.170188:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327643392:12345-0@lo:400:kworker.0 Request processed in 37us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872618.170193:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00000100:00100000:0.0:1788872618.170204:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:0.0:1788872618.170210:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327643520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872618.170239:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327643520:12345-0@lo:400:kworker.0 Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872618.170245:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00100000:0.0:1788872618.170286:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327643136:0@lo:400:kworker.0 00000100:00100000:0.0:1788872618.170298:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327642880:0@lo:400:kworker.0 00000100:00100000:0.0:1788872618.170338:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327643520:0@lo:400:kworker.0 00000100:00100000:0.0:1788872618.170349:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327643392:0@lo:400:kworker.0 00000100:00100000:1.0:1788872618.170695:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327642752:0@lo:38:kworker.0 00000100:00100000:1.0:1788872618.170793:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872618.170823:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327643008:0@lo:38:kworker.0 00000100:00100000:1.0:1788872618.170844:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872618.170862:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327643264:0@lo:38:kworker.0 00000100:00100000:1.0:1788872618.170883:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872618.170898:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327643648:0@lo:38:kworker.0 00000100:00100000:1.0:1788872618.170917:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872618.170959:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327642752 00000100:00100000:1.0:1788872618.170964:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327642752 00000100:00100000:1.0:1788872618.170986:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327643008 00000100:00100000:1.0:1788872618.170989:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327643008 00000100:00100000:1.0:1788872618.171001:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327643648 00000100:00100000:1.0:1788872618.171004:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327643648 00000100:00100000:1.0:1788872618.171018:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:1.0:1788872618.171180:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327642752:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872618.171200:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872618.171237:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327642752:12345-0@lo:38:kworker.0 Request processed in 58us (444us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872618.171324:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327643264 00000100:00100000:2.0:1788872618.171337:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327643264 00000100:00100000:2.0:1788872618.171363:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:2.0:1788872618.171368:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327643264:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872618.171378:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872618.171406:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327643264:12345-0@lo:38:kworker.0 Request processed in 38us (522us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872618.171412:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00080000:3.0:1788872618.171485:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872618.171501:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872618.171504:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872618.171632:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1788872618.171640:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327643008:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872618.171651:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872618.171693:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327643008:12345-0@lo:38:kworker.0 Request processed in 52us (847us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872618.171698:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1788872618.171725:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1788872618.171730:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327643648:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872618.171738:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872618.171765:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327643648:12345-0@lo:38:kworker.0 Request processed in 34us (847us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872618.171771:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00080000:0.0:1788872618.171817:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872618.171822:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872618.171826:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327642752:0@lo:38:kworker.0 00000100:00080000:0.0:1788872618.171834:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872618.171838:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872618.171841:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327643008:0@lo:38:kworker.0 00000100:00080000:0.0:1788872618.171847:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872618.171850:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872618.171852:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327643264:0@lo:38:kworker.0 00000100:00080000:0.0:1788872618.171859:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872618.171863:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872618.171873:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327643648:0@lo:38:kworker.0 00000100:00100000:1.0:1788872618.174388:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00010000:00010000:0.0:1788872618.233444:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872618.680938:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327643776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872618.681034:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872618.681332:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327643776 00000100:00100000:1.0:1788872618.681340:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327643776 00000100:00100000:1.0:1788872618.681394:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:1.0:1788872618.681404:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327643776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872618.681432:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872618.681474:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327643776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872618.681481:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:3.0:1788872618.681845:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327643904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872618.681880:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872618.681940:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327643904 00000100:00100000:1.0:1788872618.681944:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327643904 00000100:00100000:1.0:1788872618.681973:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:1.0:1788872618.681979:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327643904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872618.681995:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872618.683633:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327643776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872618.689952:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327643904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7961us (8059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872618.689969:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00100000:3.0:1788872618.699340:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327643904:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788872619.256878:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872619.276987:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872619.277037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000400:00000100:3.0:1788872619.277068:0:3639:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311142784 offset 0 length 224: 4 00000100:00100000:3.0:1788872619.277091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872619.277531:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311143296 00000100:00100000:0.0:1788872619.277542:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311143296 00000100:00100000:0.0:1788872619.277626:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311143168 00000100:00100000:0.0:1788872619.277630:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311143168 00000100:00100000:0.0:1788872619.277652:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2473 00000100:00100000:0.0:1788872619.277663:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311143296:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872619.277740:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311143296:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 78us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872619.277747:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2473 00000100:00100000:0.0:1788872619.277764:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2474 00000100:00100000:0.0:1788872619.277771:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311143168:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872619.277796:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311143168:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 26us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872619.277802:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2474 00000100:00080000:0.0:1788872619.277850:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872619.277854:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872619.278012:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872619.278317:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311143040 00000100:00100000:0.0:1788872619.278323:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311143040 00000100:00100000:0.0:1788872619.278370:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311142912 00000100:00100000:0.0:1788872619.278374:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311142912 00000100:00100000:2.0:1788872619.278383:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1113 00000100:00100000:2.0:1788872619.278396:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311143040:12345-192.168.204.39@tcp:400:kworker.0 00000100:00080000:3.0:1788872619.278416:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872619.278432:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311143040:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 39us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872619.297945:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1107 00000100:00100000:0.0:1788872619.297982:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875765311142912:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:0.0:1788872619.298012:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872619.298101:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875765311142912:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 121us (20088us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872619.298111:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1107 00000100:00100000:2.0:1788872619.300917:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1113 00010000:00010000:1.0:1788872620.281064:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872621.304823:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872622.328906:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872623.288902:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1788872623.288990:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872623.288995:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872623.288998:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872623.289006:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3555 00000100:00080000:3.0:1788872623.289018:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788872623.289025:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872623.289049:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a3800 x1875765327644160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872623.289121:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327644160:0@lo:38:kworker.0 00000100:00100000:0.0:1788872623.289184:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872623.289570:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327644160 00000100:00100000:1.0:1788872623.289579:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327644160 00000100:00100000:1.0:1788872623.289628:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1788872623.289644:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327644160:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872623.289666:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872623.290492:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327644288:0@lo:400:kworker.0 00000100:00100000:2.0:1788872623.290540:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872623.290578:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327644032:0@lo:400:kworker.0 00000400:00000100:2.0:1788872623.290599:0:3647:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327644032 offset 0 length 224: 4 00000100:00100000:0.0:1788872623.290718:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327644288 00000100:00100000:0.0:1788872623.290724:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327644288 00000100:00100000:0.0:1788872623.290777:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1788872623.290786:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327644288:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788872623.290859:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872623.293959:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327644288:12345-0@lo:400:kworker.0 Request processed in 3164us (3407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872623.293976:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00080000:3.0:1788872623.295213:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872623.295221:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872623.295224:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872623.295242:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3555 00000100:00080000:3.0:1788872623.295247:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788872623.295254:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872623.295294:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9cb5d9180 x1875765327644416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872623.295330:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872623.295333:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872623.295335:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872623.295338:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3555 00000100:00080000:3.0:1788872623.295340:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788872623.295343:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872623.295353:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9cb5d8a80 x1875765327644672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872623.295404:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872623.295407:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872623.295408:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872623.295411:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3555 00000100:00080000:3.0:1788872623.295414:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788872623.295417:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872623.295429:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef1bbb80 x1875765327645056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872623.298921:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327644800:0@lo:400:kworker.0 00000100:00100000:3.0:1788872623.299080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872623.299205:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872623.299215:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327644544:0@lo:400:kworker.0 00000100:00100000:3.0:1788872623.299264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872623.300337:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327644544 00000100:00100000:0.0:1788872623.300348:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327644544 00000100:00100000:0.0:1788872623.300439:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1788872623.300458:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327644544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872623.300580:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327644544:12345-0@lo:400:kworker.0 Request processed in 133us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872623.300588:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1788872623.300646:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327644544:0@lo:400:kworker.0 00000100:00100000:0.0:1788872623.300678:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327644928:0@lo:400:kworker.0 00000100:00100000:0.0:1788872623.300788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872623.300843:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327644800 00000100:00100000:0.0:1788872623.300848:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327644800 00000100:00100000:0.0:1788872623.300877:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327644928 00000100:00100000:0.0:1788872623.300880:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327644928 00000100:00100000:0.0:1788872623.300902:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:0.0:1788872623.300908:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327644800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872623.300948:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327644800:12345-0@lo:400:kworker.0 Request processed in 40us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872623.300955:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000100:00100000:0.0:1788872623.300966:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:0.0:1788872623.300973:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327644928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872623.301005:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327644928:12345-0@lo:400:kworker.0 Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872623.301340:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:0.0:1788872623.301397:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327644800:0@lo:400:kworker.0 00000100:00100000:0.0:1788872623.301424:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327644928:0@lo:400:kworker.0 00000100:00100000:0.0:1788872623.301454:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327644416:0@lo:38:kworker.0 00000100:00100000:0.0:1788872623.301488:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872623.301512:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327644672:0@lo:38:kworker.0 00000100:00100000:0.0:1788872623.301534:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872623.301584:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327645056:0@lo:38:kworker.0 00000100:00100000:0.0:1788872623.301608:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872623.301640:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327644672 00000100:00100000:0.0:1788872623.301645:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327644672 00000100:00100000:0.0:1788872623.301669:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:0.0:1788872623.301673:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327644672:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872623.302657:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872623.302941:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327644672:12345-0@lo:38:kworker.0 Request processed in 1264us (1403us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872623.302949:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:0.0:1788872623.302990:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327644416 00000100:00100000:0.0:1788872623.302995:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327644416 00000100:00100000:0.0:1788872623.303083:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327645056 00000100:00100000:0.0:1788872623.303152:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327645056 00000100:00100000:0.0:1788872623.303175:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1788872623.303180:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327644416:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872623.303193:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872623.303226:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327644416:12345-0@lo:38:kworker.0 Request processed in 44us (1737us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872623.303242:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1788872623.303255:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1788872623.303259:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327645056:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872623.303269:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872623.303296:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327645056:12345-0@lo:38:kworker.0 Request processed in 35us (1686us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872623.303302:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00080000:0.0:1788872623.303347:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872623.303352:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872623.303357:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327644416:0@lo:38:kworker.0 00000100:00080000:0.0:1788872623.303366:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872623.303370:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872623.303386:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327644672:0@lo:38:kworker.0 00000100:00080000:0.0:1788872623.303398:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872623.303402:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872623.303404:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327645056:0@lo:38:kworker.0 00000100:00100000:2.0:1788872623.303580:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327644288:0@lo:400:kworker.0 00000100:00080000:3.0:1788872623.303972:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872623.303979:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872623.303982:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872623.344327:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327644160:12345-0@lo:38:kworker.0 Request processed in 54669us (55128us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872623.344349:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00080000:2.0:1788872623.344401:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872623.344408:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872623.344412:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327644160:0@lo:38:kworker.0 00010000:00010000:3.0:1788872623.352897:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872623.800917:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327645184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872623.800991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872623.801158:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327645184 00000100:00100000:1.0:1788872623.801167:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327645184 00000100:00100000:1.0:1788872623.801231:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:1.0:1788872623.801241:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327645184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872623.801270:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872623.801324:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327645184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872623.801330:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00100000:3.0:1788872623.801761:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327645184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872623.801926:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872623.801936:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327645312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872623.801968:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872623.802089:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327645312 00000100:00100000:2.0:1788872623.802093:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327645312 00000100:00100000:2.0:1788872623.802127:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:2.0:1788872623.802133:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327645312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872623.802150:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872623.802190:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327645312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872623.802196:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:3.0:1788872623.802751:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327645312:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788872624.376731:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872624.393204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872624.393263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872624.393318:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872624.393791:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311143552 00000100:00100000:0.0:1788872624.393802:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311143552 00000100:00100000:0.0:1788872624.393851:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1111 00000100:00100000:0.0:1788872624.393860:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311143552:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:0.0:1788872624.393888:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872624.393957:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311143552:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 96us (763us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872624.393966:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1111 00000400:00000100:0.0:1788872624.394018:0:3637:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311143424 offset 0 length 224: 4 00000100:00100000:0.0:1788872624.394175:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872624.394293:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311143680 00000100:00100000:3.0:1788872624.394372:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311143680 00000100:00100000:3.0:1788872624.394426:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1116 00000100:00080000:0.0:1788872624.394579:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872624.394627:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311143680:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872624.394687:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311143680:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 254us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872624.394704:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1116 00000100:00100000:1.0:1788872624.399873:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311143808 00000100:00100000:1.0:1788872624.399889:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311143808 00000100:00100000:1.0:1788872624.399996:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311143936 00000100:00100000:1.0:1788872624.400000:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311143936 00000100:00080000:0.0:1788872624.400001:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872624.400009:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872624.400045:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5940 00000100:00100000:1.0:1788872624.400057:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2403:x1875765311143808:12345-192.168.204.39@tcp:9:kworker.0 00000020:00000080:1.0:1788872624.400091:0:26182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d99c8 00000100:00080000:1.0:1788872624.400101:0:26182:0:(import.c:65:import_set_state_nolock()) ffff98a9ef256800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788872624.400135:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5941 00000100:00100000:3.0:1788872624.400148:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2403:x1875765311143936:12345-192.168.204.39@tcp:9:kworker.0 00000001:00000004:1.0:1788872624.400157:0:26182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969449 00000020:00000080:3.0:1788872624.400164:0:9961:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d99cf 00000100:00080000:3.0:1788872624.400172:0:9961:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0ad000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788872624.400206:0:9961:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969449 00010000:00010000:0.0:1788872624.400395:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872624.400733:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+2:2403:x1875765311143936:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 587us (7412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872624.400742:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5941 00010000:00010000:3.0:1788872624.400764:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872624.400886:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+2:2403:x1875765311143808:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 832us (7622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872624.400906:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5940 00010000:00010000:3.0:1788872625.400881:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872626.425065:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872627.453922:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788872628.410788:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872628.410795:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872628.410798:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872628.410807:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3560 00000100:00080000:1.0:1788872628.410813:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872628.410819:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872628.410840:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9df5ad500 x1875765327645568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872628.410876:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872628.410880:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872628.410882:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872628.410884:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3560 00000100:00080000:1.0:1788872628.410887:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872628.410890:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872628.410900:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9df5aed80 x1875765327645824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872628.410915:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872628.410918:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872628.410920:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872628.410924:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3560 00000100:00080000:1.0:1788872628.410926:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872628.410929:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872628.410941:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5ae1500 x1875765327646080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872628.410980:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872628.410982:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872628.410984:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872628.410987:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3560 00000100:00080000:1.0:1788872628.410990:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872628.410994:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872628.411004:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c4f37480 x1875765327646464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872628.411035:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327646208:0@lo:400:kworker.0 00000100:00100000:1.0:1788872628.411103:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872628.411156:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788872628.411162:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327645440:0@lo:400:kworker.0 00000400:00000100:1.0:1788872628.411181:0:3644:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327645440 offset 0 length 224: 4 00000100:00100000:1.0:1788872628.411202:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327646336:0@lo:400:kworker.0 00000100:00100000:1.0:1788872628.411222:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872628.411249:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327645568:0@lo:38:kworker.0 00000100:00100000:1.0:1788872628.411273:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872628.411291:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327645824:0@lo:38:kworker.0 00000100:00100000:1.0:1788872628.411311:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872628.411327:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327646080:0@lo:38:kworker.0 00000100:00100000:1.0:1788872628.411350:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872628.411369:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327646464:0@lo:38:kworker.0 00000100:00100000:1.0:1788872628.411391:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872628.411431:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327645952:0@lo:400:kworker.0 00000100:00100000:1.0:1788872628.411455:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872628.411474:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872628.411480:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327645696:0@lo:400:kworker.0 00000100:00100000:1.0:1788872628.411502:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872628.411531:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327646208 00000100:00100000:1.0:1788872628.411538:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327646208 00000100:00100000:1.0:1788872628.411620:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327646336 00000100:00100000:1.0:1788872628.411623:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327646336 00000100:00100000:1.0:1788872628.411663:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:1.0:1788872628.411672:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327646208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872628.411724:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327646208:12345-0@lo:400:kworker.0 Request processed in 53us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872628.411731:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00100000:1.0:1788872628.411748:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:1.0:1788872628.411754:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327646336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872628.411781:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327646336:12345-0@lo:400:kworker.0 Request processed in 28us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872628.411787:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:1.0:1788872628.411810:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327645568 00000100:00100000:1.0:1788872628.411813:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327645568 00000100:00100000:1.0:1788872628.411831:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327645824 00000100:00100000:1.0:1788872628.411834:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327645824 00000100:00100000:1.0:1788872628.411841:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327646464 00000100:00100000:1.0:1788872628.411844:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327646464 00000100:00100000:1.0:1788872628.411850:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327645952 00000100:00100000:1.0:1788872628.411852:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327645952 00000100:00100000:1.0:1788872628.411867:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327645696 00000100:00100000:1.0:1788872628.411869:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327645696 00000100:00100000:1.0:1788872628.411893:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1788872628.411899:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327645952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872628.411934:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327645952:12345-0@lo:400:kworker.0 Request processed in 34us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872628.411940:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1788872628.411952:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1788872628.411958:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327645696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872628.411986:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327645696:12345-0@lo:400:kworker.0 Request processed in 28us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872628.411991:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1788872628.412003:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1788872628.412006:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327645568:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872628.412024:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872628.412054:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327645568:12345-0@lo:38:kworker.0 Request processed in 46us (780us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872628.412060:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1788872628.412072:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1788872628.412076:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327645824:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872628.412085:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872628.412108:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327645824:12345-0@lo:38:kworker.0 Request processed in 30us (796us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872628.412113:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1788872628.412124:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1788872628.412127:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327646464:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872628.412148:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872628.412179:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327646464:12345-0@lo:38:kworker.0 Request processed in 49us (786us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872628.412184:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1788872628.412207:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327646080 00000100:00100000:1.0:1788872628.412211:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327646080 00000100:00100000:1.0:1788872628.412234:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:1.0:1788872628.412239:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327646080:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872628.412248:0:23717:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872628.412274:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327646080:12345-0@lo:38:kworker.0 Request processed in 33us (923us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872628.412279:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00080000:1.0:1788872628.412304:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872628.412309:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872628.412310:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872628.412348:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327645696:0@lo:400:kworker.0 00000100:00100000:1.0:1788872628.412359:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327645952:0@lo:400:kworker.0 00000100:00080000:1.0:1788872628.412387:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872628.412392:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872628.412395:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327645568:0@lo:38:kworker.0 00000100:00080000:1.0:1788872628.412403:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872628.412405:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872628.412408:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327645824:0@lo:38:kworker.0 00000100:00080000:1.0:1788872628.412415:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872628.412418:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872628.412420:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327646080:0@lo:38:kworker.0 00000100:00080000:1.0:1788872628.412436:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872628.412439:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872628.412442:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327646464:0@lo:38:kworker.0 00000100:00100000:1.0:1788872628.412477:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327646336:0@lo:400:kworker.0 00000100:00100000:1.0:1788872628.412487:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327646208:0@lo:400:kworker.0 00010000:00010000:0.0:1788872628.472895:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872628.920816:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327646592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872628.920914:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872628.921088:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872628.921098:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327646720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872628.921140:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872628.921197:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327646592 00000100:00100000:1.0:1788872628.921205:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327646592 00000100:00100000:1.0:1788872628.921256:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:1.0:1788872628.921266:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327646592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872628.921297:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872628.921348:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327646720 00000100:00100000:1.0:1788872628.921355:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327646592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872628.921363:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:0.0:1788872628.921372:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327646720 00000100:00100000:0.0:1788872628.921405:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:0.0:1788872628.921412:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327646720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872628.921503:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872628.921539:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327646720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872628.921546:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00100000:2.0:1788872628.921670:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327646720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872628.921695:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327646592:0@lo:13:osp-pre-0-1.0 00000100:00000400:1.0:1788872629.432827:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788872613/real 1788872613] req@ffff98a9ff7f1180 x1875765327640704/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872629 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872629.432855:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff98a9ff7f1180 x1875765327640704/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872629 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872629.432862:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788872629.432865:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788872629.432868:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.139@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788872629.432869:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788872629.432872:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9ff7f1180 x1875765327640704/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872629 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872629.432878:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a8c1cabb80 x1875765327642624/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872634 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872629.432904:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9f67a0e00 x1875765327644032/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872639 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872629.432922:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9df5ac700 x1875765327645440/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872644 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788872629.432928:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788872629.432931:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788872629.432932:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788872629.432933:0:3644:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1788872629.432969:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327645440:0@lo:400:kworker.0 00000100:00100000:1.0:1788872629.432974:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327640704:0@lo:400:kworker.0 00000100:00080000:1.0:1788872629.433008:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872629.433014:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788872629.433017:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872629.433022:0:52416:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3503 00000100:00080000:1.0:1788872629.433031:0:52416:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872629.433056:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327644032:0@lo:400:kworker.0 00000100:00100000:1.0:1788872629.433063:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9c77a4000 x1875765327646848/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872629.433086:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872629.433090:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872629.433092:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872629.433096:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3565 00000100:00080000:1.0:1788872629.433098:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872629.433102:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872629.433130:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9c77a6d80 x1875765327646976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872629.433185:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872629.433193:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872629.433195:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872629.433199:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3565 00000100:00100000:0.0:1788872629.433254:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327647104:0@lo:400:kworker.0 00000100:00100000:0.0:1788872629.433333:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788872629.433386:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872629.433394:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872629.433397:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327647104 00000100:00100000:0.0:1788872629.433407:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327647104 00000100:00100000:1.0:1788872629.433412:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9c77a4a80 x1875765327647232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872629.433440:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872629.433444:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872629.433446:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872629.433450:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3565 00000100:00080000:1.0:1788872629.433453:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872629.433457:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872629.433464:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1788872629.433477:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327647104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872629.433483:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9c77a5c00 x1875765327647488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872629.433496:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872629.433499:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872629.433501:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872629.433505:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3565 00000100:00080000:1.0:1788872629.433507:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872629.433510:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872629.433530:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327647104:12345-0@lo:400:kworker.0 Request processed in 57us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872629.433534:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9c77a4380 x1875765327647616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872629.433542:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1788872629.433596:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327646848:0@lo:250:kworker.0 00000100:00100000:0.0:1788872629.433614:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327647104:0@lo:400:kworker.0 00000100:00100000:0.0:1788872629.433625:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872629.433631:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327647360:0@lo:400:kworker.0 00000100:00100000:0.0:1788872629.433653:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872629.433679:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327647360 00000100:00100000:0.0:1788872629.433682:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327647360 00000100:00100000:0.0:1788872629.433705:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1788872629.433712:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327647360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872629.433743:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327647360:12345-0@lo:400:kworker.0 Request processed in 32us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872629.433756:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000400:00000100:1.0:1788872629.434024:0:3643:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327646848 offset 0 length 520: 4 00000100:00100000:2.0:1788872629.434025:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327642624:0@lo:400:kworker.0 00000100:00100000:1.0:1788872629.434060:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327646976:0@lo:38:kworker.0 00000100:00100000:1.0:1788872629.434089:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872629.434128:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327647232:0@lo:38:kworker.0 00000100:00100000:1.0:1788872629.434151:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872629.434170:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327647488:0@lo:38:kworker.0 00000100:00100000:1.0:1788872629.434193:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872629.434287:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327647616:0@lo:38:kworker.0 00000100:00100000:1.0:1788872629.434309:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872629.434342:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327646976 00000100:00100000:1.0:1788872629.434347:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327646976 00000100:00100000:1.0:1788872629.434366:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327647232 00000100:00100000:1.0:1788872629.434369:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327647232 00000100:00100000:1.0:1788872629.434379:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327647616 00000100:00100000:1.0:1788872629.434382:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327647616 00000100:00100000:1.0:1788872629.434395:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1788872629.434400:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327646976:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872629.434419:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872629.434456:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327646976:12345-0@lo:38:kworker.0 Request processed in 54us (366us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872629.434463:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1788872629.434487:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:1.0:1788872629.434491:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327647232:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872629.434501:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872629.434851:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327647232:12345-0@lo:38:kworker.0 Request processed in 356us (697us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872629.434858:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:1.0:1788872629.434871:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1788872629.434875:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327647616:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872629.434885:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872629.435092:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327647616:12345-0@lo:38:kworker.0 Request processed in 214us (780us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872629.435099:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00080000:1.0:1788872629.435143:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872629.435149:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872629.435153:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327646976:0@lo:38:kworker.0 00000100:00080000:1.0:1788872629.435161:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872629.435164:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872629.435166:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327647232:0@lo:38:kworker.0 00000100:00080000:1.0:1788872629.435172:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872629.435175:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872629.435178:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327647616:0@lo:38:kworker.0 00000100:00100000:1.0:1788872629.435852:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327647488 00000100:00100000:1.0:1788872629.435863:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327647488 00000100:00100000:0.0:1788872629.435866:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327647360:0@lo:400:kworker.0 00000100:00100000:1.0:1788872629.435908:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:1.0:1788872629.435914:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327647488:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872629.435927:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872629.436350:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327647488:12345-0@lo:38:kworker.0 Request processed in 433us (2155us total) trans 0 rc -19/-19 00000100:00080000:3.0:1788872629.436409:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872629.436416:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872629.436420:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327647488:0@lo:38:kworker.0 00000100:00100000:1.0:1788872629.438293:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00010000:00010000:1.0:1788872629.496640:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788872629.517897:0:3637:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311144064 offset 0 length 224: 4 00000100:00100000:0.0:1788872629.517958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872629.517997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872629.518029:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311144320 00000100:00100000:0.0:1788872629.518046:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311144320 00000100:00100000:0.0:1788872629.518123:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311144192 00000100:00100000:0.0:1788872629.518127:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311144192 00000100:00100000:0.0:1788872629.518150:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1121 00000100:00100000:0.0:1788872629.518162:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311144320:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872629.518241:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311144320:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 81us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872629.518250:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1121 00000100:00100000:0.0:1788872629.518271:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1118 00000100:00100000:0.0:1788872629.518275:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311144192:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:0.0:1788872629.518297:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872629.518326:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311144192:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 48us (329us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872629.518332:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1118 00000100:00080000:0.0:1788872629.518957:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1788872629.948254:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00100000:1.0:1788872629.948254:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:3.0:1788872629.948263:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a9ef255000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:1.0:1788872629.948263:0:9516:0:(genops.c:906:class_export_put()) final put ffff98a9ef0ab000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:0.0:1788872629.953193:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef0ab000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-OST0001 00000020:00000080:1.0:1788872629.953410:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef255000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-OST0000 00000020:00000080:1.0:1788872629.953543:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ef0ad000 for lustre-OST0001 00000020:00000080:1.0:1788872629.953567:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ef256800 for lustre-OST0000 00010000:00010000:2.0:1788872630.524001:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788872630.541488:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311144448 offset 0 length 520: 4 00000100:00100000:0.0:1788872630.541543:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872630.542917:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311144576 00000100:00100000:3.0:1788872630.542938:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311144576 00000100:00100000:3.0:1788872630.543014:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1119 00000100:00100000:3.0:1788872630.543035:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875765311144576:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:3.0:1788872630.543289:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872630.543391:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875765311144576:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 354us (1841us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872630.543405:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1119 00000100:00100000:0.0:1788872630.555863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872630.557714:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311144704 00000100:00100000:1.0:1788872630.557735:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311144704 00000100:00100000:1.0:1788872630.557864:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1122 00000100:00100000:1.0:1788872630.557877:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311144704:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872630.557986:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311144704:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 111us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872630.558005:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1122 00010000:00010000:2.0:1788872631.545754:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872632.569410:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872633.601145:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872634.042296:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872634.042331:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327647744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872634.042431:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872634.042518:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872634.042529:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327647872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872634.045006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872634.052662:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327647744 00000100:00100000:2.0:1788872634.052679:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327647744 00000100:00100000:2.0:1788872634.052778:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327647872 00000100:00100000:2.0:1788872634.052782:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327647872 00000100:00080000:1.0:1788872634.052943:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872634.052949:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872634.052976:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:2.0:1788872634.052992:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327647744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872634.053048:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872634.053372:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327647744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872634.053482:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327647744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 202us (10757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872634.053491:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:2.0:1788872634.053516:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:2.0:1788872634.053526:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327647872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872634.053585:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872634.053633:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327647872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (8641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872634.053640:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:1.0:1788872634.053875:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327647872:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788872634.552721:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872634.552734:0:52416:0:(pinger.c:247:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788872634.552737:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872634.552742:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872634.552747:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872634.552757:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3566 00000100:00080000:1.0:1788872634.552774:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872634.552784:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872634.552856:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9c77a4380 x1875765327648000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872634.552927:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872634.552931:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872634.552933:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872634.552936:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3566 00000100:00080000:1.0:1788872634.552938:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872634.552942:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872634.552955:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9c77a6d80 x1875765327648256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872634.552970:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872634.552973:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872634.552975:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872634.552978:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3566 00000100:00080000:1.0:1788872634.552980:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872634.552984:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872634.552994:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9c77a7100 x1875765327648512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872634.553004:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872634.553007:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872634.553009:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872634.553012:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3566 00000100:00080000:1.0:1788872634.553032:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872634.553037:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872634.553053:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9c77a5c00 x1875765327648640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872634.553094:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327648128:0@lo:400:kworker.0 00000100:00100000:1.0:1788872634.553185:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872634.553241:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872634.553247:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327648384:0@lo:400:kworker.0 00000100:00100000:1.0:1788872634.553270:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872634.553314:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327648128 00000100:00100000:1.0:1788872634.553323:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327648128 00000100:00100000:1.0:1788872634.553389:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327648384 00000100:00100000:1.0:1788872634.553393:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327648384 00000100:00100000:2.0:1788872634.553586:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327648000:0@lo:38:kworker.0 00000100:00100000:2.0:1788872634.553625:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872634.553647:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327648256:0@lo:38:kworker.0 00000100:00100000:2.0:1788872634.553668:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872634.553683:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327648512:0@lo:38:kworker.0 00000100:00100000:2.0:1788872634.553722:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872634.553740:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327648640:0@lo:38:kworker.0 00000100:00100000:2.0:1788872634.553762:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872634.553784:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327648000 00000100:00100000:2.0:1788872634.553788:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327648000 00000100:00100000:1.0:1788872634.553957:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1788872634.553974:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327648128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872634.554079:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327648128:12345-0@lo:400:kworker.0 Request processed in 108us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872634.556004:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327648256 00000100:00100000:0.0:1788872634.556037:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327648256 00000100:00100000:2.0:1788872634.567080:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327648640 00000100:00100000:2.0:1788872634.567104:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327648640 00000100:00100000:2.0:1788872634.567160:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1788872634.567193:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327648384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872634.567353:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327648384:12345-0@lo:400:kworker.0 Request processed in 182us (14080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872634.567363:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1788872634.567387:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:2.0:1788872634.567392:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327648000:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872634.567418:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872634.567484:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327648000:12345-0@lo:38:kworker.0 Request processed in 90us (13857us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872634.567492:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:2.0:1788872634.568881:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1788872634.568894:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327648640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872634.568925:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872634.569204:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327648640:12345-0@lo:38:kworker.0 Request processed in 309us (15439us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872634.569212:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1788872634.569273:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327648512 00000100:00100000:2.0:1788872634.569284:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327648512 00000100:00100000:2.0:1788872634.569362:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:2.0:1788872634.569367:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327648512:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872634.569380:0:23717:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872634.569411:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327648512:12345-0@lo:38:kworker.0 Request processed in 44us (15688us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872634.569417:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00100000:1.0:1788872634.569542:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1788872634.569640:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327648384:0@lo:400:kworker.0 00000100:00100000:1.0:1788872634.569657:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327648128:0@lo:400:kworker.0 00000100:00080000:1.0:1788872634.569720:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872634.574006:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:0.0:1788872634.574037:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327648256:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872634.574070:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872634.574206:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327648256:12345-0@lo:38:kworker.0 Request processed in 169us (20535us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872634.574216:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00080000:2.0:1788872634.574682:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872634.574690:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872634.574695:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327648000:0@lo:38:kworker.0 00000100:00080000:2.0:1788872634.574714:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872634.574718:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872634.574721:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327648256:0@lo:38:kworker.0 00000100:00080000:2.0:1788872634.574733:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872634.574736:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872634.574740:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327648512:0@lo:38:kworker.0 00000100:00080000:2.0:1788872634.574752:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872634.574755:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872634.574758:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327648640:0@lo:38:kworker.0 00010000:00010000:3.0:1788872634.616785:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872635.643150:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872635.672546:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872635.672631:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872635.672689:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311144960 00000100:00100000:2.0:1788872635.672703:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311144960 00000100:00100000:1.0:1788872635.672758:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311144832 00000100:00100000:1.0:1788872635.672765:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311144832 00000100:00100000:2.0:1788872635.672814:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1125 00000100:00100000:2.0:1788872635.672840:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311144960:12345-192.168.204.39@tcp:400:kworker.0 00000100:00080000:3.0:1788872635.672848:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872635.672960:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311144960:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 134us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872635.680405:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1123 00000100:00100000:1.0:1788872635.680425:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311144832:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:1.0:1788872635.680459:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872635.680603:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311144832:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 180us (7969us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872635.680613:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1123 00000100:00100000:2.0:1788872635.685970:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1125 00010000:00010000:0.0:1788872636.665327:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872637.693868:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788872638.141857:0:87059:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788872638.141870:0:87059:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788872638.141872:0:87059:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788872638.142026:0:87059:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98a9f6655000 00000020:01000004:3.0:1788872638.142048:0:87059:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788872638.142068:0:87059:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788872638.142091:0:87059:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98a9efa78000) 00000020:00000080:3.0:1788872638.142117:0:87059:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788872638.350167:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788872638.363784:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788872638.369289:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788872638.371619:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788872638.372911:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788872638.373384:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788872638.373836:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788872638.374295:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788872638.380143:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788872638.381599:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788872638.384008:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788872638.384883:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788872638.385243:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788872638.386898:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788872638.387441:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788872638.414684:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.415466:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788872638.416272:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788872638.416756:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.417434:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788872638.418627:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.419508:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.420015:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.420697:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.421311:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.421730:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788872638.422164:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788872638.423817:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788872638.424282:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788872638.424501:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788872638.424774:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.425038:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788872638.425437:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.425711:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.426023:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.426841:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.428847:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788872638.429377:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788872638.431785:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.433607:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788872638.434200:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788872638.434487:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788872638.444321:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788872638.446147:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788872638.447380:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788872638.448072:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788872638.449392:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788872638.450412:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788872638.452995:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788872638.453486:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788872638.456335:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788872638.460400:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788872638.461779:0:87059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1788872638.466354:0:87059:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788872638.466722:0:87059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788872638.466849:0:87059:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788872638.466866:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9b3b 00000020:01000004:2.0:1788872638.466876:0:87059:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788872638.466890:0:87059:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788872638.466897:0:87059:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a9f6655000 from MGS 00000020:01000004:2.0:1788872638.466902:0:87059:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788872638.466916:0:87059:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98a9e9b0cd40) 00000020:00000080:2.0:1788872638.466931:0:87059:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:2.0:1788872638.467038:0:87059:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9f6655000 from MGS, refs=2 00080000:01000000:2.0:1788872638.467044:0:87059:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788872638.467049:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9b49 00010000:00010000:2.0:1788872638.467182:0:87059:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1788872638.491061:0:87059:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788872638.497173:0:87063:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788872638.497868:0:87059:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788872638.497990:0:87059:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788872638.499930:0:87059:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788872638.500480:0:87059:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788872638.503230:0:87059:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788872638.503245:0:87059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788872638.515834:0:87059:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788872638.515861:0:87059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788872638.517647:0:87059:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788872638.517662:0:87059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788872638.519827:0:87059:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788872638.520827:0:87059:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788872638.520833:0:87059:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.139@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788872638.520840:0:87059:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.139@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788872638.520848:0:87059:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98a9e98d3800 already not connected (conn 61, was 0): CONNECTING 00000100:00100000:1.0:1788872638.520855:0:87059:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00010000:00010000:3.0:1788872638.712909:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872639.161844:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872639.161881:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327648768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872639.162013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872639.162085:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327648768 00000100:00100000:2.0:1788872639.162098:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327648768 00000100:00100000:2.0:1788872639.162200:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1788872639.162214:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327648768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872639.162254:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872639.162320:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327648768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872639.162329:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1788872639.162390:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327648768:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788872639.164614:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872639.167949:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872639.175299:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327648896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872639.176246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872639.183215:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327648896 00000100:00100000:0.0:1788872639.183240:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327648896 00000100:00100000:0.0:1788872639.184651:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:0.0:1788872639.184671:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327648896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872639.184727:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872639.184864:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327648896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 200us (8621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872639.184873:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000100:00100000:2.0:1788872639.189080:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327648896:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788872639.192242:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00020000:1.0:1788872639.544706:0:87059:0:(import.c:339:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) 00000100:00020000:1.0:1788872639.563713:0:87059:0:(import.c:363:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff98a9c77a4000 x1875765327646848/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788872639 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00020000:1.0:1788872639.610838:0:87059:0:(import.c:373:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. 00000100:00100000:1.0:1788872639.640516:0:87059:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788872639.680375:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788872629/real 1788872629] req@ffff98a9c77a4000 x1875765327646848/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788872639 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872639.680428:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98a9c77a4000 x1875765327646848/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788872639 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788872639.680790:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872639.680822:0:52416:0:(pinger.c:247:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788872639.680825:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872639.680830:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872639.680835:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872639.680842:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3571 00000100:00080000:2.0:1788872639.680847:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872639.680856:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872639.680908:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3b4b480 x1875765327649024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872639.680975:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872639.680979:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872639.680981:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872639.680985:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3571 00000100:00080000:2.0:1788872639.680988:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872639.680992:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872639.681006:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3b4b800 x1875765327649280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872639.681023:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872639.681027:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872639.681029:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872639.681032:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3571 00000100:00080000:2.0:1788872639.681035:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872639.681039:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872639.681056:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3b48a80 x1875765327649536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872639.681073:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872639.681077:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872639.681079:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872639.681083:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3571 00000100:00080000:2.0:1788872639.681085:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872639.681090:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872639.681103:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3b4ad80 x1875765327649664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872639.681240:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327649024:0@lo:38:kworker.0 00000100:00100000:0.0:1788872639.681340:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872639.681401:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327649280:0@lo:38:kworker.0 00000100:00100000:0.0:1788872639.681441:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872639.681459:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327649536:0@lo:38:kworker.0 00000100:00100000:0.0:1788872639.681488:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872639.681510:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327649664:0@lo:38:kworker.0 00000100:00100000:0.0:1788872639.681532:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788872639.681622:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872639.681638:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788872639.681647:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327646848:0@lo:250:kworker.0 00000100:00100000:0.0:1788872639.681695:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327649536 00000100:00100000:0.0:1788872639.681716:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327649536 00000100:00100000:0.0:1788872639.681762:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:0.0:1788872639.681771:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327649536:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872639.681811:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872639.681864:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327649536:12345-0@lo:38:kworker.0 Request processed in 92us (374us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872639.681872:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00080000:0.0:1788872639.681897:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872639.681900:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788872639.681902:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872639.681907:0:52416:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3566 00000100:00080000:0.0:1788872639.681910:0:52416:0:(import.c:589:import_select_connection()) MGC192.168.204.139@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788872639.681915:0:52416:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872639.681947:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f5eebb80 x1875765327649792/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1788872639.682019:0:3643:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff98a9f5eebb80 x1875765327649792/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872639.684307:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327649408:0@lo:400:kworker.0 00000100:00100000:1.0:1788872639.684426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872639.684486:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872639.684516:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327649152:0@lo:400:kworker.0 00000100:00100000:1.0:1788872639.684586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872639.684639:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327649024 00000100:00100000:1.0:1788872639.684648:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327649024 00000100:00100000:1.0:1788872639.684688:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327649280 00000100:00100000:1.0:1788872639.684692:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327649280 00000100:00100000:1.0:1788872639.684701:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327649664 00000100:00100000:1.0:1788872639.684703:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327649664 00000100:00100000:1.0:1788872639.684711:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327649408 00000100:00100000:1.0:1788872639.684713:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327649408 00000100:00100000:1.0:1788872639.684753:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327649152 00000100:00100000:1.0:1788872639.684755:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327649152 00000100:00100000:1.0:1788872639.684774:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1788872639.684782:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327649408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872639.684851:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327649408:12345-0@lo:400:kworker.0 Request processed in 68us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872639.684858:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1788872639.684877:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:1.0:1788872639.684883:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327649152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872639.684909:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327649152:12345-0@lo:400:kworker.0 Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872639.684915:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:1.0:1788872639.684939:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1788872639.684944:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327649024:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872639.684968:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872639.684999:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327649024:12345-0@lo:38:kworker.0 Request processed in 54us (3660us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872639.685006:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1788872639.685025:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1788872639.685028:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327649280:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872639.685037:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872639.685060:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327649280:12345-0@lo:38:kworker.0 Request processed in 30us (3619us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872639.685065:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1788872639.685075:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1788872639.685079:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327649664:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872639.685087:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872639.685108:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327649664:12345-0@lo:38:kworker.0 Request processed in 28us (3575us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872639.685113:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00080000:1.0:1788872639.685150:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872639.685195:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327649152:0@lo:400:kworker.0 00000100:00100000:1.0:1788872639.685207:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327649408:0@lo:400:kworker.0 10000000:01000000:2.0:1788872639.685825:0:87059:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1788872639.685849:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01d9775 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d977c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.685862:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01d9775 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d977c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.685870:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788872639.685896:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.685909:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01d9775 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d977c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.685941:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5440e00/0xe4e6e89fb01d96db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d96e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.685948:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440e00/0xe4e6e89fb01d96db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d96e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.685953:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872639.685957:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.685973:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5440e00/0xe4e6e89fb01d96db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d96e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.685982:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d96f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d96fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.685989:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d96f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d96fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.685995:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872639.685999:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.686002:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01d96f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d96fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.686011:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01d9721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.686017:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01d9721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.686021:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872639.686025:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.686028:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01d9721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.686037:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c58af800/0xe4e6e89fb01d972f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.686044:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c58af800/0xe4e6e89fb01d972f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.686062:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872639.686066:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.686072:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c58af800/0xe4e6e89fb01d972f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9736 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.686081:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb000/0xe4e6e89fb01d974b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9752 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.686088:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb000/0xe4e6e89fb01d974b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9752 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.686094:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872639.686098:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.686101:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb000/0xe4e6e89fb01d974b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9752 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.686110:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8000/0xe4e6e89fb01d9759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.686117:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8000/0xe4e6e89fb01d9759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.686123:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872639.686126:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.686129:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8000/0xe4e6e89fb01d9759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9760 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.686137:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01d9783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d978a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.686153:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01d9783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d978a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.686159:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872639.686162:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.686166:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01d9783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d978a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.686180:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5440400/0xe4e6e89fb01d96e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d96f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.686186:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440400/0xe4e6e89fb01d96e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d96f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.686191:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872639.686194:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.686197:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5440400/0xe4e6e89fb01d96e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d96f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.686207:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9a00/0xe4e6e89fb01d9705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d970c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.686213:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9a00/0xe4e6e89fb01d9705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d970c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.686219:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872639.686223:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.686226:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9a00/0xe4e6e89fb01d9705 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d970c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.686248:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5441c00/0xe4e6e89fb01d9713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d971a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.686255:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5441c00/0xe4e6e89fb01d9713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d971a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.686261:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788872639.686265:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.686269:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5441c00/0xe4e6e89fb01d9713 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d971a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.686278:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01d973d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9744 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.686284:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01d973d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9744 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.686289:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788872639.686293:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.686296:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01d973d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9744 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.686305:0:87059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01d9767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d976e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872639.686311:0:87059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01d9767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d976e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872639.686316:0:87059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788872639.686326:0:87059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872639.686330:0:87059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01d9767 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d976e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788872639.718974:0:87059:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98a9e98d3800 already not connected (conn 62, was 0): CONNECTING 00000100:00080000:2.0:1788872639.718992:0:87059:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:0.0:1788872639.719818:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872639.719853:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1788872639.719866:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:0:1875765327649792:0@lo:250:kworker.0 00000100:00080000:0.0:1788872639.719933:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872639.719938:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872639.719941:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327649024:0@lo:38:kworker.0 00000100:00080000:0.0:1788872639.719955:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872639.719959:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872639.719962:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327649280:0@lo:38:kworker.0 00000100:00080000:0.0:1788872639.719975:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872639.720003:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872639.720006:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327649536:0@lo:38:kworker.0 00000100:00080000:0.0:1788872639.720021:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872639.720024:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872639.720027:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327649664:0@lo:38:kworker.0 00000100:00080000:2.0:1788872639.721963:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872639.721980:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788872639.721985:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872639.721996:0:52416:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3576 00000100:00080000:2.0:1788872639.722004:0:52416:0:(import.c:589:import_select_connection()) MGC192.168.204.139@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788872639.722015:0:52416:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872639.722073:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3b4ad80 x1875765327649920/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872639.723610:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327649920:0@lo:250:kworker.0 00000100:00100000:0.0:1788872639.724310:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872639.724591:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327649920 00000100:00100000:1.0:1788872639.724604:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327649920 00000100:00100000:1.0:1788872639.724656:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788872639.724667:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1875765327649920:12345-0@lo:250:kworker.0 00010000:00080000:1.0:1788872639.724716:0:87064:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo t0 exp 0000000000000000 cur 3576 last 0 00000020:00000080:1.0:1788872639.724761:0:87064:0:(genops.c:1406:class_connect()) connect: client f2e885a0-f180-4b85-9f87-6a01e20afd1a, cookie 0xe4e6e89fb01d9b50 00000100:00080000:1.0:1788872639.724959:0:87064:0:(import.c:65:import_set_state_nolock()) ffff98a9c5f15800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872639.725039:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:3643:x1875765327649920:12345-0@lo:250:kworker.0 Request processed in 372us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872639.725048:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788872639.725331:0:3643:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.139@tcp: committing for last_committed 0 gen 25 00000100:00080000:0.0:1788872639.725345:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.139@tcp: connect to target with instance 0 00000100:00080000:0.0:1788872639.725355:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788872639.725361:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788872639.725365:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788872639.725368:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788872639.725445:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788872639.725457:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327649920:0@lo:250:kworker.0 00000100:00080000:1.0:1788872639.727900:0:87059:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1788872639.727943:0:87059:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788872639.728019:0:87059:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788872639.728028:0:87059:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788872639.728196:0:87059:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788872639.728260:0:87059:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.139@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788872639.728266:0:87059:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788872639.728269:0:87059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788872639.728270:0:87059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872639.728272:0:87059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872639.728274:0:87059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872639.728275:0:87059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872639.728277:0:87059:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788872639.728279:0:87059:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788872639.728282:0:87059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872639.728283:0:87059:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788872639.728286:0:87059:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788872639.728289:0:87059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788872639.728290:0:87059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788872639.728291:0:87059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872639.728292:0:87059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872639.728294:0:87059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872639.728295:0:87059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872639.728296:0:87059:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788872639.728297:0:87059:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788872639.728298:0:87059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872639.728300:0:87059:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788872639.728348:0:87059:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788872639.728378:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327650048:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788872639.728633:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872639.728693:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c71190c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872639.731653:0:87067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327650048 00000100:00100000:0.0:1788872639.731673:0:87067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327650048 00000100:00100000:0.0:1788872639.731764:0:87067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788872639.731776:0:87067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:87059:x1875765327650048:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788872639.731837:0:87067:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788872639.731841:0:87067:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788872639.731844:0:87067:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788872639.735778:0:87068:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788872639.736498:0:87067:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 107 00010000:00010000:0.0:1788872639.737889:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788872639.738528:0:52416:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.139@tcp 10000000:01000000:3.0:1788872639.738585:0:52416:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1788872639.738590:0:52416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788872639.738593:0:52416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788872639.738594:0:52416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872639.738596:0:52416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872639.738597:0:52416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872639.738598:0:52416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872639.738600:0:52416:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788872639.738602:0:52416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872639.738603:0:52416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788872639.738673:0:52416:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788872639.738681:0:52416:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788872639.738683:0:52416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788872639.738684:0:52416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788872639.738693:0:52416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872639.738695:0:52416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872639.738696:0:52416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872639.738697:0:52416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872639.738698:0:52416:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788872639.738699:0:52416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872639.738700:0:52416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788872639.740132:0:52416:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788872639.740151:0:52416:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1788872639.740155:0:52416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788872639.740157:0:52416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788872639.740159:0:52416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872639.740160:0:52416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872639.740162:0:52416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872639.740163:0:52416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872639.740164:0:52416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788872639.740166:0:52416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872639.740168:0:52416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788872639.740209:0:52416:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788872639.740245:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872639.740276:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327650432:0@lo:253:kworker.0 00000100:00100000:3.0:1788872639.740382:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872639.740592:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327650304:0@lo:253:kworker.0 00000100:00100000:3.0:1788872639.741630:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327650432 00000100:00100000:3.0:1788872639.741643:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327650432 00000100:00100000:3.0:1788872639.741751:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788872639.741765:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:3645:x1875765327650432:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788872639.741811:0:87066:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1788872639.742587:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327650176:0@lo:253:kworker.0 00000100:00100000:0.0:1788872639.756047:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872639.759049:0:87064:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1788872639.759074:0:87064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1788872639.759227:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327650176 00000100:00100000:2.0:1788872639.759242:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327650176 00000100:00100000:2.0:1788872639.759391:0:87070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788872639.759405:0:87070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:3646:x1875765327650176:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788872639.759466:0:87070:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1788872639.759603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872639.759668:0:87064:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:2.0:1788872639.759675:0:87064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 20000000:01000000:0.0:1788872639.759988:0:87069:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788872639.759994:0:87069:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788872639.759997:0:87069:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788872639.760000:0:87069:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788872639.760512:0:87069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788872639.760787:0:87067:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788872639.760808:0:87067:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788872639.761650:0:87066:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788872639.761859:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327650304 00000100:00100000:3.0:1788872639.761873:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327650304 00000100:00100000:3.0:1788872639.762023:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788872639.762038:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3647:x1875765327650304:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788872639.762084:0:87071:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1788872639.762462:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872639.762519:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872639.762577:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872639.762622:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311145344 00000100:00100000:1.0:1788872639.762635:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311145344 00000100:00100000:1.0:1788872639.762692:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311145216 00000100:00100000:1.0:1788872639.762695:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311145216 00000100:00100000:2.0:1788872639.762860:0:87064:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 5 min 3 max 32 00000100:00100000:2.0:1788872639.762872:0:87064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0005' 00000100:00100000:2.0:1788872639.763041:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311145088 00000100:00100000:2.0:1788872639.763045:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311145088 00000100:00100000:2.0:1788872639.763139:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5 00000100:00100000:2.0:1788872639.763147:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:0+-99:2403:x1875765311145088:12345-192.168.204.39@tcp:250:kworker.0 00010000:00080000:2.0:1788872639.763178:0:87072:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 8a09bb38-f574-4ce9-b65f-ec6facc58f7e@192.168.204.39@tcp t0 exp 0000000000000000 cur 3576 last 0 00000020:00000080:2.0:1788872639.763213:0:87072:0:(genops.c:1406:class_connect()) connect: client 8a09bb38-f574-4ce9-b65f-ec6facc58f7e, cookie 0xe4e6e89fb01d9b57 00000100:00080000:2.0:1788872639.763386:0:87072:0:(import.c:65:import_set_state_nolock()) ffff98a8c394d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872639.763481:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+5:2403:x1875765311145088:12345-192.168.204.39@tcp:250:kworker.0 Request processed in 333us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872639.763489:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5 00000100:00080000:2.0:1788872639.763586:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872639.763616:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1128 00000100:00100000:2.0:1788872639.763626:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311145344:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872639.763666:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311145344:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 43us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872639.763673:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1128 00000100:00100000:1.0:1788872639.764112:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1127 00000100:00100000:1.0:1788872639.764120:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311145216:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:1.0:1788872639.764142:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872639.764176:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311145216:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 55us (1598us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872639.764183:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1127 00000100:00100000:0.0:1788872639.775477:0:87067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:87059:x1875765327650048:12345-0@lo:253:mount.lustre.0 Request processed in 43070us (46210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872639.775502:0:87067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788872639.775704:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327650048:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788872639.775731:0:87059:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788872639.775735:0:87059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788872639.775737:0:87059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788872639.775739:0:87059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872639.775740:0:87059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872639.775742:0:87059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872639.775744:0:87059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872639.775745:0:87059:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788872639.775748:0:87059:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 20000000:01000000:3.0:1788872639.775750:0:87066:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000020:01000004:1.0:1788872639.775750:0:87059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872639.775752:0:87059:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788872639.775787:0:87059:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a9f6655000 from lustre-MDT0000 20000000:01000000:3.0:1788872639.775791:0:87066:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 10000000:01000000:1.0:1788872639.775836:0:87059:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788872639.775841:0:87059:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788872639.775855:0:87059:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98a9f6655000 20000000:01000000:3.0:1788872639.775961:0:87068:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788872639.775966:0:87068:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788872639.776009:0:87068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c5deb800/0xe4e6e89fb01d9b5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872639.776027:0:87068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5deb800/0xe4e6e89fb01d9b5e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788872639.776037:0:87068:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000071861s 00010000:00010000:3.0:1788872639.776042:0:87068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c5deb800/0xe4e6e89fb01d9b5e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872639.776049:0:87068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c5deb800/0xe4e6e89fb01d9b5e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872639.776056:0:87068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c5deb800/0xe4e6e89fb01d9b5e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872639.776064:0:87068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c5deb800/0xe4e6e89fb01d9b5e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872639.776071:0:87068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872639.776076:0:87068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c5deb800/0xe4e6e89fb01d9b5e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872639.776085:0:87068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c5deb800/0xe4e6e89fb01d9b5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872639.776100:0:87068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c5deb800/0xe4e6e89fb01d9b5e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872639.776108:0:87068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c5deb800/0xe4e6e89fb01d9b5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872639.776123:0:87068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5deb800/0xe4e6e89fb01d9b5e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872639.776345:0:87059:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 20000000:01000000:2.0:1788872639.776454:0:87071:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 10000000:01000000:1.0:1788872639.776476:0:87059:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98a9f6655000 10000000:01000000:1.0:1788872639.776483:0:87059:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788872639.776488:0:87059:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a9f6655000 from 1 10000000:01000000:1.0:1788872639.776492:0:87059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788872639.776541:0:87059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.776742:0:87059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.776755:0:87059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872639.776785:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327650560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788872639.776867:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872639.776899:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:3645:x1875765327650432:12345-0@lo:253:kworker.0 Request processed in 35135us (36515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872639.776909:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:0.0:1788872639.777525:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788872639.777530:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788872639.777531:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872639.777533:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872639.777534:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872639.777536:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872639.777538:0:3645:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872639.777540:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872639.777541:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788872639.777546:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327650432:0@lo:253:kworker.0 00000100:00100000:1.0:1788872639.777704:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c71199c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872639.777713:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327650560 00000100:00100000:2.0:1788872639.777724:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327650560 00000100:00100000:2.0:1788872639.777788:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788872639.777800:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:87059:x1875765327650560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872639.777819:0:87064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872639.777845:0:87064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac5e00/0xe4e6e89fb01d9b6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9b65 expref: -99 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.777876:0:87064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac5e00/0xe4e6e89fb01d9b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9b65 expref: 8 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.777889:0:87064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac5e00/0xe4e6e89fb01d9b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9b65 expref: 8 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.777912:0:87064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5e00, rc 0) 00000100:00100000:2.0:1788872639.777981:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:87059:x1875765327650560:12345-0@lo:101:mount.lustre.0 Request processed in 183us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872639.777988:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788872639.778621:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327650560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872639.778644:0:87059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.778656:0:87059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872639.778677:0:87059:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788872639.778693:0:87059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.778790:0:87059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872639.778802:0:87059:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788872639.778808:0:87059:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788872639.778815:0:87059:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98a9f6655000 10000000:01000000:1.0:1788872639.778817:0:87059:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788872639.778831:0:87059:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788872639.778834:0:87059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788872639.778870:0:87059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.778878:0:87059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.778887:0:87059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872639.778909:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327650688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788872639.778970:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872639.779825:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c71199c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872639.790631:0:87067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327650688 00000100:00100000:3.0:1788872639.790651:0:87067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327650688 00000100:00100000:3.0:1788872639.790733:0:87067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788872639.790749:0:87067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:87059:x1875765327650688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872639.790773:0:87067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872639.790801:0:87067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d9b7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9b73 expref: -99 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872639.790837:0:87067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d9b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9b73 expref: 9 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872639.790850:0:87067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d9b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9b73 expref: 9 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872639.790862:0:87067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5dea600, rc 0) 00000100:00100000:3.0:1788872639.790978:0:87067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:87059:x1875765327650688:12345-0@lo:101:mount.lustre.0 Request processed in 234us (12007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872639.790986:0:87067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788872639.791438:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327650688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872639.791466:0:87059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872639.791478:0:87059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872639.791624:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327650816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872639.791673:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872639.791716:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c12ed600 going to sleep for 11 seconds 20000000:01000000:0.0:1788872639.791980:0:87071:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788872639.791995:0:87071:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788872639.792152:0:87068:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788872639.792157:0:87068:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788872639.792181:0:87068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9b81 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.792194:0:87068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9b81 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788872639.792205:0:87068:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000071861s 00010000:00010000:1.0:1788872639.792210:0:87068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9b81 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.792217:0:87068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9b81 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.792225:0:87068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9b81 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.792256:0:87068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9b81 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.792264:0:87068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872639.792268:0:87068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9b81 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.792277:0:87068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9b81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.792292:0:87068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9b81 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.792301:0:87068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9b81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.792307:0:87068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9b81 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872639.792613:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3647:x1875765327650304:12345-0@lo:253:kworker.0 Request processed in 30577us (33007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872639.792624:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788872639.792660:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327650816 00000100:00100000:0.0:1788872639.792666:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327650816 00000100:00100000:0.0:1788872639.792704:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788872639.792713:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:87059:x1875765327650816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788872639.792888:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:87059:x1875765327650816:12345-0@lo:501:mount.lustre.0 Request processed in 176us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872639.792896:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000004:1.0:1788872639.793026:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788872639.793030:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788872639.793031:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872639.793033:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872639.793035:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872639.793036:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872639.793038:0:3647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788872639.793041:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872639.793042:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788872639.793046:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327650304:0@lo:253:kworker.0 00000100:00100000:2.0:1788872639.793667:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327650816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872639.793721:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327650944:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872639.793789:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872639.793830:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c12ed600 going to sleep for 11 seconds 20000000:01000000:2.0:1788872639.793860:0:87070:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788872639.794365:0:87067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327650944 00000100:00100000:0.0:1788872639.794374:0:87067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327650944 00000100:00100000:0.0:1788872639.794433:0:87067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788872639.794442:0:87067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:87059:x1875765327650944:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872639.797906:0:87067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:87059:x1875765327650944:12345-0@lo:503:mount.lustre.0 Request processed in 3446us (4098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872639.797936:0:87067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788872639.804594:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327650944:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872639.805597:0:87073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87073:1875765327651072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872639.805721:0:87073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872639.805771:0:87073:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c12ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1788872639.805860:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327651072 00000100:00100000:0.0:1788872639.805869:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327651072 00000100:00100000:0.0:1788872639.805948:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788872639.805960:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:87073:x1875765327651072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872639.806840:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:87073:x1875765327651072:12345-0@lo:502:llog_process_th.0 Request processed in 876us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872639.806854:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788872639.806994:0:87073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87073:1875765327651072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788872639.807046:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872639.807062:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872639.807065:0:87073:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788872639.807072:0:87073:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788872639.807075:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788872639.807096:0:87073:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98a9e9b099c0) 00000020:00000080:2.0:1788872639.807125:0:87073:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1788872639.807132:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788872639.807244:0:87073:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788872639.807253:0:87073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9b8f 00000020:00000080:2.0:1788872639.807603:0:87073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788872639.807608:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872639.807613:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872639.807615:0:87073:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788872639.807618:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872639.807622:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872639.807624:0:87073:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788872639.807628:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788872639.807637:0:87073:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98a9e9b08000) 00000020:00000080:2.0:1788872639.807652:0:87073:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1788872639.807656:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788872639.807658:0:87073:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788872639.807662:0:87073:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788872639.807669:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788872639.807729:0:87073:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9f6655000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788872639.807745:0:87073:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98a8c340b380) 00000020:00000080:2.0:1788872639.807756:0:87073:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1788872639.807826:0:87073:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788872639.807833:0:87073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d9ba4 00000020:00000080:2.0:1788872639.807957:0:87073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788872639.807966:0:87073:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788872639.807970:0:87073:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe4e6e89fb01d9bab 00080000:01000000:2.0:1788872639.807984:0:87073:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788872639.807988:0:87073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9bb2 20000000:01000000:0.0:1788872639.811583:0:87070:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788872639.811603:0:87070:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788872639.812174:0:87068:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788872639.812191:0:87068:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788872639.812222:0:87068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9bb9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.812263:0:87068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9bb9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788872639.812276:0:87068:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000086610s 00010000:00010000:1.0:1788872639.812282:0:87068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9bb9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.812289:0:87068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9bb9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.812298:0:87068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9bb9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.812307:0:87068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9bb9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.812315:0:87068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872639.812320:0:87068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9bb9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.812331:0:87068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9bb9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.812350:0:87068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9bb9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.812359:0:87068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9bb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872639.812366:0:87068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9bb9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872639.814375:0:87070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3646:x1875765327650176:12345-0@lo:253:kworker.0 Request processed in 54958us (58323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872639.814396:0:87070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1788872639.825744:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788872639.825753:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788872639.825756:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872639.825757:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872639.825784:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872639.825787:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872639.825790:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788872639.825792:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872639.825794:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788872639.825805:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327650176:0@lo:253:kworker.0 00010000:00010000:2.0:1788872640.086997:0:87073:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788872640.087200:0:87073:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 idx: 0 lr: 98784247815 srv lr: 103079215104 lx: 0 gen 23 00000001:00080000:2.0:1788872640.087266:0:87073:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 22 00000001:00000004:2.0:1788872640.087291:0:87073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:2.0:1788872640.087427:0:87073:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788872640.087507:0:87073:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff98a9ff5bf900: xid 1875765311138176, transno 103079215108, client gen 23, slot idx 0 00000001:00080000:2.0:1788872640.087519:0:87073:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff98a9ff5bf300: xid 1875765311137920, transno 103079215107, client gen 23, slot idx 1 00000020:00000080:3.0:1788872640.096268:0:87073:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98a9efa799c0) 00000020:00000080:3.0:1788872640.096309:0:87073:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1788872640.096455:0:87073:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788872640.096463:0:87073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9bd5 00000020:00000080:3.0:1788872640.106975:0:87073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788872640.135081:0:87073:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe4e6e89fb01d9bdc 00000020:00000080:0.0:1788872640.138938:0:87073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788872640.138958:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872640.138973:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.138975:0:87073:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788872640.138979:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788872640.138982:0:87073:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788872640.138984:0:87073:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788872640.138986:0:87073:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788872640.138988:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788872640.139013:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.139015:0:87073:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788872640.139018:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872640.139025:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.139027:0:87073:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788872640.139033:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788872640.139125:0:87073:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788872640.139148:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872640.139152:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.139153:0:87073:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788872640.139156:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872640.139159:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.139161:0:87073:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788872640.139164:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788872640.139170:0:87073:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:00000080:0.0:1788872640.139213:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788872640.139242:0:87073:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98a8c72ecd40) 00000020:00000080:0.0:1788872640.139272:0:87073:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788872640.139281:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788872640.139363:0:87073:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788872640.139370:0:87073:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788872640.139379:0:87073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9bea 00010000:00080000:0.0:1788872640.142599:0:87073:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9c8f4a000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:1.0:1788872640.151458:0:87073:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1788872640.156945:0:87073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872640.156969:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788872640.157031:0:87073:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788872640.157067:0:87073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d9bf1 00000100:00080000:3.0:1788872640.157082:0:87073:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788872640.157090:0:87073:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98a9c8f4a000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872640.157142:0:87073:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff54e300 x1875765327651200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872640.157214:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327651200:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788872640.157320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788872640.157431:0:87073:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788872640.157503:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872640.157509:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872640.157511:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872640.157517:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3576 00000100:00080000:3.0:1788872640.157521:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872640.157525:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872640.157540:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff54df80 x1875765327651456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872640.158572:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327651200 00000100:00100000:1.0:1788872640.158588:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327651200 00000100:00100000:1.0:1788872640.158646:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:1.0:1788872640.158656:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327651200:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788872640.158691:0:23717:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3577 last 0 00000020:00000080:1.0:1788872640.158751:0:23717:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d9bf8 00000004:00100000:1.0:1788872640.158773:0:23717:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788872640.158910:0:23717:0:(import.c:65:import_set_state_nolock()) ffff98a9ef97b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872640.166643:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327651456:0@lo:38:kworker.0 00000100:00100000:0.0:1788872640.166829:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.167387:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327651456 00000100:00100000:2.0:1788872640.167410:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327651456 00000100:00100000:2.0:1788872640.167478:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1788872640.167489:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327651456:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788872640.167603:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327651456:12345-0@lo:38:kworker.0 Request processed in 115us (775us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788872640.167612:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1788872640.168629:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327651328:0@lo:400:kworker.0 00000100:00100000:3.0:1788872640.168737:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788872640.168882:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872640.168887:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872640.168891:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872640.168897:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3576 00000100:00080000:3.0:1788872640.168902:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872640.168910:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872640.168937:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327651584:0@lo:400:kworker.0 00000100:00100000:3.0:1788872640.168967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872640.169010:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327651584 00000100:00100000:3.0:1788872640.169017:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327651584 00000100:00100000:3.0:1788872640.169096:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1788872640.169107:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327651584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872640.169172:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327651584:12345-0@lo:400:kworker.0 Request processed in 67us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.169180:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1788872640.169229:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327651584:0@lo:400:kworker.0 00000100:00100000:3.0:1788872640.169273:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff54c380 x1875765327651712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872640.169299:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872640.169303:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872640.169305:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872640.169308:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3576 00000100:00080000:3.0:1788872640.169311:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872640.169315:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872640.169328:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872640.169336:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327651840:0@lo:400:kworker.0 00000100:00100000:3.0:1788872640.169362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872640.169398:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5af7800 x1875765327651968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872640.169441:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327652096:0@lo:400:kworker.0 00000100:00100000:3.0:1788872640.169474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872640.169516:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327652096 00000100:00100000:3.0:1788872640.169519:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327652096 00000100:00100000:3.0:1788872640.169578:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479 00000100:00100000:3.0:1788872640.169587:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327652096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872640.169626:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327652096:12345-0@lo:400:kworker.0 Request processed in 42us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.169633:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479 00000100:00100000:3.0:1788872640.169660:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327652096:0@lo:400:kworker.0 00000100:00080000:3.0:1788872640.169686:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872640.169690:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872640.169692:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872640.169696:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3576 00000100:00080000:3.0:1788872640.169699:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872640.169703:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872640.169712:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327652224:0@lo:400:kworker.0 00000100:00100000:3.0:1788872640.169736:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872640.169768:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327652224 00000100:00100000:3.0:1788872640.169772:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327652224 00000100:00100000:3.0:1788872640.169807:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480 00000100:00100000:3.0:1788872640.169814:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327652224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872640.169850:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327652224:12345-0@lo:400:kworker.0 Request processed in 37us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.169856:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480 00000100:00100000:3.0:1788872640.169881:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327652224:0@lo:400:kworker.0 00000100:00100000:3.0:1788872640.169905:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5af6a00 x1875765327652352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:3.0:1788872640.170031:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872640.170038:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872640.170041:0:87073:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788872640.170044:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788872640.170047:0:87073:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788872640.170049:0:87073:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788872640.170050:0:87073:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788872640.170052:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788872640.170055:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872640.170056:0:87073:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788872640.170059:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788872640.170065:0:87073:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788872640.170069:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872640.170070:0:87073:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788872640.170073:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788872640.170077:0:87073:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:3.0:1788872640.170104:0:87073:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788872640.170106:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788872640.170125:0:87073:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98a9efa7b380) 00000020:00000080:3.0:1788872640.170152:0:87073:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788872640.170157:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788872640.170259:0:87073:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788872640.170273:0:87073:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788872640.170281:0:87073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9c06 00010000:00080000:3.0:1788872640.170318:0:87073:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a8c36d1000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:3.0:1788872640.170627:0:87073:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1788872640.173493:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327651200:12345-0@lo:38:llog_process_th.0 Request processed in 14819us (16155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.173516:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:1.0:1788872640.173660:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327651840 00000100:00100000:1.0:1788872640.173672:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327651840 00000100:00100000:1.0:1788872640.173741:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1788872640.173951:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327651840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872640.174074:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327651840:12345-0@lo:400:kworker.0 Request processed in 324us (4709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.174189:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1788872640.174270:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327651840:0@lo:400:kworker.0 00000100:00100000:2.0:1788872640.174613:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327651328 00000100:00100000:2.0:1788872640.174621:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327651328 00000100:00100000:2.0:1788872640.174674:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788872640.174684:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3645:x1875765327651328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872640.174760:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3645:x1875765327651328:12345-0@lo:400:kworker.0 Request processed in 77us (6022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.174768:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788872640.180282:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327651328:0@lo:400:kworker.0 00000100:00100000:0.0:1788872640.181525:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788872640.181562:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1788872640.181576:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788872640.181600:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788872640.181605:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9c8f4a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788872640.181631:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327651200:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788872640.181680:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327651712:0@lo:38:kworker.0 00000100:00100000:0.0:1788872640.181791:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872640.181867:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327651712 00000100:00100000:0.0:1788872640.181877:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327651712 00000100:00100000:0.0:1788872640.181951:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:0.0:1788872640.181960:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327651712:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788872640.182030:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327651712:12345-0@lo:38:kworker.0 Request processed in 69us (239us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788872640.182038:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1788872640.182263:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327652480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872640.182313:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788872640.182499:0:87073:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788872640.182785:0:87073:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788872640.182901:0:87073:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000100:00080000:0.0:1788872640.183709:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872640.183720:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788872640.183728:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327651712:0@lo:38:kworker.0 00000100:00100000:0.0:1788872640.183771:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327652480 00000100:00100000:0.0:1788872640.183781:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327652480 00000100:00100000:0.0:1788872640.183885:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:0.0:1788872640.183895:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327652480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788872640.183947:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:0.0:1788872640.184045:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327652480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872640.184053:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000040:00080000:1.0:1788872640.186194:0:87073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788872640.186239:0:87073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:1.0:1788872640.188320:0:87073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000040:00080000:3.0:1788872640.196643:0:87079:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:3.0:1788872640.196654:0:87079:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788872640.196968:0:87079:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1788872640.197008:0:87079:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788872640.197352:0:87079:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:3.0:1788872640.197357:0:87079:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788872640.197616:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327651968:0@lo:38:kworker.0 00000100:00100000:1.0:1788872640.197727:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.197785:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327652352:0@lo:38:kworker.0 00000100:00100000:1.0:1788872640.197820:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788872640.197882:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1788872640.197884:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327652352 00000100:00080000:1.0:1788872640.197892:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788872640.197896:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327652352 00000100:00100000:1.0:1788872640.197898:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327651456:0@lo:38:kworker.0 00000100:00100000:2.0:1788872640.197964:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1788872640.197971:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327651968 00000100:00100000:2.0:1788872640.197976:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327652352:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788872640.197977:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327651968 00000100:00100000:1.0:1788872640.198009:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:1.0:1788872640.198015:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327651968:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788872640.198077:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327652352:12345-0@lo:38:kworker.0 Request processed in 102us (254us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788872640.198278:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327651968:12345-0@lo:38:kworker.0 Request processed in 260us (551us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788872640.198287:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00080000:1.0:1788872640.198325:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872640.198330:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788872640.198333:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327651968:0@lo:38:kworker.0 00000100:00080000:1.0:1788872640.198343:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872640.198346:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788872640.198348:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327652352:0@lo:38:kworker.0 00000100:00100000:2.0:1788872640.198792:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000020:00000080:2.0:1788872640.200363:0:87073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872640.200384:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788872640.200450:0:87073:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788872640.200485:0:87073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d9c0d 00000100:00080000:2.0:1788872640.200500:0:87073:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788872640.200509:0:87073:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98a8c36d1000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872640.200605:0:87073:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3b4b480 x1875765327652608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872640.200647:0:87073:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788872640.201284:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872640.201294:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872640.201296:0:87073:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788872640.201300:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788872640.201303:0:87073:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788872640.201305:0:87073:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788872640.201307:0:87073:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788872640.201308:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788872640.201311:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872640.201313:0:87073:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788872640.201315:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788872640.201321:0:87073:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788872640.201325:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872640.201327:0:87073:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788872640.201330:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788872640.201357:0:87073:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:2.0:1788872640.201391:0:87073:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788872640.201394:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788872640.201415:0:87073:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98a8c3408000) 00000020:00000080:2.0:1788872640.201445:0:87073:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788872640.201451:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788872640.202942:0:87073:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788872640.202958:0:87073:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788872640.202971:0:87073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01d9c1b 00010000:00080000:2.0:1788872640.203026:0:87073:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9f0832800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:2.0:1788872640.203691:0:87073:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1788872640.204044:0:87073:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788872640.204065:0:87073:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788872640.204227:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327652480:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788872640.204305:0:87073:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000100:00100000:1.0:1788872640.204419:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327652608:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788872640.204533:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872640.204693:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327652608 00000100:00100000:0.0:1788872640.204710:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327652608 00000100:00100000:0.0:1788872640.204763:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5942 00000100:00100000:0.0:1788872640.204773:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3643:x1875765327652608:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788872640.204811:0:26188:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3577 last 0 00000020:00000080:0.0:1788872640.204852:0:26188:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d9c22 00002000:00100000:0.0:1788872640.204871:0:26188:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98a8c6775000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788872640.204876:0:26188:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788872640.204880:0:26188:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788872640.204973:0:26188:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788872640.205006:0:26188:0:(import.c:65:import_set_state_nolock()) ffff98a8c6773000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788872640.206317:0:87073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788872640.206357:0:87073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000100:00100000:0.0:1788872640.207356:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327652608:12345-0@lo:8:llog_process_th.0 Request processed in 2571us (2812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872640.207374:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5942 00000100:00100000:1.0:1788872640.207627:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788872640.207642:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788872640.207655:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788872640.207672:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788872640.207678:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c36d1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:2.0:1788872640.207685:0:87073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000004:00080000:1.0:1788872640.207708:0:3643:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:1.0:1788872640.207719:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327652608:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788872640.207849:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327652736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872640.207942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.208005:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327652736 00000100:00100000:1.0:1788872640.208013:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327652736 00000100:00100000:1.0:1788872640.208094:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:1.0:1788872640.208105:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327652736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872640.208132:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788872640.208176:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872640.208187:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327652736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.208195:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:1.0:1788872640.208238:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327652736:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788872640.209225:0:87079:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788872640.209336:0:87079:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3577335786184ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788872640.209345:0:87079:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:0.0:1788872640.209999:0:87081:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:0.0:1788872640.210005:0:87081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788872640.210249:0:87081:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000020:00000080:0.0:1788872640.211252:0:87073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872640.211272:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788872640.211332:0:87073:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788872640.211368:0:87073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d9c29 00000100:00080000:0.0:1788872640.211383:0:87073:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788872640.211390:0:87073:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98a9f0832800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872640.212632:0:87073:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3a64a80 x1875765327652864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872640.212680:0:87073:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000040:00080000:1.0:1788872640.212797:0:87081:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000020:01000000:0.0:1788872640.212956:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872640.212964:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.212966:0:87073:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788872640.212970:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872640.212976:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.212978:0:87073:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788872640.212984:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788872640.212986:0:87073:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788872640.212990:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872640.212993:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.212994:0:87073:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788872640.212997:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872640.212999:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.213001:0:87073:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788872640.213006:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788872640.213059:0:87073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87073:1875765327652992:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788872640.213083:0:87081:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:1.0:1788872640.213089:0:87081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1788872640.213371:0:87073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.214381:0:87067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327652992 00000100:00100000:1.0:1788872640.214396:0:87067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327652992 00000100:00100000:1.0:1788872640.214475:0:87067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788872640.214487:0:87067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:87073:x1875765327652992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872640.215374:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327652864:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788872640.216655:0:87067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:87073:x1875765327652992:12345-0@lo:502:llog_process_th.0 Request processed in 2160us (3274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.216673:0:87067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:2.0:1788872640.218603:0:87060:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788872640.230092:0:87073:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef2af480 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.230194:0:87073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87073:1875765327652992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872640.230265:0:87073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872640.230279:0:87073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872640.230282:0:87073:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788872640.230290:0:87073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788872640.232301:0:87059:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788872640.232349:0:87059:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788872640.232371:0:87059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.232386:0:87059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872640.232396:0:87059:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9f6655000 from 1 10000000:01000000:0.0:1788872640.232409:0:87059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788872640.232466:0:87059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.232475:0:87059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.232507:0:87059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872640.232539:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327653120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788872640.235372:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.235543:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327652864 00000100:00100000:2.0:1788872640.235594:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327652864 00000100:00100000:2.0:1788872640.235644:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5943 00000100:00100000:2.0:1788872640.235655:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3643:x1875765327652864:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788872640.235713:0:26189:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3577 last 0 00000020:00000080:2.0:1788872640.235757:0:26189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01d9c37 00002000:00100000:2.0:1788872640.235774:0:26189:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98aa002c7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788872640.235779:0:26189:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788872640.235782:0:26189:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788872640.235880:0:26189:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788872640.235942:0:26189:0:(import.c:65:import_set_state_nolock()) ffff98aa002c7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872640.236020:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327652864:12345-0@lo:8:llog_process_th.0 Request processed in 365us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.236029:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5943 00000100:00100000:3.0:1788872640.236596:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788872640.236609:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788872640.236620:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788872640.236627:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788872640.236631:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9f0832800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788872640.236646:0:3643:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:3.0:1788872640.236652:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327652864:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788872640.236828:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872640.236842:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327653248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872640.236898:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788872640.237060:0:87081:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788872640.237156:0:87081:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3577363606506ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788872640.237164:0:87081:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788872640.237873:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872640.237949:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c1359600 going to sleep for 11 seconds 00000100:00100000:0.0:1788872640.237996:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327653248 00000100:00100000:0.0:1788872640.238005:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327653248 00000100:00100000:0.0:1788872640.238086:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:3.0:1788872640.238098:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327653120 00000100:00100000:0.0:1788872640.238098:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efcc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327653248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872640.238105:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327653120 00002000:00000024:0.0:1788872640.238129:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872640.238149:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788872640.238159:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:87059:x1875765327653120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872640.238171:0:87071:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788872640.238191:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efcc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327653248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1291us total) trans 0 rc 0/0 00010000:00010000:3.0:1788872640.238197:0:87071:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5dea200/0xe4e6e89fb01d9c3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9c30 expref: -99 pid: 87071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872640.238202:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00010000:00010000:3.0:1788872640.238234:0:87071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5dea200/0xe4e6e89fb01d9c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c30 expref: 9 pid: 87071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.238265:0:87071:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5dea200/0xe4e6e89fb01d9c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c30 expref: 9 pid: 87071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.238276:0:87071:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5dea200, rc 0) 00000100:00100000:3.0:1788872640.238321:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:87059:x1875765327653120:12345-0@lo:101:mount.lustre.0 Request processed in 163us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.238329:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788872640.238516:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872640.238593:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327653248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872640.238634:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327653120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788872640.238653:0:87059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c3e expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.238666:0:87059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9c3e expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.239305:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327653376:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788872640.239370:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.239410:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.239614:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327653376 00000100:00100000:1.0:1788872640.239621:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327653376 00000100:00100000:1.0:1788872640.239667:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788872640.239675:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:87059:x1875765327653376:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788872640.239709:0:87066:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788872640.239732:0:87066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788872640.239736:0:87066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788872640.239740:0:87066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788872640.239743:0:87066:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 110 00000100:00100000:1.0:1788872640.239835:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:87059:x1875765327653376:12345-0@lo:256:mount.lustre.0 Request processed in 161us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.239843:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788872640.240330:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327653376:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788872640.241153:0:87059:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788872640.241181:0:87059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c3e expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.241195:0:87059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c3e expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872640.241207:0:87059:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9f6655000 from 1 10000000:01000000:2.0:1788872640.241210:0:87059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788872640.241259:0:87059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.241267:0:87059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.241280:0:87059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.241320:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327653504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788872640.241387:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.241444:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2540 going to sleep for 11 seconds 00000004:00080000:1.0:1788872640.241966:0:87060:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788872640.242281:0:87067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327653504 00000100:00100000:0.0:1788872640.242293:0:87067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327653504 00000100:00100000:0.0:1788872640.242360:0:87067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788872640.242383:0:87067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:87059:x1875765327653504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788872640.242411:0:87067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872640.242433:0:87067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa98ea00/0xe4e6e89fb01d9c4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9c45 expref: -99 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.242465:0:87067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa98ea00/0xe4e6e89fb01d9c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c45 expref: 10 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.242478:0:87067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa98ea00/0xe4e6e89fb01d9c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c45 expref: 10 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.242489:0:87067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa98ea00, rc 0) 00000100:00100000:0.0:1788872640.242602:0:87067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:87059:x1875765327653504:12345-0@lo:101:mount.lustre.0 Request processed in 221us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872640.242610:0:87067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788872640.243198:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327653504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872640.243225:0:87059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.243237:0:87059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.243342:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327653632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872640.243384:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.243422:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788872640.243507:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327653632 00000100:00100000:3.0:1788872640.243513:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327653632 00000100:00100000:3.0:1788872640.243579:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788872640.243588:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:87059:x1875765327653632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788872640.243769:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:87059:x1875765327653632:12345-0@lo:501:mount.lustre.0 Request processed in 182us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.243776:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788872640.243845:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327653632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872640.243874:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327653760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872640.243933:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.243957:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.244488:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327653760 00000100:00100000:1.0:1788872640.244498:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327653760 00000100:00100000:1.0:1788872640.244588:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788872640.244598:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:87059:x1875765327653760:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872640.244765:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:87059:x1875765327653760:12345-0@lo:503:mount.lustre.0 Request processed in 169us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.244773:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788872640.246229:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327653760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872640.247287:0:87083:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87083:1875765327653888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872640.247408:0:87083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.247460:0:87083:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872640.247689:0:87067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327653888 00000100:00100000:0.0:1788872640.249621:0:87067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327653888 00000100:00100000:1.0:1788872640.250102:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788872640.250121:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:87083:x1875765327653888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872640.253151:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:87083:x1875765327653888:12345-0@lo:502:llog_process_th.0 Request processed in 3021us (5735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.253173:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788872640.254238:0:87083:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87083:1875765327653888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788872640.254311:0:87083:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872640.254328:0:87083:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.254331:0:87083:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788872640.254343:0:87083:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a9f6655000 00000020:00000080:0.0:1788872640.254347:0:87083:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788872640.254357:0:87083:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872640.254360:0:87083:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.254361:0:87083:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788872640.254364:0:87083:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872640.254367:0:87083:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.254368:0:87083:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788872640.254372:0:87083:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a9f6655000 00000020:00000080:0.0:1788872640.254387:0:87083:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788872640.259024:0:87083:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87083:1875765327654016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872640.259153:0:87083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872640.259213:0:87083:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.260418:0:87070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327654016 00000100:00100000:1.0:1788872640.260433:0:87070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327654016 00000100:00100000:1.0:1788872640.260514:0:87070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788872640.260529:0:87070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:87083:x1875765327654016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872640.268093:0:87070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:87083:x1875765327654016:12345-0@lo:502:llog_process_th.0 Request processed in 7556us (8927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.268113:0:87070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788872640.268856:0:87083:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87083:1875765327654016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788872640.268921:0:87083:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872640.268934:0:87083:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872640.268936:0:87083:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788872640.268943:0:87083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788872640.269636:0:87059:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788872640.269676:0:87059:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788872640.269714:0:87059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.269729:0:87059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872640.269821:0:87059:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788872640.269825:0:87059:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98a9f6655000 10000000:01000000:2.0:1788872640.269829:0:87059:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98a9f6655000 10000000:01000000:2.0:1788872640.269834:0:87059:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788872640.269843:0:87059:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9f6655000 from 1 10000000:01000000:2.0:1788872640.269847:0:87059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788872640.269897:0:87059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.269906:0:87059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.269930:0:87059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.269962:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327654144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788872640.270051:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.270267:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327654144 00000100:00100000:1.0:1788872640.270278:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327654144 00000100:00100000:1.0:1788872640.270340:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788872640.270351:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:87059:x1875765327654144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872640.270370:0:87066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872640.270386:0:87066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9c5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9c53 expref: -99 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.270418:0:87066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c53 expref: 11 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.270430:0:87066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c53 expref: 11 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.270451:0:87066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d800, rc 0) 00000100:00100000:1.0:1788872640.270498:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87059:x1875765327654144:12345-0@lo:101:mount.lustre.0 Request processed in 148us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.270505:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788872640.271868:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.271928:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327654144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872640.271957:0:87059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.271972:0:87059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.272164:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327654272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872640.272229:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.272275:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.272420:0:87067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327654272 00000100:00100000:1.0:1788872640.272430:0:87067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327654272 00000100:00100000:1.0:1788872640.272495:0:87067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788872640.272506:0:87067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87059:x1875765327654272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872640.272938:0:87067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87059:x1875765327654272:12345-0@lo:501:mount.lustre.0 Request processed in 429us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.272944:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327654272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872640.272951:0:87067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788872640.272992:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327654400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872640.273041:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872640.273154:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327654400 00000100:00100000:0.0:1788872640.273160:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327654400 00000100:00100000:0.0:1788872640.273202:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788872640.273210:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87059:x1875765327654400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872640.273322:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87059:x1875765327654400:12345-0@lo:503:mount.lustre.0 Request processed in 114us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872640.273329:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788872640.273630:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.273648:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327654400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872640.276869:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87085:1875765327654528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872640.277010:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.277062:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5cf1780 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.279220:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327654528 00000100:00100000:2.0:1788872640.279242:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327654528 00000100:00100000:2.0:1788872640.279352:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788872640.279376:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87085:x1875765327654528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872640.280591:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87085:x1875765327654528:12345-0@lo:502:llog_process_th.0 Request processed in 1208us (3571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.280606:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788872640.281465:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87085:1875765327654528:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788872640.281602:0:87085:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788872640.281628:0:87085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98a9fa793380) 00000020:00000080:2.0:1788872640.281667:0:87085:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788872640.287635:0:87085:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9f6655000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788872640.287650:0:87085:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9f6655000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788872640.287654:0:87085:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9f6655000 4 00010000:00080000:2.0:1788872640.287712:0:87085:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9dfe90000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:2.0:1788872640.298572:0:87085:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1788872640.298736:0:87085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788872640.298808:0:87085:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788872640.298828:0:87085:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe4e6e89fb01d9c68 00000100:00080000:2.0:1788872640.298843:0:87085:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788872640.298858:0:87085:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98a9dfe90000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872640.298908:0:87085:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3b49880 x1875765327654656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872640.298958:0:87085:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788872640.300223:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327654656:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788872640.300347:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.300491:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327654656 00000100:00100000:2.0:1788872640.300503:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327654656 00000100:00100000:2.0:1788872640.300578:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1788872640.300588:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327654656:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788872640.300672:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327654656:12345-0@lo:38:llog_process_th.0 Request processed in 82us (324us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788872640.300680:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1788872640.302866:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788872640.302886:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe90000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872640.302895:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788872640.302900:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327654656:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788872640.306773:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87085:1875765327654784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872640.306924:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872640.306989:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327654784 00000100:00100000:3.0:1788872640.306998:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327654784 00000100:00100000:1.0:1788872640.307827:0:87067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788872640.307845:0:87067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87085:x1875765327654784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872640.308426:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c550cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872640.308462:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87085:1875765327654784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872640.308582:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87085:1875765327654912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872640.308640:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872640.308673:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c550cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.310214:0:87067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87085:x1875765327654784:12345-0@lo:502:llog_process_th.0 Request processed in 230us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.310246:0:87067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788872640.310340:0:87067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327654912 00000100:00100000:1.0:1788872640.310352:0:87067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327654912 00000100:00100000:1.0:1788872640.310416:0:87067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788872640.310425:0:87067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87085:x1875765327654912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872640.310637:0:87067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87085:x1875765327654912:12345-0@lo:502:llog_process_th.0 Request processed in 213us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.310653:0:87067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788872640.311827:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87085:1875765327654912:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788872640.311904:0:87085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788872640.321827:0:87059:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788872640.321900:0:87059:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788872640.321938:0:87059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.321955:0:87059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788872640.322161:0:87059:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788872640.322164:0:87059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788872640.326303:0:87059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872640.326370:0:87059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872640.326371:0:87059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872640.326376:0:87059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872640.326377:0:87059:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788872640.326379:0:87059:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788872640.326382:0:87059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872640.326383:0:87059:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788872640.326391:0:87059:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788872640.326396:0:87059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788872640.326415:0:87059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788872640.326416:0:87059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872640.326417:0:87059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872640.326418:0:87059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872640.326419:0:87059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872640.326420:0:87059:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788872640.326421:0:87059:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788872640.326422:0:87059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872640.326423:0:87059:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788872640.326475:0:87059:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788872640.326508:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327655040:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788872640.326635:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.326700:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa9540c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872640.328587:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327655040 00000100:00100000:3.0:1788872640.328608:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327655040 00000100:00100000:3.0:1788872640.328728:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788872640.328743:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87059:x1875765327655040:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788872640.328793:0:87066:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788872640.328815:0:87066:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788872640.337514:0:87066:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788872640.337541:0:87066:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788872640.337665:0:87068:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788872640.337672:0:87068:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788872640.337703:0:87068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.337728:0:87068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c5dea200/0xe4e6e89fb01d9c3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c30 expref: 11 pid: 87071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.337740:0:87068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.337819:0:87068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c5dea200/0xe4e6e89fb01d9c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01d9c30 expref: 11 pid: 87071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.337840:0:87068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c5dea200/0xe4e6e89fb01d9c3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01d9c30 expref: 11 pid: 87071 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872640.337860:0:87068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87068:1875765327655168:0@lo:104: 00000100:00100000:3.0:1788872640.337996:0:87068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872640.338067:0:87068:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c550cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.338129:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788872640.338155:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327655168 00000100:00100000:2.0:1788872640.338165:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327655168 00000100:00100000:2.0:1788872640.338228:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788872640.338239:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:87068:x1875765327655168:12345-0@lo:104: 00010000:00010000:2.0:1788872640.338255:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01d9c3e expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.338427:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788872640.338434:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:87068:x1875765327655168:12345-0@lo:104: Request processed in 197us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.338443:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788872640.339514:0:87068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87068:1875765327655168:0@lo:104: 00010000:00010000:3.0:1788872640.339582:0:87068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872640.339731:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:87059:x1875765327655040:12345-0@lo:253:mount.lustre.0 Request processed in 10991us (13096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.339744:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788872640.339827:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:87059:1875765327655040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788872640.339843:0:87059:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788872640.339847:0:87059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788872640.339849:0:87059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788872640.339851:0:87059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872640.339852:0:87059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872640.339854:0:87059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872640.339865:0:87059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872640.339866:0:87059:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788872640.339868:0:87059:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788872640.339871:0:87059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872640.339873:0:87059:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788872640.339894:0:87059:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788872640.343083:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872640.343104:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01d9c3e expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.343119:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98f000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872640.343133:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01d9c3e expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.343147:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01d9c3e expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872640.343155:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01d9c3e expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872640.343162:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872640.343232:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01d9c3e expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.343239:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872640.343271:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01d9c3e expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.343278:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f000/0xe4e6e89fb01d9c30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01d9c3e expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.343295:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872640.343298:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872640.343299:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872640.343423:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327655296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872640.343513:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872640.343634:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327655296 00000100:00100000:0.0:1788872640.343644:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327655296 00010000:00010000:0.0:1788872640.343684:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c5dea200/0xe4e6e89fb01d9c3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01d9c30 expref: 11 pid: 87071 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872640.344008:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:0.0:1788872640.344029:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:3645:x1875765327655296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872640.344049:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872640.344056:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c5dea200/0xe4e6e89fb01d9c3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01d9c30 expref: 11 pid: 87071 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.344071:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c5dea200/0xe4e6e89fb01d9c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01d9c30 expref: 11 pid: 87071 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.344092:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5dea200/0xe4e6e89fb01d9c3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01d9c30 expref: 11 pid: 87071 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.344113:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.344124:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788872640.344144:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006473694s 00010000:00010000:0.0:1788872640.344150:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.344158:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.344166:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.344173:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.344178:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5dea400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872640.344188:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.344197:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.344219:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.344231:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872640.344290:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:3645:x1875765327655296:12345-0@lo:103:ldlm_bl.0 Request processed in 263us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872640.344298:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00010000:00010000:3.0:1788872640.344357:0:87068:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.344368:0:87068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.344375:0:87068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c6f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872640.352848:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327655296:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788872640.374273:0:87059:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411353 00000040:01000000:3.0:1788872640.376370:0:87059:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788872640.376540:0:87091:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411353 00000020:00080000:2.0:1788872640.376546:0:87091:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411353 00000040:01000000:2.0:1788872640.378966:0:87092:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788872640.379618:0:87092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788872640.381248:0:87059:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:3.0:1788872640.386978:0:87059:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788872640.387060:0:87059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788872640.389594:0:87059:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788872640.389617:0:87059:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788872640.392276:0:87059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788872640.395892:0:87093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87093:1875765327655424:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788872640.396015:0:87093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788872640.396484:0:87092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000100:00100000:3.0:1788872640.396684:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327655424 00000100:00100000:3.0:1788872640.396707:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327655424 00000100:00100000:3.0:1788872640.396787:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:3.0:1788872640.396801:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87093:x1875765327655424:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788872640.399081:0:87093:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e7bc66c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788872640.400464:0:87092:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788872640.400860:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87093:x1875765327655424:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 4056us (4838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.400876:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000040:00080000:3.0:1788872640.405101:0:87059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788872640.406686:0:87059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788872640.407428:0:87059:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788872640.407625:0:87059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788872640.412716:0:87093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87093:1875765327655424:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788872640.412801:0:87093:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788872640.412897:0:87093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87093:1875765327655552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788872640.413018:0:87093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872640.413157:0:87093:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e7bc66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.413833:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327655552 00000100:00100000:1.0:1788872640.413844:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327655552 00000100:00100000:1.0:1788872640.413922:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:1.0:1788872640.413934:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87093:x1875765327655552:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788872640.414286:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87093:x1875765327655552:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 353us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872640.414297:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:1.0:1788872640.414335:0:87093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87093:1875765327655552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788872640.414679:0:87093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87093:1875765327655680:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788872640.414721:0:87093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872640.414779:0:87093:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e7bc6c00 going to sleep for 11 seconds 00080000:10000000:3.0:1788872640.414847:0:87059:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00000100:00100000:2.0:1788872640.415064:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327655680 00000100:00100000:2.0:1788872640.415078:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327655680 00000100:00100000:2.0:1788872640.415126:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:2.0:1788872640.415134:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87093:x1875765327655680:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872640.415221:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87093:x1875765327655680:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.415229:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:0.0:1788872640.415618:0:87093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87093:1875765327655680:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788872640.415689:0:87093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788872640.420609:0:87093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788872640.420761:0:87093:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788872640.420768:0:87093:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:3.0:1788872640.423828:0:87059:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215108 00010000:00080000:0.0:1788872640.429494:0:87094:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 87094 00010000:02000000:0.0:1788872640.429520:0:87094:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1788872640.429526:0:87094:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788872640.429531:0:87094:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1788872640.429882:0:87059:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788872640.429920:0:87059:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788872640.429956:0:87059:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788872640.429993:0:87059:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788872640.434503:0:87059:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788872640.438045:0:87059:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788872640.761478:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788872640.892214:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788872640.892228:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9f6655000 from 111 10000000:01000000:2.0:1788872640.892237:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788872640.892315:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.892330:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.892345:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.892402:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327655808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.892500:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.892574:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82ba300 going to sleep for 11 seconds 00000100:00100000:3.0:1788872640.893584:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327655808 00000100:00100000:3.0:1788872640.893597:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327655808 00000100:00100000:3.0:1788872640.893699:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788872640.893712:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:6517:x1875765327655808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872640.893734:0:87072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872640.893769:0:87072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9c76 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.893805:0:87072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c76 expref: 11 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.893819:0:87072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c76 expref: 11 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.893830:0:87072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5dea400, rc 0) 00000100:00100000:3.0:1788872640.893927:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327655808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.893935:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788872640.896931:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327655808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872640.896979:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.896997:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.897101:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327655936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.897205:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.897268:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82ba300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872640.897607:0:87070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327655936 00000100:00100000:0.0:1788872640.897619:0:87070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327655936 00000100:00100000:0.0:1788872640.898817:0:87070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788872640.898836:0:87070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327655936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788872640.898874:0:87070:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788872640.898896:0:87070:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788872640.898911:0:87070:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 111 00000100:00100000:0.0:1788872640.899105:0:87070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327655936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 274us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872640.899114:0:87070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788872640.899280:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327655936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788872640.899353:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788872640.899366:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.899378:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872640.899392:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788872640.899395:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9d0cfb000 from 52 10000000:01000000:2.0:1788872640.899398:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788872640.899438:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5400/0xe4e6e89fb01d9c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.899460:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac5400/0xe4e6e89fb01d9c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.899471:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac5400/0xe4e6e89fb01d9c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.899495:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.899526:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.902751:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82ba300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.902991:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327656064 00000100:00100000:1.0:1788872640.903004:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327656064 00000100:00100000:1.0:1788872640.903087:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788872640.903100:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327656064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872640.903122:0:87071:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872640.903151:0:87071:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01d9c8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9c84 expref: -99 pid: 87071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.903193:0:87071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01d9c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c84 expref: 12 pid: 87071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.903209:0:87071:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01d9c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c84 expref: 12 pid: 87071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.903221:0:87071:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c200, rc 0) 00000100:00100000:1.0:1788872640.903326:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327656064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (3798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.903334:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788872640.903508:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872640.903530:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac5400/0xe4e6e89fb01d9c84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c8b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.903541:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac5400/0xe4e6e89fb01d9c84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9c8b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.903698:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.903745:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872640.903930:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327656192 00000100:00100000:3.0:1788872640.903936:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327656192 00000100:00100000:3.0:1788872640.904004:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788872640.904013:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327656192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872640.904187:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327656192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.904195:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788872640.904266:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82ba300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.904280:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.904313:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.904364:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.904394:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82ba300 going to sleep for 11 seconds 00000100:00100000:3.0:1788872640.904444:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327656320 00000100:00100000:3.0:1788872640.904449:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327656320 00000100:00100000:3.0:1788872640.904486:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788872640.904493:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327656320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872640.904620:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327656320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.904627:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788872640.904726:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788872640.905872:0:87109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788872640.906149:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788872640.906177:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788872640.906191:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5400/0xe4e6e89fb01d9c84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c8b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.906204:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac5400/0xe4e6e89fb01d9c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c8b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872640.906216:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788872640.906219:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9d0cfb000 from 108 10000000:01000000:3.0:1788872640.906222:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788872640.906270:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb600/0xe4e6e89fb01d9c92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.906278:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb600/0xe4e6e89fb01d9c92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.906303:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb600/0xe4e6e89fb01d9c92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872640.906336:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872640.906418:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872640.906466:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef2af000 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.906526:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327656448 00000100:00100000:2.0:1788872640.906545:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327656448 00000100:00100000:2.0:1788872640.906616:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788872640.906626:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327656448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872640.906643:0:87072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872640.906662:0:87072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01d9c99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9c92 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.906933:0:87072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01d9c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c92 expref: 13 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.906948:0:87072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01d9c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c92 expref: 13 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.906959:0:87072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4c00, rc 0) 00000100:00100000:2.0:1788872640.907019:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327656448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 394us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.907028:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788872640.907186:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872640.907204:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb600/0xe4e6e89fb01d9c92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c99 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.907225:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb600/0xe4e6e89fb01d9c92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9c99 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872640.907301:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.907344:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.907381:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5db3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872640.907435:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327656576 00000100:00100000:3.0:1788872640.907440:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327656576 00000100:00100000:3.0:1788872640.907494:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788872640.907504:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327656576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788872640.907529:0:87066:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788872640.907579:0:87066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788872640.907584:0:87066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788872640.907586:0:87066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788872640.907589:0:87066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788872640.907591:0:87066:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 111 00000100:00100000:3.0:1788872640.907698:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327656576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 195us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.907706:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788872640.908090:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788872640.908196:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788872640.908206:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb600/0xe4e6e89fb01d9c92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c99 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.908219:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb600/0xe4e6e89fb01d9c92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c99 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872640.908228:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788872640.908231:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1788872640.908234:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788872640.908261:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01d9ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.908270:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01d9ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.908281:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01d9ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872640.908297:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.908338:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.908375:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5db3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.908439:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327656704 00000100:00100000:2.0:1788872640.908445:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327656704 00000100:00100000:2.0:1788872640.908489:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788872640.908497:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327656704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872640.908511:0:87072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872640.908527:0:87072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01d9ca7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9ca0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.908580:0:87072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01d9ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9ca0 expref: 14 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.908604:0:87072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01d9ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9ca0 expref: 14 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.908613:0:87072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4000, rc 0) 00000100:00100000:2.0:1788872640.908656:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327656704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.908662:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788872640.908940:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872640.908955:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01d9ca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9ca7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.908965:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01d9ca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9ca7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872640.909045:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.909076:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.909105:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5db3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872640.909157:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327656832 00000100:00100000:3.0:1788872640.909164:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327656832 00000100:00100000:3.0:1788872640.909210:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788872640.909219:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327656832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872640.909431:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327656832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.909439:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788872640.909593:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.909638:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.909836:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.910891:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82baa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872640.911880:0:87070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327656960 00000100:00100000:0.0:1788872640.911909:0:87070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327656960 00000100:00100000:1.0:1788872640.916925:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788872640.916956:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327656960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.920460:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327656960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3501us (10610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.920478:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788872640.920849:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327656960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872640.928470:0:87110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1788872640.928629:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1788872640.928667:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788872640.930852:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01d9ca0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9ca7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.930878:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01d9ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9ca7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872640.930896:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1788872640.930932:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a9d0cfb000 from 1 10000000:01000000:1.0:1788872640.930936:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788872640.930996:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01d9cae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.931005:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01d9cae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.931018:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01d9cae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872640.931054:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.931154:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.931209:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c913b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788872640.931574:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327657088 00000100:00100000:3.0:1788872640.931585:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327657088 00000100:00100000:3.0:1788872640.932279:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788872640.932294:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327657088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872640.932315:0:87066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872640.932346:0:87066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5deac00/0xe4e6e89fb01d9cb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9cae expref: -99 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.932737:0:87066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5deac00/0xe4e6e89fb01d9cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cae expref: 15 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.932753:0:87066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5deac00/0xe4e6e89fb01d9cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cae expref: 15 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.932880:0:87066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5deac00, rc 0) 00000100:00100000:3.0:1788872640.932985:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327657088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 695us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.932993:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788872640.934194:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872640.934232:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01d9cae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cb5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.934247:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01d9cae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9cb5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872640.934276:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788872640.934282:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01d9cae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cb5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.934290:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01d9cae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cb5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872640.934301:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788872640.934304:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9d0cfb000 from 7 10000000:01000000:1.0:1788872640.934328:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788872640.934373:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01d9cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.934382:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01d9cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.934392:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01d9cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872640.934417:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.934484:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.934535:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c913b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.935105:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327657216 00000100:00100000:2.0:1788872640.935115:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327657216 00000100:00100000:2.0:1788872640.935182:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788872640.935193:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327657216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872640.935210:0:87072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872640.935230:0:87072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac5800/0xe4e6e89fb01d9cc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9cbc expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.935256:0:87072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac5800/0xe4e6e89fb01d9cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cbc expref: 16 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.935266:0:87072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac5800/0xe4e6e89fb01d9cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cbc expref: 16 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.935291:0:87072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5800, rc 0) 00000100:00100000:2.0:1788872640.935343:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327657216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.935350:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788872640.937389:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872640.937429:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01d9cbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cc3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.937445:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01d9cbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9cc3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872640.937599:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.937797:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.937854:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c913b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.937881:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327657344 00000100:00100000:1.0:1788872640.937888:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327657344 00000100:00100000:1.0:1788872640.937955:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788872640.937967:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327657344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.938168:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327657344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.938199:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788872640.938246:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.938283:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.938330:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.938346:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c913b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.938362:0:87067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327657472 00000100:00100000:1.0:1788872640.938366:0:87067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327657472 00000100:00100000:1.0:1788872640.938394:0:87067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788872640.938400:0:87067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327657472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.938490:0:87067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327657472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.938498:0:87067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788872640.938539:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872640.942672:0:87112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788872640.943175:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788872640.943216:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788872640.943231:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01d9cbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cc3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.943247:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01d9cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cc3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872640.943258:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788872640.943262:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff5b1000 from 52 10000000:01000000:2.0:1788872640.943265:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788872640.943323:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01d9cca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.943332:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01d9cca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.943344:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01d9cca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.943380:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.943483:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.943574:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82ba300 going to sleep for 11 seconds 00000100:00100000:3.0:1788872640.943871:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327657600 00000100:00100000:3.0:1788872640.943884:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327657600 00000100:00100000:3.0:1788872640.943978:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788872640.943992:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327657600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872640.944014:0:87072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872640.944035:0:87072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5deaa00/0xe4e6e89fb01d9cd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9cca expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.944068:0:87072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5deaa00/0xe4e6e89fb01d9cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cca expref: 17 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.944083:0:87072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5deaa00/0xe4e6e89fb01d9cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cca expref: 17 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.944110:0:87072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5deaa00, rc 0) 00000100:00100000:3.0:1788872640.944180:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327657600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.944188:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788872640.945093:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872640.945122:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01d9cca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cd1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.945134:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01d9cca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9cd1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872640.945266:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.945321:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.945366:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c913b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.945505:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327657728 00000100:00100000:2.0:1788872640.945519:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327657728 00000100:00100000:2.0:1788872640.945599:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788872640.945610:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327657728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.951343:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327657728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5717us (6002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.951366:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788872640.953024:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.953136:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.953254:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.953366:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c913b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.955829:0:87070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327657856 00000100:00100000:2.0:1788872640.955849:0:87070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327657856 00000100:00100000:2.0:1788872640.955944:0:87070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788872640.955959:0:87070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c37ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327657856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.956266:0:87070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c37ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327657856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 308us (3008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.956276:0:87070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788872640.960058:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872640.965001:0:87114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788872640.965301:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788872640.965339:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788872640.965356:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01d9cca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cd1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.965382:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01d9cca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cd1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872640.965395:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788872640.965399:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788872640.965402:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788872640.965460:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.965469:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.965483:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9cd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872640.965523:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.965655:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.965719:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c913b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788872640.966448:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327657984 00000100:00100000:3.0:1788872640.966460:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327657984 00000100:00100000:3.0:1788872640.966533:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788872640.966545:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c37efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327657984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872640.966591:0:87072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872640.966614:0:87072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5deba00/0xe4e6e89fb01d9cdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9cd8 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.966648:0:87072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5deba00/0xe4e6e89fb01d9cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cd8 expref: 18 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.966661:0:87072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5deba00/0xe4e6e89fb01d9cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cd8 expref: 18 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872640.966672:0:87072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5deba00, rc 0) 00000100:00100000:3.0:1788872640.966863:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c37efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327657984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 318us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.966871:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788872640.966988:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327657984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872640.967015:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9cd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cdf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872640.967026:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9cd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9cdf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872640.967127:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.967166:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.967214:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c913b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.967333:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327658112 00000100:00100000:2.0:1788872640.967339:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327658112 00000100:00100000:2.0:1788872640.967386:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788872640.967395:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c37ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327658112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.967612:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c37ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327658112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.967620:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788872640.970956:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872640.971050:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872640.971152:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872640.971217:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e7bc66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.971280:0:87070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327658240 00000100:00100000:2.0:1788872640.971289:0:87070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327658240 00000100:00100000:2.0:1788872640.971356:0:87070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788872640.971367:0:87070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c37ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327658240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.972805:0:87070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c37ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327658240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1429us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.972837:0:87070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788872640.973024:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872640.974167:0:87115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788872640.974471:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788872640.974503:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788872640.974519:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9cd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cdf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.974533:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cdf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872640.974544:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788872640.974575:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ff5b1000 from 7 10000000:01000000:2.0:1788872640.974579:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788872640.974633:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4a00/0xe4e6e89fb01d9ce6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.974643:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac4a00/0xe4e6e89fb01d9ce6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.974655:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac4a00/0xe4e6e89fb01d9ce6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.974696:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.974783:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.974833:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef3db300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.975581:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327658368 00000100:00100000:1.0:1788872640.975594:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327658368 00000100:00100000:2.0:1788872640.975794:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788872640.975808:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c37ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327658368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872640.975829:0:87064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872640.975854:0:87064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac4400/0xe4e6e89fb01d9ced lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9ce6 expref: -99 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.975924:0:87064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac4400/0xe4e6e89fb01d9ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9ce6 expref: 19 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.975938:0:87064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac4400/0xe4e6e89fb01d9ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9ce6 expref: 19 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.975950:0:87064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4400, rc 0) 00000100:00100000:2.0:1788872640.976025:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c37ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327658368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.976033:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788872640.976103:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872640.976125:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac4a00/0xe4e6e89fb01d9ce6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9ced expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.976137:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac4a00/0xe4e6e89fb01d9ce6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9ced expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.976233:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.976266:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.976288:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef3db300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.976390:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327658496 00000100:00100000:1.0:1788872640.976396:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327658496 00000100:00100000:1.0:1788872640.976434:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788872640.976442:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327658496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.977006:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327658496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 561us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.977015:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788872640.977146:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.977197:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.977255:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.977293:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef3db300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.977350:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327658624 00000100:00100000:1.0:1788872640.977356:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327658624 00000100:00100000:1.0:1788872640.977399:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788872640.977408:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327658624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.977521:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327658624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.977530:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788872640.977795:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872640.980236:0:87116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788872640.980534:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788872640.980607:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788872640.980626:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4a00/0xe4e6e89fb01d9ce6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9ced expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.980644:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac4a00/0xe4e6e89fb01d9ce6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9ced expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872640.980657:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788872640.980660:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ef97c000 from 52 10000000:01000000:2.0:1788872640.980664:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788872640.980733:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01d9cf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.980743:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01d9cf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.980757:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01d9cf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.980797:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.980910:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.980954:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef3db300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872640.981168:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327658752 00000100:00100000:0.0:1788872640.981178:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327658752 00000100:00100000:0.0:1788872640.981275:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788872640.981287:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327658752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872640.981306:0:87064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872640.981324:0:87064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa98f000/0xe4e6e89fb01d9cfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9cf4 expref: -99 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.981355:0:87064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa98f000/0xe4e6e89fb01d9cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cf4 expref: 20 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.981369:0:87064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa98f000/0xe4e6e89fb01d9cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cf4 expref: 20 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.981381:0:87064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa98f000, rc 0) 00000100:00100000:0.0:1788872640.981453:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327658752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872640.981461:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788872640.981830:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872640.981852:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01d9cf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cfb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.981864:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01d9cf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9cfb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872640.981977:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.982011:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872640.982036:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef3db300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872640.982219:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327658880 00000100:00100000:1.0:1788872640.982225:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327658880 00000100:00100000:1.0:1788872640.982269:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788872640.982279:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327658880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.982460:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327658880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872640.982477:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788872640.982589:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327658880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872640.982629:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872640.982697:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872640.982734:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e7bc6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.982915:0:87067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327659008 00000100:00100000:2.0:1788872640.982920:0:87067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327659008 00000100:00100000:2.0:1788872640.982964:0:87067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788872640.982973:0:87067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327659008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872640.983082:0:87067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327659008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.983091:0:87067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788872640.983181:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872640.984408:0:87117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788872640.984708:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788872640.984737:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872640.984767:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01d9cf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cfb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.984780:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01d9cf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9cfb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872640.984791:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788872640.984795:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1788872640.984799:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788872640.984849:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d9d02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.984859:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d9d02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.984871:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d9d02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872640.984913:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872640.984988:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872640.985040:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c550c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788872640.985649:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327659136 00000100:00100000:2.0:1788872640.985661:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327659136 00000100:00100000:2.0:1788872640.985732:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788872640.985744:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327659136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872640.985762:0:87064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872640.985784:0:87064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac4e00/0xe4e6e89fb01d9d09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9d02 expref: -99 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.985815:0:87064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac4e00/0xe4e6e89fb01d9d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9d02 expref: 21 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.985828:0:87064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac4e00/0xe4e6e89fb01d9d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9d02 expref: 21 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872640.985839:0:87064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4e00, rc 0) 00000100:00100000:2.0:1788872640.985912:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327659136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872640.985933:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788872640.986588:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872640.986614:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d9d02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9d09 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872640.986627:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d9d02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9d09 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872640.987016:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.987076:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.987112:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788872640.987171:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327659264 00000100:00100000:0.0:1788872640.987178:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327659264 00000100:00100000:0.0:1788872640.987240:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788872640.987249:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327659264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872640.987694:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327659264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 444us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872640.987703:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788872640.989385:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.989484:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872640.989818:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872640.989927:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788872640.990397:0:87070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327659392 00000100:00100000:3.0:1788872640.990407:0:87070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327659392 00000100:00100000:3.0:1788872640.990630:0:87070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788872640.990645:0:87070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9d247fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327659392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872640.991918:0:87070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9d247fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327659392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1260us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872640.991933:0:87070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788872640.993227:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872640.999166:0:87119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1788872641.003533:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788872641.003609:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788872641.003626:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d9d02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9d09 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872641.003642:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d9d02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9d09 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872641.003981:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788872641.003987:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ef97c000 from 7 10000000:01000000:1.0:1788872641.003991:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788872641.004054:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9d10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.004065:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9d10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.004079:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9d10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872641.004133:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872641.004242:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872641.004662:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872641.008334:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327659520 00000100:00100000:2.0:1788872641.008359:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327659520 00000100:00100000:1.0:1788872641.008584:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788872641.008599:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327659520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872641.008621:0:87064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872641.008649:0:87064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01d9d17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9d10 expref: -99 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.008791:0:87064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01d9d17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9d10 expref: 22 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.008808:0:87064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01d9d17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9d10 expref: 22 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.008818:0:87064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d400, rc 0) 00000100:00100000:1.0:1788872641.008940:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327659520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 344us (4696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872641.008948:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788872641.009050:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872641.009074:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9d10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9d17 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872641.009086:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9d10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9d17 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872641.009206:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872641.009251:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872641.009513:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef3db780 going to sleep for 11 seconds 00000100:00100000:3.0:1788872641.009786:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327659648 00000100:00100000:3.0:1788872641.009793:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327659648 00000100:00100000:3.0:1788872641.009851:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788872641.009862:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327659648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872641.010046:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327659648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872641.010053:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788872641.010239:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872641.010282:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872641.010337:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872641.010361:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef3db780 going to sleep for 11 seconds 00000100:00100000:3.0:1788872641.010414:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327659776 00000100:00100000:3.0:1788872641.010419:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327659776 00000100:00100000:3.0:1788872641.010457:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788872641.010467:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327659776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872641.010584:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327659776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872641.010591:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788872641.010702:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788872641.015085:0:87121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788872641.015471:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788872641.015514:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788872641.015531:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9d10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9d17 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872641.015582:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9d10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9d17 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872641.015597:0:6517:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788872641.015600:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98a9e9b999c0 from 1 10000000:01000000:3.0:1788872641.015620:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788872641.015686:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea000/0xe4e6e89fb01d9d1e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872641.015695:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea000/0xe4e6e89fb01d9d1e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872641.015709:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea000/0xe4e6e89fb01d9d1e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872641.015749:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872641.015853:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872641.015923:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e84900 going to sleep for 11 seconds 00000100:00100000:2.0:1788872641.016085:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327659904 00000100:00100000:2.0:1788872641.016096:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327659904 00000100:00100000:2.0:1788872641.016154:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788872641.016165:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c49a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327659904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872641.016183:0:87072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872641.016204:0:87072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01d9d25 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9d1e expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872641.016234:0:87072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01d9d25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9d1e expref: 23 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872641.016248:0:87072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01d9d25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9d1e expref: 23 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872641.016260:0:87072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5600, rc 0) 00000100:00100000:2.0:1788872641.016312:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c49a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327659904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872641.016319:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788872641.016422:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327659904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872641.016441:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea000/0xe4e6e89fb01d9d1e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9d25 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872641.016451:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea000/0xe4e6e89fb01d9d1e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9d25 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872641.016476:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788872641.016481:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea000/0xe4e6e89fb01d9d1e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9d25 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872641.016489:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea000/0xe4e6e89fb01d9d1e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9d25 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872641.016496:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788872641.016499:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98a9e9b999c0 from 1 10000000:01000000:3.0:1788872641.016501:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788872641.016531:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea200/0xe4e6e89fb01d9d2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872641.016539:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea200/0xe4e6e89fb01d9d2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872641.016576:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea200/0xe4e6e89fb01d9d2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872641.016593:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327660032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872641.016622:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872641.016646:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e84900 going to sleep for 11 seconds 00000100:00100000:2.0:1788872641.016770:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327660032 00000100:00100000:2.0:1788872641.016776:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327660032 00000100:00100000:2.0:1788872641.016804:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788872641.016810:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c49a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327660032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872641.016818:0:87066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872641.016829:0:87066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac5a00/0xe4e6e89fb01d9d33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01d9d2c expref: -99 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872641.016845:0:87066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac5a00/0xe4e6e89fb01d9d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9d2c expref: 24 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872641.016863:0:87066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac5a00/0xe4e6e89fb01d9d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01d9d2c expref: 24 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872641.016870:0:87066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5a00, rc 0) 00000100:00100000:2.0:1788872641.016911:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c49a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327660032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872641.016917:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788872641.017135:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327660032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872641.017149:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea200/0xe4e6e89fb01d9d2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9d33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872641.017159:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea200/0xe4e6e89fb01d9d2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9d33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872641.017234:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327660160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872641.017264:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872641.017294:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e84900 going to sleep for 11 seconds 00000100:00100000:3.0:1788872641.017310:0:87070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327660160 00000100:00100000:3.0:1788872641.017314:0:87070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327660160 00000100:00100000:3.0:1788872641.017362:0:87070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788872641.017371:0:87070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327660160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872641.017465:0:87070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7311450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327660160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (200us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788872641.017485:0:87070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788872641.017521:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327660160:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788872641.017586:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788872641.017593:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea200/0xe4e6e89fb01d9d2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9d33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872641.017602:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea200/0xe4e6e89fb01d9d2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9d33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872641.164163:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872641.164317:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311145472 00000100:00100000:1.0:1788872641.164334:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311145472 00000100:00100000:1.0:1788872641.164418:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:1.0:1788872641.164432:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+5:42482:x1875765311145472:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872641.164456:0:87072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872641.164484:0:87072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01d9d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae72 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.164576:0:87072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01d9d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae72 expref: 6 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.164590:0:87072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01d9d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae72 expref: 6 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.164601:0:87072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c800, rc 0) 00000100:00100000:1.0:1788872641.165939:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7313050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311145472:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 1497us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872641.165953:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:0.0:1788872641.175373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872641.175523:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311145600 00000100:00100000:2.0:1788872641.175539:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311145600 00000100:00100000:2.0:1788872641.176021:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:2.0:1788872641.176037:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311145600:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788872641.176082:0:87066:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788872641.176118:0:87066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788872641.176122:0:87066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788872641.176126:0:87066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788872641.176128:0:87066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788872641.176130:0:87066:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 111 00000100:00100000:2.0:1788872641.181418:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7310c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311145600:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 Request processed in 5365us (6039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872641.181441:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:0.0:1788872641.189365:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872641.189460:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872641.189620:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311145728 00000100:00100000:2.0:1788872641.189639:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311145728 00000100:00100000:2.0:1788872641.189717:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1132 00000100:00100000:2.0:1788872641.189731:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875765311145728:12345-192.168.204.39@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1788872641.189793:0:66190:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '2a005fe2-2a3d-4ca6-8402-a633d5d16eb3' at ffff98a9e99a1000, cookie 0xe4e6e89fb01d9bc0 00010000:00080000:2.0:1788872641.189802:0:66190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp recovering/t103079215109 exp ffff98a9e99a1000 cur 3578 last 1788872640 00010000:02000400:2.0:1788872641.189844:0:66190:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788872641.189853:0:66190:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788872641.189888:0:66190:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788872641.190131:0:66190:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872641.190258:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311145728:12345-192.168.204.39@tcp:38:ll_cfg_requeue.0 Request processed in 528us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872641.190269:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1132 00000100:00100000:1.0:1788872641.190914:0:87067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311145856 00000100:00100000:1.0:1788872641.190927:0:87067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311145856 00000100:00100000:1.0:1788872641.190992:0:87067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 64 00000100:00100000:1.0:1788872641.191001:0:87067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311145856:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872641.191017:0:87067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872641.191044:0:87067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01d9d41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae79 expref: -99 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.191078:0:87067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01d9d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae79 expref: 7 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.191091:0:87067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01d9d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae79 expref: 7 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.191102:0:87067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d000, rc 0) 00000100:00100000:1.0:1788872641.191148:0:87067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+7:42482:x1875765311145856:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 148us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872641.191173:0:87067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 64 00000100:00100000:2.0:1788872641.196176:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872641.198184:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311138944 00000100:00100000:3.0:1788872641.198210:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311138944 00000100:00100000:3.0:1788872641.198326:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1133 00000100:00100000:3.0:1788872641.198351:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311138944:12345-192.168.204.39@tcp:36:mcreate.0 00010000:00080000:3.0:1788872641.198384:0:66193:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215109, current: 103079215109, replaying 00000100:00100000:3.0:1788872641.198398:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311138944:12345-192.168.204.39@tcp:36:mcreate.0 Request processed in 63us (2239us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872641.198407:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1133 00010000:00080000:0.0:1788872641.198628:0:87094:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1788872641.201473:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872641.201606:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311145984 00000100:00100000:1.0:1788872641.201620:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311145984 00000100:00100000:1.0:1788872641.201934:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 65 00000100:00100000:1.0:1788872641.201950:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+7:42482:x1875765311145984:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872641.202174:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311145984:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 228us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872641.202182:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 65 00000100:00100000:0.0:1788872641.211487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872641.211775:0:87070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311146112 00000100:00100000:2.0:1788872641.211791:0:87070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311146112 00000100:00100000:2.0:1788872641.211873:0:87070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 66 00000100:00100000:2.0:1788872641.211887:0:87070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311146112:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872641.212120:0:87070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311146112:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 235us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872641.212131:0:87070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 66 00000100:00100000:2.0:1788872641.223236:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872641.223453:0:87067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311146240 00000100:00100000:1.0:1788872641.223468:0:87067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311146240 00000100:00100000:1.0:1788872641.223579:0:87067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 67 00000100:00100000:1.0:1788872641.223593:0:87067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311146240:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872641.223615:0:87067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872641.223642:0:87067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01d9d48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae80 expref: -99 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.223917:0:87067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01d9d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae80 expref: 9 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.223932:0:87067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01d9d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae80 expref: 9 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872641.223943:0:87067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9de00, rc 0) 00000100:00100000:1.0:1788872641.224142:0:87067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311146240:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 551us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872641.224152:0:87067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 67 00000100:00100000:1.0:1788872641.239601:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872641.240472:0:87072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311146368 00000100:00100000:2.0:1788872641.240490:0:87072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311146368 00000100:00100000:2.0:1788872641.240683:0:87072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 68 00000100:00100000:2.0:1788872641.240699:0:87072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311146368:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872641.240944:0:87072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311146368:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 248us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872641.240953:0:87072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 68 00000100:00100000:1.0:1788872641.249614:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872641.250472:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311146496 00000100:00100000:0.0:1788872641.250493:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311146496 00000100:00100000:0.0:1788872641.250617:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 69 00000100:00100000:0.0:1788872641.250632:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311146496:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872641.250854:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311146496:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 225us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872641.250864:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 69 00000100:00100000:2.0:1788872641.269360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872641.269664:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311146624 00000100:00100000:0.0:1788872641.269685:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311146624 00000100:00100000:0.0:1788872641.269758:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 70 00000100:00100000:0.0:1788872641.269770:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311146624:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872641.269794:0:87064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872641.269829:0:87064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa98e200/0xe4e6e89fb01d9d4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae87 expref: -99 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872641.269872:0:87064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa98e200/0xe4e6e89fb01d9d4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae87 expref: 10 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872641.269885:0:87064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa98e200/0xe4e6e89fb01d9d4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae87 expref: 10 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872641.269907:0:87064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa98e200, rc 0) 00000100:00100000:0.0:1788872641.269992:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:42482:x1875765311146624:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 224us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872641.270000:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 70 00000100:00100000:3.0:1788872641.276429:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872641.276495:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311146752 00000100:00100000:3.0:1788872641.276507:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311146752 00000100:00100000:3.0:1788872641.276613:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 71 00000100:00100000:3.0:1788872641.276628:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:42482:x1875765311146752:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872641.276944:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:42482:x1875765311146752:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 319us (926us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788872641.276955:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 71 00010000:00010000:0.0:1788872641.791343:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872642.810008:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872643.840398:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872644.283221:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872644.283279:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327660288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872644.283399:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872644.283477:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327660288 00000100:00100000:2.0:1788872644.283487:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327660288 00000100:00100000:2.0:1788872644.283589:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:2.0:1788872644.283601:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327660288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872644.283644:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872644.283703:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327660288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872644.283713:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00100000:2.0:1788872644.283779:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327660288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872644.284215:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872644.284230:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327660416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872644.284272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788872644.284327:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872644.284345:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327660416 00000100:00100000:0.0:1788872644.284350:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327660416 00000100:00100000:0.0:1788872644.284397:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:0.0:1788872644.284406:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327660416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872644.284430:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872644.284470:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327660416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872644.284477:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00080000:0.0:1788872644.284499:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872644.284522:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327660416:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788872644.858051:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872644.874175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872644.874232:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872644.874273:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311147008 00000100:00100000:2.0:1788872644.874286:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311147008 00000100:00100000:2.0:1788872644.874363:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1131 00000100:00100000:2.0:1788872644.874375:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311147008:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872644.874482:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311147008:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 111us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872644.874491:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1131 00000100:00080000:2.0:1788872644.874517:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872644.874702:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311146880 00000100:00100000:3.0:1788872644.874708:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311146880 00000100:00100000:3.0:1788872644.874766:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 72 00000100:00100000:3.0:1788872644.874776:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311146880:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872644.874809:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311146880:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 36us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872644.874815:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 72 00000100:00080000:0.0:1788872645.307599:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872645.307609:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872645.307613:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872645.307631:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872645.307662:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3a66300 x1875765327660672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872645.307694:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872645.307697:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872645.307699:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872645.307704:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872645.307715:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9faa7b480 x1875765327660928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872645.307742:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872645.307746:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872645.307747:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872645.307752:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872645.307764:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9faa7ad80 x1875765327661184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872645.307786:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872645.307789:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872645.307791:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872645.307796:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872645.307807:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9faa78000 x1875765327661568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872645.307865:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788872645.307868:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872645.307869:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe90000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872645.307874:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98a9dfe90000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872645.307884:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f0988e00 x1875765327662080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872645.308045:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327660544:0@lo:400:kworker.0 00000100:00100000:1.0:1788872645.308352:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327660672:0@lo:38:kworker.0 00000100:00100000:2.0:1788872645.311651:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327661312:0@lo:400:kworker.0 00000100:00100000:1.0:1788872645.316686:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872645.316756:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327660928:0@lo:38:kworker.0 00000100:00100000:1.0:1788872645.316795:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872645.316855:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327660672 00000100:00100000:1.0:1788872645.316866:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327660672 00000100:00100000:1.0:1788872645.316913:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327660928 00000100:00100000:1.0:1788872645.316916:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327660928 00000100:00100000:1.0:1788872645.316944:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:1.0:1788872645.316952:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327660672:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788872645.316996:0:66192:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3582 last 0 00000020:00000080:1.0:1788872645.317045:0:66192:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe4e6e89fb01d9d56 00000004:00100000:1.0:1788872645.317068:0:66192:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788872645.317500:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1788872645.317508:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327660928:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872645.317528:0:66190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3582 last 0 00000020:00000080:3.0:1788872645.317577:0:66190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe4e6e89fb01d9d5d 00000004:00100000:3.0:1788872645.317588:0:66190:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872645.317761:0:66190:0:(import.c:65:import_set_state_nolock()) ffff98a9df96b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872645.317853:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875765327660928:12345-0@lo:38:kworker.0 Request processed in 342us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872645.317861:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00080000:1.0:1788872645.317964:0:66192:0:(import.c:65:import_set_state_nolock()) ffff98a9ff63d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872645.318000:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875765327660672:12345-0@lo:38:kworker.0 Request processed in 1046us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872645.318006:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:1.0:1788872645.318038:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327660800:0@lo:400:kworker.0 00000100:00100000:1.0:1788872645.318202:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872645.318245:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327661696:0@lo:400:kworker.0 00000100:00100000:1.0:1788872645.318279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872645.318311:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872645.318317:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327662208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872645.318337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872645.318385:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327660800 00000100:00100000:1.0:1788872645.318391:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327660800 00000100:00100000:1.0:1788872645.318435:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1788872645.318443:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327660800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872645.318486:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327660800:12345-0@lo:400:kworker.0 Request processed in 44us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872645.318491:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1788872645.318510:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327661696 00000100:00100000:1.0:1788872645.318515:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327661696 00000100:00100000:1.0:1788872645.318540:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327662208 00000100:00100000:1.0:1788872645.318543:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327662208 00000100:00100000:0.0:1788872645.318836:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872645.318893:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327661440:0@lo:400:kworker.0 00000100:00100000:0.0:1788872645.318927:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872645.319108:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327660544 00000100:00100000:0.0:1788872645.319114:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327660544 00000100:00100000:0.0:1788872645.319166:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788872645.319174:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327660544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872645.319222:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327660544:12345-0@lo:400:kworker.0 Request processed in 49us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872645.319229:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788872645.319265:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327661440 00000100:00100000:0.0:1788872645.319269:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327661440 00000100:00100000:0.0:1788872645.319298:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481 00000100:00100000:0.0:1788872645.319304:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327661440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872645.319339:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327661440:12345-0@lo:400:kworker.0 Request processed in 36us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872645.319345:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481 00000100:00100000:0.0:1788872645.319394:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327660544:0@lo:400:kworker.0 00000100:00100000:0.0:1788872645.319410:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327661440:0@lo:400:kworker.0 00000100:00100000:1.0:1788872645.320567:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:1.0:1788872645.320589:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875765327661696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872645.320681:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875765327661696:12345-0@lo:400:kworker.0 Request processed in 100us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872645.320688:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00100000:1.0:1788872645.320706:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:1.0:1788872645.320713:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327662208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872645.320747:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872645.320781:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327662208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872645.320787:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:1.0:1788872645.320855:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327662208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872645.320873:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327660800:0@lo:400:kworker.0 00000100:00100000:1.0:1788872645.320882:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327661696:0@lo:400:kworker.0 00010000:00080000:1.0:1788872645.320933:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9faa7b480 x1875765327660928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872645.320962:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00100000:2.0:1788872645.322301:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327661056:0@lo:400:kworker.0 00000100:00100000:2.0:1788872645.322377:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872645.322419:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327661824:0@lo:400:kworker.0 00000100:00100000:2.0:1788872645.322464:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788872645.322511:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872645.322539:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327661056 00000100:00100000:2.0:1788872645.322564:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327661056 00000100:00100000:2.0:1788872645.322636:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1788872645.322645:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327661056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872645.322705:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327661056:12345-0@lo:400:kworker.0 Request processed in 60us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872645.322712:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1788872645.322751:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327661824 00000100:00100000:2.0:1788872645.322755:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327661824 00000100:00100000:2.0:1788872645.322787:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:2.0:1788872645.322793:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327661824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872645.322837:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327661824:12345-0@lo:400:kworker.0 Request processed in 45us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872645.322844:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00080000:2.0:1788872645.322858:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872645.322861:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872645.322891:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327661056:0@lo:400:kworker.0 00000100:00100000:2.0:1788872645.322901:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327661824:0@lo:400:kworker.0 00000100:00100000:2.0:1788872645.322964:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872645.322996:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327661312 00000100:00100000:2.0:1788872645.322999:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327661312 00000100:00100000:2.0:1788872645.323023:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:2.0:1788872645.323028:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327661312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872645.323056:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327661312:12345-0@lo:400:kworker.0 Request processed in 28us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872645.323069:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00100000:2.0:1788872645.323110:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327661312:0@lo:400:kworker.0 00000100:00100000:2.0:1788872645.323120:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327661952:0@lo:400:kworker.0 00000100:00100000:2.0:1788872645.323225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872645.323253:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327661952 00000100:00100000:2.0:1788872645.323256:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327661952 00000100:00100000:2.0:1788872645.323287:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484 00000100:00100000:2.0:1788872645.323293:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327661952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872645.323324:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327661952:12345-0@lo:400:kworker.0 Request processed in 31us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872645.323329:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484 00000100:00080000:2.0:1788872645.323343:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872645.323360:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327661952:0@lo:400:kworker.0 00000100:00080000:1.0:1788872645.325987:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff98a9faa7b480 x1875765327660928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872670 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872645.326005:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788872645.326012:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788872645.326017:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788872645.326025:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327660928:0@lo:38:kworker.0 00000100:00100000:1.0:1788872645.326055:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327661184:0@lo:38:kworker.0 00000100:00100000:1.0:1788872645.327444:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872645.327509:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327661568:0@lo:38:kworker.0 00000100:00100000:1.0:1788872645.327572:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872645.327612:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327661568 00000100:00100000:1.0:1788872645.327621:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327661568 00000100:00100000:1.0:1788872645.327678:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0:1788872645.327686:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327661568:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788872645.327729:0:66193:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3582 last 0 00000020:00000080:1.0:1788872645.327786:0:66193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe4e6e89fb01d9d64 00000004:00100000:1.0:1788872645.327806:0:66193:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788872645.327860:0:66193:0:(import.c:65:import_set_state_nolock()) ffff98a9ff63c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872645.327922:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875765327661568:12345-0@lo:38:kworker.0 Request processed in 235us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872645.327931:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00010000:00080000:1.0:1788872645.327984:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9faa78000 x1875765327661568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872645.328027:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00000100:00080000:1.0:1788872645.331059:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff98a9faa78000 x1875765327661568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872670 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872645.331078:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788872645.331086:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788872645.331091:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788872645.331100:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327661568:0@lo:38:kworker.0 00000100:00100000:1.0:1788872645.331117:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327662080:0@lo:38:kworker.0 00000100:00100000:3.0:1788872645.334397:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327661184 00000100:00100000:3.0:1788872645.334424:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327661184 00000100:00100000:3.0:1788872645.334506:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:3.0:1788872645.334519:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fbfc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327661184:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872645.334577:0:8447:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff98a9e99a0800, cookie 0xe4e6e89fb01d9bc7 00010000:00080000:3.0:1788872645.334584:0:8447:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378652 exp ffff98a9e99a0800 cur 3582 last 1788872640 00000004:00100000:3.0:1788872645.334613:0:8447:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872645.334658:0:8447:0:(import.c:65:import_set_state_nolock()) ffff98a9c5f13000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872645.334799:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fbfc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327661184:12345-0@lo:38:kworker.0 Request processed in 282us (7363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872645.334807:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00100000:1.0:1788872645.335450:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788872645.335569:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a8c3a66300 x1875765327660672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872645.335589:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000100:00100000:3.0:1788872645.336480:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327662080 00000100:00100000:3.0:1788872645.336491:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327662080 00000100:00100000:3.0:1788872645.336545:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1788872645.336566:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327662080:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872645.336601:0:68674:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3582 last 0 00000020:00000080:3.0:1788872645.336658:0:68674:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe4e6e89fb01d9d6b 00000004:00100000:3.0:1788872645.336677:0:68674:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872645.336715:0:68674:0:(import.c:65:import_set_state_nolock()) ffff98aa002c6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872645.336790:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875765327662080:12345-0@lo:38:kworker.0 Request processed in 223us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872645.336798:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00010000:00080000:2.0:1788872645.338935:0:87094:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1788872645.338950:0:87094:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 103079215109 00000020:00080000:2.0:1788872645.338960:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872645.338964:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215109, next_transno: 103079215109 00010000:00080000:2.0:1788872645.338971:0:87094:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215109) 00000020:00080000:2.0:1788872645.338974:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872645.338990:0:87094:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311138944 t103079215109 from 192.168.204.39@tcp req@ffff98a8c3b48000 x1875765311138944/t0(103079215109) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:567/0 lens 528/0 e 0 to 0 dl 1788872652 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872645.339236:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff98a8c3a66300 x1875765327660672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872670 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872645.339251:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788872645.339258:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788872645.339264:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788872645.339272:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327660672:0@lo:38:kworker.0 00000100:00080000:1.0:1788872645.339331:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:1.0:1788872645.339347:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1788872645.339352:0:3643:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1788872645.339355:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:1.0:1788872645.339360:0:3643:0:(recover.c:53:ptlrpc_replay_next()) import ffff98a9df8c9800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:1.0:1788872645.339381:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1788872645.344165:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327661184:0@lo:38:kworker.0 00010000:00080000:2.0:1788872645.344236:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9f0988e00 x1875765327662080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788872645.344277:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:2.0:1788872645.344289:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788872645.344297:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788872645.344302:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe90000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788872645.344309:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327662080:0@lo:38:kworker.0 00010000:00080000:1.0:1788872645.346498:0:87266:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1788872645.346521:0:87266:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1788872645.346528:0:87266:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1788872645.347021:0:87266:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788872645.347626:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327662336:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788872645.357939:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872645.360632:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327662336 00000100:00100000:3.0:1788872645.360653:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327662336 00000100:00100000:3.0:1788872645.360744:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:3.0:1788872645.360757:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327662336:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788872645.360787:0:23717:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a8c3b49880 x1875765327662336/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:571/0 lens 224/0 e 0 to 0 dl 1788872656 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872645.360801:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327662336:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 49us (2871us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872645.360810:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000004:00080000:3.0:1788872645.363450:0:87094:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 23526us 00010000:00010000:3.0:1788872645.386354:0:87094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d72 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.386398:0:87094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.386416:0:87094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.386432:0:87094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9d79 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.386439:0:87094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9d79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.386446:0:87094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9d79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.387024:0:87094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.387036:0:87094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d72 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.387044:0:87094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d72 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.387051:0:87094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872645.387057:0:87094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d72 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.387065:0:87094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d72 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.387148:0:87094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4300) 00010000:00010000:3.0:1788872645.387159:0:87094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872645.387166:0:87094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d72 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.387173:0:87094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d72 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872645.387194:0:87094:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002ca367f1 reply state 00000000937cb2cb transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9d79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.387205:0:87094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9d79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.387212:0:87094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4000) 00010000:00010000:3.0:1788872645.387214:0:87094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872645.387218:0:87094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788872645.387359:0:87094:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1788872645.387386:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872645.387390:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000020:00080000:3.0:1788872645.387395:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872645.387397:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000100:00100000:0.0:1788872645.396514:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872645.400514:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311139456 00000100:00100000:3.0:1788872645.401452:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311139456 00000100:00100000:2.0:1788872645.403446:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1138 00000100:00100000:2.0:1788872645.403463:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2403:x1875765311139456:12345-192.168.204.39@tcp:36:rm.0 00010000:00080000:2.0:1788872645.403492:0:66190:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215110, current: 103079215110, replaying 00000100:00100000:2.0:1788872645.403519:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2403:x1875765311139456:12345-192.168.204.39@tcp:36:rm.0 Request processed in 61us (7023us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788872645.403527:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1138 00000020:00080000:3.0:1788872645.413029:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872645.413043:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215110, next_transno: 103079215110 00010000:00080000:3.0:1788872645.413052:0:87094:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215110) 00000020:00080000:3.0:1788872645.413056:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872645.413077:0:87094:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311139456 t103079215110 from 192.168.204.39@tcp req@ffff98a8c1ca8a80 x1875765311139456/t0(103079215110) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:571/0 lens 512/0 e 0 to 0 dl 1788872656 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788872645.413228:0:87094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d80 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.413340:0:87094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.413357:0:87094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.413374:0:87094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d9d87 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.413384:0:87094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d9d87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.413391:0:87094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d9d87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.413752:0:87094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d9d8e lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.413762:0:87094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d9d8e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.413857:0:87094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d9d8e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414189:0:87094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d9d8e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414198:0:87094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d9d8e lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414207:0:87094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d9d8e lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414227:0:87094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5debc00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872645.414310:0:87094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d9d8e lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414320:0:87094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d9d8e lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414337:0:87094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff98a9e7bf4700) 00010000:00010000:3.0:1788872645.414341:0:87094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788872645.414347:0:87094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d9d8e lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414354:0:87094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5debc00/0xe4e6e89fb01d9d8e lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414383:0:87094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414389:0:87094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d80 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414396:0:87094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d80 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414401:0:87094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872645.414404:0:87094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d80 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414411:0:87094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d80 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414431:0:87094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4300) 00010000:00010000:3.0:1788872645.414433:0:87094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872645.414436:0:87094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d80 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414442:0:87094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb200/0xe4e6e89fb01d9d80 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872645.414662:0:87094:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae89808f reply state 000000000aa1b26a transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d9d87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414677:0:87094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d9d87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.414684:0:87094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4000) 00010000:00010000:3.0:1788872645.414687:0:87094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872645.414690:0:87094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788872645.414900:0:87094:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788872645.414932:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872645.414936:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000020:00080000:3.0:1788872645.414941:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872645.414943:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000001:00080000:3.0:1788872645.417848:0:87060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:3.0:1788872645.417910:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9d79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.417925:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9d79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.417933:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9d79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.417952:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872645.417958:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9d79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.417967:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9d79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.417987:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4000) 00010000:00010000:3.0:1788872645.417991:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872645.417996:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9d79 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.418003:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb000/0xe4e6e89fb01d9d79 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.418025:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d9d87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.418032:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d9d87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.418038:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d9d87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.418043:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872645.418045:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d9d87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.418050:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d9d87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.418070:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4000) 00010000:00010000:3.0:1788872645.418072:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872645.418075:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d9d87 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.418081:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5deb400/0xe4e6e89fb01d9d87 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872645.421993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872645.422136:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311140608 00000100:00100000:1.0:1788872645.422149:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311140608 00000100:00100000:1.0:1788872645.422224:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1139 00000100:00100000:1.0:1788872645.422235:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311140608:12345-192.168.204.39@tcp:101:touch.0 00010000:00080000:1.0:1788872645.422257:0:66193:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:1.0:1788872645.422282:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311140608:12345-192.168.204.39@tcp:101:touch.0 Request processed in 50us (305us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872645.422291:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1139 00000020:00080000:0.0:1788872645.423038:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872645.423044:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:0.0:1788872645.423049:0:87094:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:0.0:1788872645.423052:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872645.423063:0:87094:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311140608 t103079215111 from 192.168.204.39@tcp req@ffff98a8c5af4000 x1875765311140608/t0(103079215111) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:571/0 lens 752/0 e 0 to 0 dl 1788872656 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788872645.423089:0:87094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872645.423117:0:87094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e600/0xe4e6e89fb01d9d95 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae6b expref: -99 pid: 87094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.423359:0:87094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01d9d9c lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.424286:0:87094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01d9d9c lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.424308:0:87094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01d9d9c lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.424328:0:87094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e000/0xe4e6e89fb01d9da3 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.424336:0:87094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e000/0xe4e6e89fb01d9da3 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.424344:0:87094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e000/0xe4e6e89fb01d9da3 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788872645.427880:0:87094:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x5:0x0], cookie = 0xe4e6e89fb01d9b26 00000004:00080000:0.0:1788872645.427889:0:87094:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xe4e6e89fb01d9b26 in new mfd 00010000:00010000:0.0:1788872645.427903:0:87094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01d9d9c lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.427914:0:87094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01d9d9c lrc: 2/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.427921:0:87094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01d9d9c lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.427928:0:87094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98fe00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872645.427933:0:87094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01d9d9c lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.427941:0:87094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01d9d9c lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.427957:0:87094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98aa02076500) 00010000:00010000:0.0:1788872645.427960:0:87094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872645.427964:0:87094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01d9d9c lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.427971:0:87094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01d9d9c lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872645.427985:0:87094:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6f796d5 reply state 00000000ecf56dc5 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e000/0xe4e6e89fb01d9da3 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.427996:0:87094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e000/0xe4e6e89fb01d9da3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.428013:0:87094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff98aa02076d00) 00010000:00010000:0.0:1788872645.428015:0:87094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872645.428019:0:87094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788872645.428059:0:87094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e600/0xe4e6e89fb01d9d95 lrc: 1/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 8 pid: 87094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.428072:0:87094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98aa02076500) 00010000:00010000:0.0:1788872645.428074:0:87094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872645.428078:0:87094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e600/0xe4e6e89fb01d9d95 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae6b expref: 8 pid: 87094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.428095:0:87094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa98e600, rc 0) 00010000:00080000:0.0:1788872645.428180:0:87094:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788872645.428205:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872645.428209:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:0.0:1788872645.428213:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872645.428215:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000100:00100000:1.0:1788872645.464745:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872645.466211:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311140864 00000100:00100000:3.0:1788872645.466228:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311140864 00000100:00100000:3.0:1788872645.466316:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1140 00000100:00100000:3.0:1788872645.466327:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2403:x1875765311140864:12345-192.168.204.39@tcp:36:touch.0 00010000:00080000:3.0:1788872645.466349:0:68674:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:3.0:1788872645.466369:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2403:x1875765311140864:12345-192.168.204.39@tcp:36:touch.0 Request processed in 44us (1642us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872645.466377:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1140 00000020:00080000:1.0:1788872645.467514:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872645.467526:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:1.0:1788872645.467533:0:87094:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:1.0:1788872645.467538:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872645.467596:0:87094:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311140864 t103079215112 from 192.168.204.39@tcp req@ffff98a8c5ae2300 x1875765311140864/t0(103079215112) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:571/0 lens 488/0 e 0 to 0 dl 1788872656 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788872645.467800:0:87094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01d9db1 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.467831:0:87094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01d9db1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.467850:0:87094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01d9db1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872645.468024:0:87094:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007411acef reply state 00000000b0906a17 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01d9db1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.468039:0:87094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01d9db1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.468047:0:87094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff98a8c396b200) 00010000:00010000:1.0:1788872645.468050:0:87094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872645.468054:0:87094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788872645.468884:0:87094:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788872645.468913:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872645.468917:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:1.0:1788872645.468920:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872645.468922:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:0.0:1788872645.485505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872645.485837:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311141248 00000100:00100000:3.0:1788872645.485857:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311141248 00000100:00100000:3.0:1788872645.485934:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 219 00000100:00100000:3.0:1788872645.485947:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2403:x1875765311141248:12345-192.168.204.39@tcp:35:touch.0 00010000:00080000:3.0:1788872645.485970:0:66194:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215113, replaying 00000100:00100000:3.0:1788872645.485998:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2403:x1875765311141248:12345-192.168.204.39@tcp:35:touch.0 Request processed in 53us (513us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872645.486005:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 219 00000020:00080000:1.0:1788872645.486017:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872645.486025:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215113, next_transno: 103079215113 00010000:00080000:1.0:1788872645.486031:0:87094:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215113) 00000020:00080000:1.0:1788872645.486038:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872645.486055:0:87094:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311141248 t103079215113 from 192.168.204.39@tcp req@ffff98a8c1caad80 x1875765311141248/t0(103079215113) o35->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:571/0 lens 392/0 e 0 to 0 dl 1788872656 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788872645.486431:0:87094:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788872645.486465:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872645.486469:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000020:00080000:1.0:1788872645.486472:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872645.486474:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000100:00100000:0.0:1788872645.520358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872645.520534:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311147136 00000100:00100000:1.0:1788872645.520570:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311147136 00000100:00100000:1.0:1788872645.520641:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1134 00000100:00100000:1.0:1788872645.520652:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2403:x1875765311147136:12345-192.168.204.39@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788872645.520681:0:66190:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a8c1cab100 x1875765311147136/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:571/0 lens 224/0 e 0 to 0 dl 1788872656 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872645.520702:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2403:x1875765311147136:12345-192.168.204.39@tcp:400:ldlm_lock_repla.0 Request processed in 52us (356us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872645.520721:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1134 00000020:00080000:1.0:1788872645.520741:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872645.520745:0:87094:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215114 00010000:00080000:1.0:1788872645.520748:0:87094:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788872645.520751:0:87094:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872645.520759:0:87094:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788872645.520762:0:87094:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788872645.520893:0:87094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:0.0:1788872645.522991:0:87060:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00100000:0.0:1788872645.523004:0:87060:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1788872645.523026:0:87060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00010000:00010000:0.0:1788872645.523075:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e000/0xe4e6e89fb01d9da3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523088:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e000/0xe4e6e89fb01d9da3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523116:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e000/0xe4e6e89fb01d9da3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523123:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98e000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872645.523129:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e000/0xe4e6e89fb01d9da3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523138:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e000/0xe4e6e89fb01d9da3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523155:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e000/0xe4e6e89fb01d9da3 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523162:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98e000/0xe4e6e89fb01d9da3 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523189:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01d9db1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523194:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01d9db1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523199:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01d9db1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523203:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ca00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872645.523205:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01d9db1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523210:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01d9db1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523223:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01d9db1 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.523229:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01d9db1 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87094 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788872645.523266:0:87094:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1788872645.523391:0:87094:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1788872645.523405:0:87094:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff98a8c3b49880 x1875765327662336/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:571/0 lens 224/0 e 0 to 0 dl 1788872656 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788872645.523582:0:87094:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.39@tcp: req@ffff98a8c1cab100 x1875765311147136/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:571/0 lens 224/0 e 0 to 0 dl 1788872656 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788872645.523784:0:87094:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1788872645.525762:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1788872645.525781:0:3643:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff98a8c5ae1880 x1875765327662336/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872661 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872645.525794:0:3643:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff98a8c5ae1880 x1875765327662336/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872661 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872645.525802:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788872645.525836:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788872645.525842:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327662336:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788872645.526275:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327662464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872645.526401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872645.526886:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327662464 00000100:00100000:3.0:1788872645.526900:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327662464 00000100:00100000:3.0:1788872645.526965:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:3.0:1788872645.526976:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327662464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872645.527013:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:3.0:1788872645.527071:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327662464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872645.527078:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00100000:1.0:1788872645.527802:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327662464:0@lo:41:osp-pre-0-1.0 00000004:00000080:3.0:1788872645.600456:0:87094:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb002c1debe10 00100000:10000000:3.0:1788872645.600473:0:87094:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1788872645.602840:0:87080:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1788872645.602903:0:87080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1caaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87080:1875765327662592:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788872645.602986:0:87080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872645.603034:0:87080:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c4e68600 going to sleep for 11 seconds 00000004:00080000:0.0:1788872645.603821:0:87082:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:0.0:1788872645.603850:0:87082:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87082:1875765327662720:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788872645.603888:0:87082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872645.603921:0:87082:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c4e68f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872645.605735:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327662592 00000100:00100000:1.0:1788872645.605753:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327662592 00000100:00100000:1.0:1788872645.605821:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327662720 00000100:00100000:1.0:1788872645.605825:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327662720 00000100:00100000:1.0:1788872645.605891:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5944 00000100:00100000:1.0:1788872645.605902:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:87080:x1875765327662592:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788872645.605936:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -593 00002000:02000040:1.0:1788872645.605941:0:8436:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:769) 00000100:00100000:0.0:1788872645.614716:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5945 00000100:00100000:0.0:1788872645.614746:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:87082:x1875765327662720:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788872645.614789:0:26185:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -95 00002000:02000040:0.0:1788872645.614795:0:26185:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:769) 00002000:00010000:1.0:1788872645.621833:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.621860:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d9db8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.621880:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x301:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.621885:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.621892:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d9db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.621911:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d9db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.621923:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d9db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.621930:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d9db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.621973:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872645.622112:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.622118:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d9dbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622127:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x300:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.622129:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x300:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.622134:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d9dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622143:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d9dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622151:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d9dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622158:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d9dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622173:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788872645.622217:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.622222:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9dc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622230:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ff:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.622240:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.622245:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622255:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622262:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9dc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622270:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622284:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788872645.622321:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.622327:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01d9dcd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622334:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fe:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.622337:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.622341:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01d9dcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622352:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01d9dcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622360:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01d9dcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622774:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01d9dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622802:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872645.622808:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d9db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622826:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9da00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872645.622831:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d9db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622840:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d9db8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622859:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d9db8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622868:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af4ef0a2/0xe4e6e89fb01d9db8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622888:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872645.622893:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d9dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622899:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ca00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872645.622909:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d9dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622917:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d9dbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622928:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d9dbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622936:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b92130aa/0xe4e6e89fb01d9dbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622950:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872645.622953:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622960:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872645.622963:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622971:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622980:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9dc6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.622987:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077e0dce5/0xe4e6e89fb01d9dc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.623008:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872645.623010:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872645.623012:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872645.623019:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872645.623024:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872645.623243:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872645.623320:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.623327:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9dd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.623338:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fd:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.623343:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.623348:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.623355:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872645.623360:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.623365:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01d9dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.623377:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.623381:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01d9dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.623390:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01d9dcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.623402:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01d9dcd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.623409:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01d9dcd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.623426:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.623434:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.623436:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788872645.625074:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788872645.628166:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.628179:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.628215:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872645.628342:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.628357:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095255154/0xe4e6e89fb01d9ddb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.628369:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fc:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.628374:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.628380:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095255154/0xe4e6e89fb01d9ddb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.628395:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095255154/0xe4e6e89fb01d9ddb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.628403:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095255154/0xe4e6e89fb01d9ddb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.628410:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095255154/0xe4e6e89fb01d9ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.628424:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788872645.628456:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.628461:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9de2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.628468:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fb:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.628470:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.628474:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.628483:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.628497:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629055:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629071:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788872645.629113:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.629118:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9de9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629127:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fa:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.629131:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.629136:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9de9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629146:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9de9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629154:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9de9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629162:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9de9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629187:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788872645.629224:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.629229:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9df0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629237:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f9:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.629240:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.629244:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629253:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629260:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629268:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629276:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788872645.629301:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.629306:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001905dbac/0xe4e6e89fb01d9df7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629313:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f8:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.629321:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.629326:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001905dbac/0xe4e6e89fb01d9df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629335:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001905dbac/0xe4e6e89fb01d9df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629342:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001905dbac/0xe4e6e89fb01d9df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629349:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001905dbac/0xe4e6e89fb01d9df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629356:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788872645.629387:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.629392:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9dfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629398:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f7:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.629401:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.629405:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9dfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629413:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9dfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629421:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9dfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629433:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9dfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629441:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788872645.629469:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.629474:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9e05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629481:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f6:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.629483:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.629488:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629496:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.629503:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630021:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788872645.630032:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630043:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.630048:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630059:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630077:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9dd4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630086:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01d9dd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630106:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788872645.630110:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095255154/0xe4e6e89fb01d9ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630116:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.630120:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095255154/0xe4e6e89fb01d9ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630140:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095255154/0xe4e6e89fb01d9ddb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630150:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095255154/0xe4e6e89fb01d9ddb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630157:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095255154/0xe4e6e89fb01d9ddb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630170:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788872645.630175:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630182:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.630185:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630192:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9de2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630201:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9de2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630208:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01d9de2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630229:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788872645.630232:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9de9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630239:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.630243:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9de9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630250:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9de9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630259:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9de9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630266:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01d9de9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630277:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788872645.630280:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630286:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.630290:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630307:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9df0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630317:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9df0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630324:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01d9df0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630335:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872645.630339:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001905dbac/0xe4e6e89fb01d9df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630344:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.630347:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001905dbac/0xe4e6e89fb01d9df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630354:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001905dbac/0xe4e6e89fb01d9df7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630363:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001905dbac/0xe4e6e89fb01d9df7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630371:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001905dbac/0xe4e6e89fb01d9df7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630392:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.630396:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9dfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630402:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.630405:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9dfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630414:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9dfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630424:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9dfe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630430:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9dfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.630441:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.630443:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.630445:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.630452:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872645.630890:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.630916:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872645.631021:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.631027:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01d9e0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631044:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f5:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.631048:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.631054:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01d9e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631065:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01d9e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631074:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01d9e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631080:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01d9e0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631100:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788872645.631139:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.631144:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9e13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631152:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f4:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.631155:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.631158:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9e13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631166:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9e13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631185:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9e13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631193:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9e13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631200:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788872645.631241:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.631246:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9e1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631253:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f3:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.631255:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.631259:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9e1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631268:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9e1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631275:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9e1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631282:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9e1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631301:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788872645.631338:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.631344:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9e21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631351:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f2:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.631354:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.631358:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9e21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631366:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9e21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631373:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9e21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631381:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9e21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.631389:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788872645.632136:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.632144:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9e28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632154:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f1:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.632164:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.632169:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9e28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632178:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9e28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632186:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9e28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632192:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9e28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632201:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788872645.632252:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.632258:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01d9e2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632265:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f0:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.632268:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.632271:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01d9e2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632280:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01d9e2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632287:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01d9e2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632302:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01d9e2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632310:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788872645.632348:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.632353:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01d9e36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632361:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ef:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.632364:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.632369:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01d9e36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632378:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01d9e36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632386:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01d9e36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632393:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01d9e36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632403:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1788872645.632441:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.632447:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01d9e3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632460:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ee:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.632463:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.632468:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01d9e3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632477:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01d9e3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632485:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01d9e3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632493:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01d9e3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.632503:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1788872645.634345:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.634355:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff7af64/0xe4e6e89fb01d9e44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634371:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ed:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.634376:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.634382:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ff7af64/0xe4e6e89fb01d9e44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634396:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ff7af64/0xe4e6e89fb01d9e44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634399:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788872645.634411:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634435:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872645.634435:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff7af64/0xe4e6e89fb01d9e44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634445:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ff7af64/0xe4e6e89fb01d9e44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634453:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634460:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1788872645.634471:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9e05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634495:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9e05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872645.634498:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.634509:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01d9e4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634510:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9e05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634533:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ec:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.634536:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.634537:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788872645.634541:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01d9e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634543:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01d9e0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634575:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01d9e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634576:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.634583:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01d9e0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634591:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01d9e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634597:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01d9e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634604:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01d9e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634614:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01d9e0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634636:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01d9e0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634640:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1788872645.634663:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788872645.634668:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9e13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634676:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.634680:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9e13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872645.634680:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.634689:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016872a2a/0xe4e6e89fb01d9e52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634696:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9e13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634701:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2eb:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.634708:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.634715:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016872a2a/0xe4e6e89fb01d9e52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634717:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9e13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634734:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016872a2a/0xe4e6e89fb01d9e52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634742:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016872a2a/0xe4e6e89fb01d9e52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634754:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9e13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634755:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016872a2a/0xe4e6e89fb01d9e52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634779:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1788872645.634784:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788872645.634790:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9e1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634798:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.634802:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9e1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872645.634825:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.634836:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e779fb/0xe4e6e89fb01d9e59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634841:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9e1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634847:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ea:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.634856:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9e1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634862:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.634873:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9e1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634873:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e779fb/0xe4e6e89fb01d9e59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634896:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e779fb/0xe4e6e89fb01d9e59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634902:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788872645.634907:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e779fb/0xe4e6e89fb01d9e59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634908:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9e21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634927:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872645.634927:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e779fb/0xe4e6e89fb01d9e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634935:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9e21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634941:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1788872645.634946:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9e21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634959:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9e21 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.634968:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9e21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872645.634977:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.634984:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e3b5fdd/0xe4e6e89fb01d9e60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.634999:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e9:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.635001:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.635005:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788872645.635006:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e3b5fdd/0xe4e6e89fb01d9e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635018:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e3b5fdd/0xe4e6e89fb01d9e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635024:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9e28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635027:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e3b5fdd/0xe4e6e89fb01d9e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635035:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.635042:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9e28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635045:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e3b5fdd/0xe4e6e89fb01d9e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635061:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9e28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635064:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1788872645.635079:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9e28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635088:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9e28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872645.635103:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.635105:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788872645.635110:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dba3f2b/0xe4e6e89fb01d9e67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635112:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01d9e2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635130:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e8:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.635131:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872645.635136:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.635138:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01d9e2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635143:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dba3f2b/0xe4e6e89fb01d9e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635157:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dba3f2b/0xe4e6e89fb01d9e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635178:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01d9e2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635179:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dba3f2b/0xe4e6e89fb01d9e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635201:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dba3f2b/0xe4e6e89fb01d9e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635208:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01d9e2f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635211:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1788872645.635222:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01d9e2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635240:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00002000:00010000:1.0:1788872645.635244:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.635245:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01d9e36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635253:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cb9e497/0xe4e6e89fb01d9e6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635256:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.635260:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01d9e36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635280:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e7:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.635281:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01d9e36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635286:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.635296:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cb9e497/0xe4e6e89fb01d9e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635301:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01d9e36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635308:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cb9e497/0xe4e6e89fb01d9e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635313:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01d9e36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635321:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cb9e497/0xe4e6e89fb01d9e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635330:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cb9e497/0xe4e6e89fb01d9e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635352:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1788872645.635383:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00002000:00010000:1.0:1788872645.635386:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.635389:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01d9e3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635393:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cf66fb6/0xe4e6e89fb01d9e75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635410:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872645.635412:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e6:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.635417:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.635418:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01d9e3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635423:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cf66fb6/0xe4e6e89fb01d9e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635435:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01d9e3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635438:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cf66fb6/0xe4e6e89fb01d9e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635462:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01d9e3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635469:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cf66fb6/0xe4e6e89fb01d9e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635475:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01d9e3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635483:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cf66fb6/0xe4e6e89fb01d9e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635496:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1788872645.635499:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788872645.635504:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ff7af64/0xe4e6e89fb01d9e44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635512:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.635517:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff7af64/0xe4e6e89fb01d9e44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872645.635532:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.635540:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081f93d5f/0xe4e6e89fb01d9e7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635541:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff7af64/0xe4e6e89fb01d9e44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635584:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e5:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.635588:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.635591:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ff7af64/0xe4e6e89fb01d9e44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635593:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081f93d5f/0xe4e6e89fb01d9e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635615:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ff7af64/0xe4e6e89fb01d9e44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635618:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081f93d5f/0xe4e6e89fb01d9e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635634:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081f93d5f/0xe4e6e89fb01d9e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635639:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788872645.635646:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081f93d5f/0xe4e6e89fb01d9e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635647:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01d9e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635664:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52aec00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.635669:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01d9e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635682:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1788872645.635685:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01d9e4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635697:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01d9e4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635706:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01d9e4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872645.635718:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.635728:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456b82ec/0xe4e6e89fb01d9e83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635737:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e4:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.635740:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788872645.635740:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.635745:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456b82ec/0xe4e6e89fb01d9e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635748:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016872a2a/0xe4e6e89fb01d9e52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635762:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456b82ec/0xe4e6e89fb01d9e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635763:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52afc00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.635768:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016872a2a/0xe4e6e89fb01d9e52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635778:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456b82ec/0xe4e6e89fb01d9e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635783:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016872a2a/0xe4e6e89fb01d9e52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635788:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456b82ec/0xe4e6e89fb01d9e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635804:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016872a2a/0xe4e6e89fb01d9e52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635804:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1788872645.635830:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016872a2a/0xe4e6e89fb01d9e52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635847:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788872645.635852:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e779fb/0xe4e6e89fb01d9e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872645.635853:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872645.635863:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001fb6e6f/0xe4e6e89fb01d9e8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635865:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.635872:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e779fb/0xe4e6e89fb01d9e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635878:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e3:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.635888:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.635897:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001fb6e6f/0xe4e6e89fb01d9e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635902:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e779fb/0xe4e6e89fb01d9e59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635910:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001fb6e6f/0xe4e6e89fb01d9e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635918:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e779fb/0xe4e6e89fb01d9e59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635920:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001fb6e6f/0xe4e6e89fb01d9e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635942:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e779fb/0xe4e6e89fb01d9e59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635943:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001fb6e6f/0xe4e6e89fb01d9e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.635967:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1788872645.635971:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788872645.635977:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e3b5fdd/0xe4e6e89fb01d9e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.635986:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.635991:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e3b5fdd/0xe4e6e89fb01d9e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872645.635999:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.636000:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e3b5fdd/0xe4e6e89fb01d9e60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.636009:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030a6ccbc/0xe4e6e89fb01d9e91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636017:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e3b5fdd/0xe4e6e89fb01d9e60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.636020:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e2:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.636027:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.636036:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030a6ccbc/0xe4e6e89fb01d9e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636037:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e3b5fdd/0xe4e6e89fb01d9e60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.636059:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030a6ccbc/0xe4e6e89fb01d9e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.636080:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030a6ccbc/0xe4e6e89fb01d9e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636090:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788872645.636097:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dba3f2b/0xe4e6e89fb01d9e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.636099:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030a6ccbc/0xe4e6e89fb01d9e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636119:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52afa00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872645.636122:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1788872645.636124:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dba3f2b/0xe4e6e89fb01d9e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636135:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dba3f2b/0xe4e6e89fb01d9e67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636148:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dba3f2b/0xe4e6e89fb01d9e67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636156:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dba3f2b/0xe4e6e89fb01d9e67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636172:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788872645.636177:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cb9e497/0xe4e6e89fb01d9e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636185:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.636189:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cb9e497/0xe4e6e89fb01d9e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636210:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cb9e497/0xe4e6e89fb01d9e6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636223:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cb9e497/0xe4e6e89fb01d9e6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636233:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cb9e497/0xe4e6e89fb01d9e6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636248:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788872645.636253:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cf66fb6/0xe4e6e89fb01d9e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636261:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.636265:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cf66fb6/0xe4e6e89fb01d9e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636274:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cf66fb6/0xe4e6e89fb01d9e75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636286:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cf66fb6/0xe4e6e89fb01d9e75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636296:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cf66fb6/0xe4e6e89fb01d9e75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636322:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788872645.636326:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081f93d5f/0xe4e6e89fb01d9e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636335:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52afe00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.636339:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081f93d5f/0xe4e6e89fb01d9e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636349:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081f93d5f/0xe4e6e89fb01d9e7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636361:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081f93d5f/0xe4e6e89fb01d9e7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636369:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081f93d5f/0xe4e6e89fb01d9e7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636384:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788872645.636388:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456b82ec/0xe4e6e89fb01d9e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636394:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52aea00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.636399:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456b82ec/0xe4e6e89fb01d9e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636420:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456b82ec/0xe4e6e89fb01d9e83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636433:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456b82ec/0xe4e6e89fb01d9e83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636442:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456b82ec/0xe4e6e89fb01d9e83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636457:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872645.636461:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001fb6e6f/0xe4e6e89fb01d9e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636468:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.636472:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001fb6e6f/0xe4e6e89fb01d9e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636481:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001fb6e6f/0xe4e6e89fb01d9e8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636494:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001fb6e6f/0xe4e6e89fb01d9e8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636503:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001fb6e6f/0xe4e6e89fb01d9e8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636531:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.636535:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030a6ccbc/0xe4e6e89fb01d9e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636544:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.636571:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030a6ccbc/0xe4e6e89fb01d9e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636581:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030a6ccbc/0xe4e6e89fb01d9e91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636595:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030a6ccbc/0xe4e6e89fb01d9e91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636603:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030a6ccbc/0xe4e6e89fb01d9e91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.636616:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.636618:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.636620:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.638182:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.638192:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.638197:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.640190:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.640207:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbb2d303/0xe4e6e89fb01d9e98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640250:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x301:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.640255:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.640264:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb2d303/0xe4e6e89fb01d9e98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640282:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbb2d303/0xe4e6e89fb01d9e98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640294:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbb2d303/0xe4e6e89fb01d9e98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640302:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb2d303/0xe4e6e89fb01d9e98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640329:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872645.640460:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.640467:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047495f25/0xe4e6e89fb01d9e9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640475:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x300:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.640478:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x300:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.640483:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047495f25/0xe4e6e89fb01d9e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640491:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047495f25/0xe4e6e89fb01d9e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640510:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047495f25/0xe4e6e89fb01d9e9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640516:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047495f25/0xe4e6e89fb01d9e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640529:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788872645.640541:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872645.640564:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbb2d303/0xe4e6e89fb01d9e98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640572:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.640577:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbb2d303/0xe4e6e89fb01d9e98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640588:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbb2d303/0xe4e6e89fb01d9e98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640607:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbb2d303/0xe4e6e89fb01d9e98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640617:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbb2d303/0xe4e6e89fb01d9e98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640653:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.640663:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047495f25/0xe4e6e89fb01d9e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640669:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.640672:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047495f25/0xe4e6e89fb01d9e9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640680:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047495f25/0xe4e6e89fb01d9e9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640691:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047495f25/0xe4e6e89fb01d9e9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640698:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047495f25/0xe4e6e89fb01d9e9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640713:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.640715:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.640717:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.640764:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.640769:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000542517b6/0xe4e6e89fb01d9ea6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640777:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ff:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.640781:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.640784:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000542517b6/0xe4e6e89fb01d9ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640805:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000542517b6/0xe4e6e89fb01d9ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640829:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000542517b6/0xe4e6e89fb01d9ea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640837:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000542517b6/0xe4e6e89fb01d9ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640851:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.640859:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.640863:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000542517b6/0xe4e6e89fb01d9ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640870:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deb200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.640874:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000542517b6/0xe4e6e89fb01d9ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640881:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000542517b6/0xe4e6e89fb01d9ea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640890:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000542517b6/0xe4e6e89fb01d9ea6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640897:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000542517b6/0xe4e6e89fb01d9ea6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640918:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.640919:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.640921:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.640963:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.640969:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c999114f/0xe4e6e89fb01d9ead lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640977:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fe:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.640980:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.640984:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c999114f/0xe4e6e89fb01d9ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.640992:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c999114f/0xe4e6e89fb01d9ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641000:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c999114f/0xe4e6e89fb01d9ead lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641007:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c999114f/0xe4e6e89fb01d9ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641026:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.641033:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.641038:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c999114f/0xe4e6e89fb01d9ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641056:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5debc00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.641060:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c999114f/0xe4e6e89fb01d9ead lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641068:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c999114f/0xe4e6e89fb01d9ead lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641079:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c999114f/0xe4e6e89fb01d9ead lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641088:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c999114f/0xe4e6e89fb01d9ead lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641102:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.641104:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.641105:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.641146:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.641152:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013c2a7bf/0xe4e6e89fb01d9eb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641159:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fd:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.641162:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.641166:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013c2a7bf/0xe4e6e89fb01d9eb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641174:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013c2a7bf/0xe4e6e89fb01d9eb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641189:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013c2a7bf/0xe4e6e89fb01d9eb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641196:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013c2a7bf/0xe4e6e89fb01d9eb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641211:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.641219:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.641223:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013c2a7bf/0xe4e6e89fb01d9eb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641229:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5debe00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.641232:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013c2a7bf/0xe4e6e89fb01d9eb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641240:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013c2a7bf/0xe4e6e89fb01d9eb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641252:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013c2a7bf/0xe4e6e89fb01d9eb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641259:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013c2a7bf/0xe4e6e89fb01d9eb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641273:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.641282:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.641284:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.641331:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.641336:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9ebb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641345:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fc:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.641348:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.641352:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641361:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641369:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9ebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641376:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641389:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.641395:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.641399:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641406:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5dea800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.641409:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641428:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9ebb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641438:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9ebb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641446:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d450c8cd/0xe4e6e89fb01d9ebb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641460:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.641462:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.641463:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.641506:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.641511:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9ec2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641519:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fb:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.641522:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.641526:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9ec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641534:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9ec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641542:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9ec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641583:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9ec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641595:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.641602:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.641605:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9ec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641612:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5deae00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.641615:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9ec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641623:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9ec2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641633:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9ec2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641639:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc39fed/0xe4e6e89fb01d9ec2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641653:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.641654:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.641656:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.641710:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.641720:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f34257e/0xe4e6e89fb01d9ec9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641728:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fa:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.641730:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.641734:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f34257e/0xe4e6e89fb01d9ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641742:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f34257e/0xe4e6e89fb01d9ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641749:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f34257e/0xe4e6e89fb01d9ec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641756:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f34257e/0xe4e6e89fb01d9ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641768:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.641774:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.641778:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f34257e/0xe4e6e89fb01d9ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641784:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.641788:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f34257e/0xe4e6e89fb01d9ec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641795:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f34257e/0xe4e6e89fb01d9ec9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641831:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f34257e/0xe4e6e89fb01d9ec9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641838:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f34257e/0xe4e6e89fb01d9ec9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641853:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.641855:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.641856:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.641897:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.641902:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01d9ed0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641910:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f9:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.641913:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.641917:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01d9ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641926:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01d9ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641932:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01d9ed0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641939:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01d9ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641962:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.641969:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.641972:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01d9ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641979:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.641982:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01d9ed0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.641992:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01d9ed0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642003:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01d9ed0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642010:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01d9ed0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642025:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.642027:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.642028:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.642067:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.642072:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a13d6fa/0xe4e6e89fb01d9ed7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642080:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f8:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.642088:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.642093:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a13d6fa/0xe4e6e89fb01d9ed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642101:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a13d6fa/0xe4e6e89fb01d9ed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642110:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a13d6fa/0xe4e6e89fb01d9ed7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642117:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a13d6fa/0xe4e6e89fb01d9ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642128:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.642134:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.642137:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a13d6fa/0xe4e6e89fb01d9ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642144:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.642148:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a13d6fa/0xe4e6e89fb01d9ed7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642156:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a13d6fa/0xe4e6e89fb01d9ed7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642165:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a13d6fa/0xe4e6e89fb01d9ed7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642184:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a13d6fa/0xe4e6e89fb01d9ed7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642201:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.642203:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.642204:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.642243:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.642248:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000155b9969/0xe4e6e89fb01d9ede lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642256:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f7:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.642259:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.642263:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155b9969/0xe4e6e89fb01d9ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642273:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000155b9969/0xe4e6e89fb01d9ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642281:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000155b9969/0xe4e6e89fb01d9ede lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642288:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000155b9969/0xe4e6e89fb01d9ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642301:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.642313:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.642317:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000155b9969/0xe4e6e89fb01d9ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642324:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.642327:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000155b9969/0xe4e6e89fb01d9ede lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642336:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000155b9969/0xe4e6e89fb01d9ede lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642347:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000155b9969/0xe4e6e89fb01d9ede lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642355:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000155b9969/0xe4e6e89fb01d9ede lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642372:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.642374:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.642376:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.642415:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.642420:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080dd84ff/0xe4e6e89fb01d9ee5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642428:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f6:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.642431:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.642435:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080dd84ff/0xe4e6e89fb01d9ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642454:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080dd84ff/0xe4e6e89fb01d9ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642462:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080dd84ff/0xe4e6e89fb01d9ee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642469:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080dd84ff/0xe4e6e89fb01d9ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642480:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.642488:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.642491:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080dd84ff/0xe4e6e89fb01d9ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642497:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.642500:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080dd84ff/0xe4e6e89fb01d9ee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642507:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080dd84ff/0xe4e6e89fb01d9ee5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642517:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080dd84ff/0xe4e6e89fb01d9ee5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642525:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080dd84ff/0xe4e6e89fb01d9ee5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642570:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.642572:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.642574:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.642613:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.642619:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c376e15/0xe4e6e89fb01d9eec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642626:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f5:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.642629:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.642633:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c376e15/0xe4e6e89fb01d9eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642641:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c376e15/0xe4e6e89fb01d9eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642650:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c376e15/0xe4e6e89fb01d9eec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642656:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c376e15/0xe4e6e89fb01d9eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642667:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.642674:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.642678:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c376e15/0xe4e6e89fb01d9eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642695:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.642699:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c376e15/0xe4e6e89fb01d9eec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642707:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c376e15/0xe4e6e89fb01d9eec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642719:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c376e15/0xe4e6e89fb01d9eec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642727:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c376e15/0xe4e6e89fb01d9eec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642744:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.642745:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.642747:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.642796:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.642802:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b99f1f25/0xe4e6e89fb01d9ef3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642827:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f4:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.642830:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.642835:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b99f1f25/0xe4e6e89fb01d9ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642844:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b99f1f25/0xe4e6e89fb01d9ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642858:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b99f1f25/0xe4e6e89fb01d9ef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642865:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b99f1f25/0xe4e6e89fb01d9ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642877:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.642883:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.642887:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b99f1f25/0xe4e6e89fb01d9ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642893:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.642896:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b99f1f25/0xe4e6e89fb01d9ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642904:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b99f1f25/0xe4e6e89fb01d9ef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642914:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b99f1f25/0xe4e6e89fb01d9ef3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642922:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b99f1f25/0xe4e6e89fb01d9ef3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.642938:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.642944:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.642947:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872645.648709:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788872645.652419:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00080000:1.0:1788872645.653251:0:8436:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:1.0:1788872645.653412:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:87080:x1875765327662592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 47508us (50422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872645.653425:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5944 00002000:00010000:3.0:1788872645.653775:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.653785:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf408d45/0xe4e6e89fb01d9efa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.653803:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f3:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.653808:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.653830:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf408d45/0xe4e6e89fb01d9efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.653849:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf408d45/0xe4e6e89fb01d9efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.653861:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf408d45/0xe4e6e89fb01d9efa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.653869:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf408d45/0xe4e6e89fb01d9efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.653993:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.654006:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.654013:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf408d45/0xe4e6e89fb01d9efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654022:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.654028:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf408d45/0xe4e6e89fb01d9efa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654052:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf408d45/0xe4e6e89fb01d9efa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654072:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf408d45/0xe4e6e89fb01d9efa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654080:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf408d45/0xe4e6e89fb01d9efa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654112:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.654115:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.654117:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.654182:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.654188:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075d536be/0xe4e6e89fb01d9f01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654197:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f2:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.654200:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.654206:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075d536be/0xe4e6e89fb01d9f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654216:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075d536be/0xe4e6e89fb01d9f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654225:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075d536be/0xe4e6e89fb01d9f01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654239:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075d536be/0xe4e6e89fb01d9f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654254:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.654262:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.654268:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075d536be/0xe4e6e89fb01d9f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654276:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.654279:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075d536be/0xe4e6e89fb01d9f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654287:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075d536be/0xe4e6e89fb01d9f01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654299:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075d536be/0xe4e6e89fb01d9f01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654306:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075d536be/0xe4e6e89fb01d9f01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654322:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.654323:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.654325:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.654368:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.654379:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042a172fa/0xe4e6e89fb01d9f08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654388:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f1:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.654391:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.654395:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042a172fa/0xe4e6e89fb01d9f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654405:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042a172fa/0xe4e6e89fb01d9f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654414:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042a172fa/0xe4e6e89fb01d9f08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654421:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042a172fa/0xe4e6e89fb01d9f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654435:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.654443:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.654448:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042a172fa/0xe4e6e89fb01d9f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654456:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.654459:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042a172fa/0xe4e6e89fb01d9f08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654467:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042a172fa/0xe4e6e89fb01d9f08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654485:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042a172fa/0xe4e6e89fb01d9f08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654493:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042a172fa/0xe4e6e89fb01d9f08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654509:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.654511:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.654513:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.654573:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.654579:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e342ab9f/0xe4e6e89fb01d9f0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654588:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f0:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.654591:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.654596:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e342ab9f/0xe4e6e89fb01d9f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654605:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e342ab9f/0xe4e6e89fb01d9f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654614:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e342ab9f/0xe4e6e89fb01d9f0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654622:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e342ab9f/0xe4e6e89fb01d9f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654649:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872645.654686:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.654691:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d9f16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654699:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ef:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.654702:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.654706:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d9f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654714:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d9f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654721:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d9f16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654728:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d9f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654740:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788872645.654747:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872645.654751:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e342ab9f/0xe4e6e89fb01d9f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654757:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.654765:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e342ab9f/0xe4e6e89fb01d9f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654773:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e342ab9f/0xe4e6e89fb01d9f0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654784:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e342ab9f/0xe4e6e89fb01d9f0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654791:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e342ab9f/0xe4e6e89fb01d9f0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654806:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.654829:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d9f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654836:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.654840:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d9f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654847:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d9f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654856:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d9f16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654863:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097377c59/0xe4e6e89fb01d9f16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654885:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.654886:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.654888:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.654932:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.654938:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c43e313/0xe4e6e89fb01d9f1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654947:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ee:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.654950:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.654954:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c43e313/0xe4e6e89fb01d9f1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654964:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c43e313/0xe4e6e89fb01d9f1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654972:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c43e313/0xe4e6e89fb01d9f1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654981:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c43e313/0xe4e6e89fb01d9f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.654992:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.654998:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.655002:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c43e313/0xe4e6e89fb01d9f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655019:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.655022:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c43e313/0xe4e6e89fb01d9f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655030:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c43e313/0xe4e6e89fb01d9f1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655040:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c43e313/0xe4e6e89fb01d9f1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655048:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c43e313/0xe4e6e89fb01d9f1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655062:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.655064:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.655066:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.655110:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.655115:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a291e666/0xe4e6e89fb01d9f24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655122:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ed:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.655125:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.655129:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a291e666/0xe4e6e89fb01d9f24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655137:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a291e666/0xe4e6e89fb01d9f24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655151:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a291e666/0xe4e6e89fb01d9f24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655158:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a291e666/0xe4e6e89fb01d9f24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655172:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.655178:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.655182:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a291e666/0xe4e6e89fb01d9f24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655188:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.655191:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a291e666/0xe4e6e89fb01d9f24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655200:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a291e666/0xe4e6e89fb01d9f24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655211:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a291e666/0xe4e6e89fb01d9f24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655219:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a291e666/0xe4e6e89fb01d9f24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655234:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.655241:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.655243:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.655286:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.655291:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01d9f2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655299:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ec:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.655302:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.655306:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01d9f2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655314:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01d9f2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655321:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01d9f2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655328:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01d9f2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655341:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.655347:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.655350:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01d9f2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655357:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.655360:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01d9f2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655378:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01d9f2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655390:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01d9f2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655397:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01d9f2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655412:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.655413:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.655414:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.655454:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.655460:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d9f32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655468:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2eb:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.655471:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.655475:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d9f32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655484:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d9f32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655491:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d9f32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655504:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d9f32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655515:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.655522:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.655525:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d9f32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655532:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.655536:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d9f32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655544:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d9f32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655578:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d9f32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655587:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01d9f32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655600:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.655602:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.655603:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.655640:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.655650:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d9f39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655658:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ea:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.655661:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.655666:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d9f39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655675:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d9f39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655683:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d9f39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655690:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d9f39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655700:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.655706:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.655709:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d9f39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655716:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.655719:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d9f39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655726:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d9f39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655742:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d9f39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655749:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f26578c/0xe4e6e89fb01d9f39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655763:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.655765:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.655767:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.655804:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.655824:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9f40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655833:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e9:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.655836:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.655840:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9f40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655848:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9f40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655855:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9f40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655862:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9f40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655885:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.655892:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.655896:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9f40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655903:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.655906:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9f40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655914:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9f40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655925:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9f40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655932:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2a37838/0xe4e6e89fb01d9f40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655946:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.655948:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.655949:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.655986:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.655991:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9f47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.655999:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e8:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.656008:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.656012:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9f47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656021:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9f47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656028:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9f47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656035:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9f47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656047:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.656054:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.656057:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9f47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656064:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.656067:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9f47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656074:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9f47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656084:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9f47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656102:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01d9f47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656116:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.656118:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.656120:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.656158:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.656164:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9f4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656172:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e7:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.656176:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.656180:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9f4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656188:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9f4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656196:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9f4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656202:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9f4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656214:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872645.656225:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.656229:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9f4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656235:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.656239:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9f4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656247:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9f4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.656258:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9f4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872645.660299:0:87080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1caaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87080:1875765327662592:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788872645.660324:0:87080:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x301:0x0] from OST, last_created [0x280000401:0x301:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1788872645.660420:0:87080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87080:1875765327662976:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788872645.660488:0:87080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872645.660572:0:87080:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c4e68600 going to sleep for 11 seconds 00000100:00100000:0.0:1788872645.660620:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327662976 00000100:00100000:0.0:1788872645.660629:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327662976 00000100:00100000:0.0:1788872645.660684:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5946 00000100:00100000:0.0:1788872645.660693:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:87080:x1875765327662976:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788872645.660740:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 770 00000100:00100000:2.0:1788872645.661659:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327662848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872645.661721:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872645.661790:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327662848 00000100:00100000:2.0:1788872645.661796:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327662848 00000100:00100000:2.0:1788872645.661851:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:2.0:1788872645.661860:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327662848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872645.661880:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 896 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872645.661929:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327662848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872645.661937:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:2.0:1788872645.662157:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327662848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872645.662527:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:87080:x1875765327662976:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1834us (2038us total) trans 4294969450 rc 0/0 00000100:00100000:0.0:1788872645.662537:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5946 00000100:00100000:0.0:1788872645.662602:0:87080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1ca9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87080:1875765327662976:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788872645.662615:0:87080:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x301:0x0]-[0x280000401:0x321:0x0] 00010000:00010000:0.0:1788872645.662633:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.663606:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01d9f4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.663670:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.663673:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.663675:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872645.665221:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.665234:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9f55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665255:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e6:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.665261:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.665267:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9f55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665298:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9f55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665309:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9f55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665317:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9f55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665347:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872645.665405:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.665410:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d9f5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665418:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e5:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.665422:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.665425:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d9f5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665435:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d9f5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665444:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d9f5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665463:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d9f5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.665843:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872645.665854:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9f55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.665865:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872645.665870:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9f55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.665881:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9f55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665884:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872645.665906:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9f55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.665914:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a462e5c2/0xe4e6e89fb01d9f55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872645.665940:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.665948:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9f63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665957:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e4:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:1.0:1788872645.665958:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872645.665962:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872645.665964:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d9f5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665970:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9f63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.665975:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872645.665980:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d9f5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.665988:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9f63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.665991:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d9f5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.666016:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d9f5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.666023:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abca7289/0xe4e6e89fb01d9f5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.666036:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872645.666038:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872645.666039:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872645.666453:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.667107:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9f63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.667127:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9f63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.667154:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872645.667208:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872645.667217:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9f63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.667226:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872645.667230:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9f63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872645.667237:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872645.667245:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9f6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.667256:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9f63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.667268:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e3:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.667275:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872645.667278:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9f63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.667282:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9f6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.667294:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01d9f63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.667303:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9f6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.667314:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9f6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.667321:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9f6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.667329:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872645.667333:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872645.667337:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9f6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.667344:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872645.667348:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788872645.667348:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9f6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.667361:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9f6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.667372:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9f6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.667381:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01d9f6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872645.667398:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872645.667405:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.667406:0:26185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9f71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.667409:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872645.667413:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.667420:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e2:0x0].0x0 since=3582s v=(0 0) 00010000:00010000:3.0:1788872645.667423:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872645.667427:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9f71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.667437:0:26185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9f71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872645.667452:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872645.667458:0:26185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9f71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.667467:0:26185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9f71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872645.668861:0:26185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872645.669333:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872645.669344:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9f71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.669361:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872645.669367:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9f71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.669381:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9f71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.669404:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9f71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872645.669413:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01d9f71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788872645.669418:0:26185:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00010000:00010000:0.0:1788872645.669459:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872645.669463:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872645.669465:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872645.669541:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:87082:x1875765327662720:12345-0@lo:5:osp-pre-1-0.0 Request processed in 54806us (65647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872645.669572:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5945 00000100:00100000:0.0:1788872645.669968:0:87082:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87082:1875765327662720:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788872645.669987:0:87082:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x301:0x0] from OST, last_created [0x2c0000401:0x301:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:0.0:1788872645.670088:0:87082:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1caaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87082:1875765327663232:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788872645.670131:0:87082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872645.670167:0:87082:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c4e68f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872645.670532:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872645.670545:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327663104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872645.670828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872645.670865:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327663104 00000100:00100000:1.0:1788872645.670878:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327663104 00000100:00100000:1.0:1788872645.670923:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:1.0:1788872645.670931:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327663104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872645.670955:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872645.670994:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327663104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872645.671001:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:1.0:1788872645.671041:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327663104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872645.672884:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327663232 00000100:00100000:3.0:1788872645.672900:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327663232 00000100:00100000:3.0:1788872645.672968:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5947 00000100:00100000:3.0:1788872645.672978:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:87082:x1875765327663232:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788872645.673133:0:26184:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 770 00000100:00100000:3.0:1788872645.679787:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:87082:x1875765327663232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6797us (9643us total) trans 4294969450 rc 0/0 00000100:00100000:3.0:1788872645.679804:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5947 00000100:00100000:1.0:1788872645.679884:0:87082:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1caaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87082:1875765327663232:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788872645.679908:0:87082:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x301:0x0]-[0x2c0000401:0x321:0x0] 00000001:00100000:2.0:1788872645.822397:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788872645.890360:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872645.906851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872645.906906:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872645.907119:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311147392 00000100:00100000:2.0:1788872645.907133:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311147392 00000100:00100000:2.0:1788872645.907210:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1135 00000100:00100000:2.0:1788872645.907222:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311147392:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872645.907318:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311147392:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 99us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872645.907330:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1135 00000100:00100000:3.0:1788872645.907710:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311147264 00000100:00100000:3.0:1788872645.907716:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311147264 00000100:00100000:3.0:1788872645.907771:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 74 00000100:00100000:3.0:1788872645.907779:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311147264:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872645.907831:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311147264:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 53us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872645.907857:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 74 00010000:00010000:2.0:1788872646.904822:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788872647.129891:0:87348:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788872647.929751:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788872648.137603:0:87400:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788872648.137874:0:87400:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788872648.955107:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788872649.018158:0:87450:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788872649.018444:0:87450:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788872649.401022:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872649.401054:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327663360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872649.401172:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872649.401568:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872649.401581:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327663488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872649.401616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872649.405468:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327663360 00000100:00100000:2.0:1788872649.405485:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327663360 00000100:00100000:1.0:1788872649.405623:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327663488 00000100:00100000:1.0:1788872649.405629:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327663488 00000100:00100000:2.0:1788872649.405872:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:2.0:1788872649.405883:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327663360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872649.405919:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872649.406006:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327663360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (4833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872649.406013:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:2.0:1788872649.406686:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327663360:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788872649.406855:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872649.407077:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:3.0:1788872649.407094:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327663488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872649.407117:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872649.407179:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327663488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (5562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872649.407186:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:2.0:1788872649.407501:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327663488:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788872649.407635:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788872649.977304:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872650.424941:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327664000:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872650.425065:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327664512:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872650.425109:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327665024:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872650.425150:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788872650.425156:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f098b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327663872:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425177:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872650.425194:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327664384:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872650.425232:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327664896:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425252:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872650.425281:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327664512 00000100:00100000:2.0:1788872650.425288:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327664512 00000100:00100000:2.0:1788872650.425329:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327665024 00000100:00100000:2.0:1788872650.425332:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327665024 00000100:00100000:2.0:1788872650.425432:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327664384 00000100:00100000:2.0:1788872650.425436:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327664384 00000100:00100000:2.0:1788872650.425546:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327664896 00000100:00100000:2.0:1788872650.425577:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327664896 00000100:00100000:2.0:1788872650.425605:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485 00000100:00100000:2.0:1788872650.425614:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327664512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425666:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327664512:12345-0@lo:400:kworker.0 Request processed in 53us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872650.425673:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485 00000100:00100000:2.0:1788872650.425691:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486 00000100:00100000:2.0:1788872650.425697:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327665024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425739:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327665024:12345-0@lo:400:kworker.0 Request processed in 42us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872650.425751:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486 00000100:00100000:2.0:1788872650.425763:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2487 00000100:00100000:2.0:1788872650.425769:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327664384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425797:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327664384:12345-0@lo:400:kworker.0 Request processed in 29us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872650.425802:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2487 00000100:00100000:2.0:1788872650.425811:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488 00000100:00100000:2.0:1788872650.425816:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327664896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425836:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327664896:12345-0@lo:400:kworker.0 Request processed in 20us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872650.425841:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488 00000100:00100000:2.0:1788872650.425880:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327664384:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425889:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327664896:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425897:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327664512:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.425905:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327665024:0@lo:400:kworker.0 00000100:00080000:0.0:1788872650.426074:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872650.426079:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872650.426282:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327663744:0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.426316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872650.426359:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327664256:0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.426383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872650.426408:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327664768:0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.426434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872650.426467:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788872650.426474:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327663616:0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.426504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872650.426530:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327664128:0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.426581:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872650.426609:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327664640:0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.426630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872650.426650:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327665152:0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.426673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872650.426700:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327664000 00000100:00100000:3.0:1788872650.426714:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327664000 00000100:00100000:3.0:1788872650.426760:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327663872 00000100:00100000:3.0:1788872650.426764:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327663872 00000100:00100000:3.0:1788872650.426776:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327663744 00000100:00100000:3.0:1788872650.426778:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327663744 00000100:00100000:3.0:1788872650.426794:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327664128 00000100:00100000:3.0:1788872650.426796:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327664128 00000100:00100000:3.0:1788872650.426806:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327664640 00000100:00100000:3.0:1788872650.426808:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327664640 00000100:00100000:3.0:1788872650.426816:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327665152 00000100:00100000:3.0:1788872650.426819:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327665152 00000100:00100000:3.0:1788872650.426830:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1788872650.426837:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327664000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.426880:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327664000:12345-0@lo:400:kworker.0 Request processed in 43us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872650.426885:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1788872650.426900:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1788872650.426906:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327663872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.426948:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327663872:12345-0@lo:400:kworker.0 Request processed in 42us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872650.426954:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1788872650.426967:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1788872650.426974:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327663744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.427005:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327663744:12345-0@lo:400:kworker.0 Request processed in 33us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872650.427012:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1788872650.427023:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1788872650.427030:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327664128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.427068:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327664128:12345-0@lo:400:kworker.0 Request processed in 40us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872650.427074:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1788872650.427085:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1788872650.427093:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327664640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872650.427103:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1788872650.427111:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327665152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.427119:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327664640:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872650.427124:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1788872650.427142:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327665152:12345-0@lo:400:kworker.0 Request processed in 32us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872650.427148:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1788872650.427150:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327664256 00000100:00100000:3.0:1788872650.427153:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327664256 00000100:00100000:3.0:1788872650.427175:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327664768 00000100:00100000:3.0:1788872650.427178:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327664768 00000100:00100000:3.0:1788872650.427194:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:1.0:1788872650.427198:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:3.0:1788872650.427200:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327664256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872650.427203:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327664768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872650.427232:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327664256:12345-0@lo:400:kworker.0 Request processed in 32us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872650.427232:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327664768:12345-0@lo:400:kworker.0 Request processed in 29us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872650.427238:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:0.0:1788872650.427308:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872650.427319:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327665280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872650.427351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872650.427394:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327665280 00000100:00100000:0.0:1788872650.427398:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327665280 00000100:00100000:2.0:1788872650.429145:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327663616 00000100:00100000:2.0:1788872650.429156:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327663616 00000100:00100000:2.0:1788872650.429210:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788872650.429221:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327663616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.429296:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327663616:12345-0@lo:400:kworker.0 Request processed in 78us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872650.429304:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788872650.429849:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872650.429869:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788872650.429991:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327663616:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.430013:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327664128:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.430026:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327664640:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.430040:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327665152:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.430052:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327663744:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.430063:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327664256:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.430073:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327664768:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.430127:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f098b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327663872:0@lo:400:kworker.0 00000100:00100000:2.0:1788872650.430140:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327664000:0@lo:400:kworker.0 00000100:00100000:1.0:1788872650.434052:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:1.0:1788872650.434103:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:1.0:1788872650.434123:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327665280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872650.434167:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872650.434278:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327665280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (6924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872650.434285:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00100000:3.0:1788872650.434394:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327665280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872650.937238:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327665408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872650.937320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872650.937391:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872650.937397:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f09d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327665536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872650.937426:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872650.937661:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327665408 00000100:00100000:3.0:1788872650.937672:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327665408 00000100:00100000:3.0:1788872650.937755:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:3.0:1788872650.937766:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327665408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872650.937798:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872650.938027:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327665408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 263us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872650.938035:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:3.0:1788872650.938108:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872650.938134:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311147520 00000100:00100000:3.0:1788872650.938138:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311147520 00000100:00100000:3.0:1788872650.938175:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1141 00000100:00100000:3.0:1788872650.938182:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:66787:x1875765311147520:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872650.938196:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872650.938217:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9f78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae8e expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872650.938278:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01d9f7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872650.938293:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01d9f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872650.938306:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01d9f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872650.938356:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872650.938360:0:68674:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872650.938397:0:68674:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01d9f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872650.938423:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae8e expref: 8 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872650.938444:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01d9f7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae8e expref: 7 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872650.938453:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c8112500) 00010000:00010000:3.0:1788872650.938462:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872650.938466:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2200, rc 0) 00000100:00100000:3.0:1788872650.938513:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:66787:x1875765311147520:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 330us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872650.938520:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1141 00000100:00100000:0.0:1788872650.939365:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327665408:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788872650.939508:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872650.943152:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327665664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872650.943232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872650.943324:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327665536 00000100:00100000:0.0:1788872650.943332:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327665536 00000100:00100000:0.0:1788872650.943378:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:0.0:1788872650.943386:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327665536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872650.943423:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:0.0:1788872650.943477:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327665536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (6049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872650.943484:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000100:00100000:0.0:1788872650.943533:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f09d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327665536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872650.944113:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327665664 00000100:00100000:0.0:1788872650.944119:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327665664 00000100:00100000:0.0:1788872650.944160:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:0.0:1788872650.944169:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327665664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872650.944190:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872650.944242:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327665664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872650.944248:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:0.0:1788872650.944287:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327665664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872650.950329:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872650.950440:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311147648 00000100:00100000:2.0:1788872650.950452:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311147648 00000100:00100000:2.0:1788872650.950653:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1142 00000100:00100000:2.0:1788872650.950665:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:66787:x1875765311147648:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:2.0:1788872650.950722:0:66979:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:2.0:1788872650.950810:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:66787:x1875765311147648:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 146us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872650.950819:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1142 00000100:00100000:3.0:1788872650.960262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872650.960378:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311147776 00000100:00100000:2.0:1788872650.960388:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311147776 00000100:00100000:2.0:1788872650.960476:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1143 00000100:00100000:2.0:1788872650.960488:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:66787:x1875765311147776:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:2.0:1788872650.960542:0:66190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00080000:0.0:1788872650.960928:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872650.961414:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:66787:x1875765311147776:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 925us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872650.961423:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1143 00000100:00100000:3.0:1788872650.965119:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872650.966088:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311147904 00000100:00100000:2.0:1788872650.966109:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311147904 00000100:00100000:2.0:1788872650.966179:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5948 00000100:00100000:2.0:1788872650.966188:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1875765311147904:12345-192.168.204.39@tcp:8:lfs.0 00010000:00080000:2.0:1788872650.966231:0:9961:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp t0 exp 0000000000000000 cur 3588 last 0 00000020:00000080:2.0:1788872650.966267:0:9961:0:(genops.c:1406:class_connect()) connect: client 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3, cookie 0xe4e6e89fb01d9f86 00002000:00100000:2.0:1788872650.966281:0:9961:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3/ffff98a8c1f59800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788872650.966294:0:9961:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788872650.966390:0:9961:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788872650.966423:0:9961:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872650.966514:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311147904:12345-192.168.204.39@tcp:8:lfs.0 Request processed in 325us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872650.966522:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5948 00000100:00100000:1.0:1788872650.972470:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872650.972628:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311148032 00000100:00100000:3.0:1788872650.972640:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311148032 00000100:00100000:3.0:1788872650.972727:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2009 00000100:00100000:3.0:1788872650.972740:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:66787:x1875765311148032:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872650.972769:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872650.972840:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:66787:x1875765311148032:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 103us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872650.972848:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2009 00000100:00080000:2.0:1788872650.973598:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788872650.979014:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00080000:2.0:1788872650.979032:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969450 is committed 00000100:00100000:1.0:1788872650.987229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872650.988601:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311148160 00000100:00100000:2.0:1788872650.988619:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311148160 00000100:00100000:2.0:1788872650.988682:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5949 00000100:00100000:2.0:1788872650.988696:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2403:x1875765311148160:12345-192.168.204.39@tcp:8:lfs.0 00010000:00080000:2.0:1788872650.989088:0:26193:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp t0 exp 0000000000000000 cur 3588 last 0 00000020:00000080:2.0:1788872650.989145:0:26193:0:(genops.c:1406:class_connect()) connect: client 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3, cookie 0xe4e6e89fb01d9f8d 00002000:00100000:2.0:1788872650.989160:0:26193:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3/ffff98a8c1f5e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788872650.989174:0:26193:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788872650.989292:0:26193:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788872650.989412:0:26193:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872650.989503:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311148160:12345-192.168.204.39@tcp:8:lfs.0 Request processed in 810us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872650.989792:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5949 00000001:00100000:0.0:1788872650.999062:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00080000:0.0:1788872650.999080:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969450 is committed 00000100:00100000:3.0:1788872651.000595:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872651.000781:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311148288 00000100:00100000:0.0:1788872651.000791:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311148288 00000100:00100000:0.0:1788872651.000929:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2010 00000100:00100000:0.0:1788872651.000941:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:66787:x1875765311148288:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:0.0:1788872651.000969:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872651.001061:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:66787:x1875765311148288:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 122us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872651.001068:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2010 00010000:00010000:2.0:1788872651.001196:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788872651.004686:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872651.023881:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872651.024000:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311148416 00000100:00100000:0.0:1788872651.024012:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311148416 00000100:00100000:0.0:1788872651.024083:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 76 00000100:00100000:0.0:1788872651.024094:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311148416:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872651.024181:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311148416:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 88us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872651.024189:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 76 00010000:00010000:1.0:1788872652.034517:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872653.048733:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872654.072703:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872654.526530:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327665792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872654.526632:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872654.526748:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327665792 00000100:00100000:3.0:1788872654.526757:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327665792 00000100:00100000:3.0:1788872654.526829:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:3.0:1788872654.526838:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327665792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872654.526866:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872654.526911:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327665792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872654.526918:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00080000:3.0:1788872654.526946:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872654.526983:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327665792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872654.527173:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872654.527183:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327665920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872654.527232:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872654.527270:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327665920 00000100:00100000:0.0:1788872654.527274:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327665920 00000100:00100000:0.0:1788872654.527307:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:0.0:1788872654.527326:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327665920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872654.527344:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872654.527380:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327665920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872654.527386:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00080000:0.0:1788872654.527406:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872654.527617:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327665920:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788872655.097337:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872655.545113:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327666176:0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.545197:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872655.545233:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327666688:0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.545259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872655.545279:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327667200:0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.545312:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872655.545338:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788872655.545344:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327666304:0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.545368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872655.545386:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327666816:0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.545409:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872655.545424:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327667328:0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.545448:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872655.545533:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327666176 00000100:00100000:3.0:1788872655.545541:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327666176 00000100:00100000:3.0:1788872655.545620:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327666304 00000100:00100000:3.0:1788872655.545633:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327666304 00000100:00100000:3.0:1788872655.545657:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1788872655.545674:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327666176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.545735:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327666176:12345-0@lo:400:kworker.0 Request processed in 69us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872655.545743:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1788872655.545761:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1788872655.545768:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327666304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.545811:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327666304:12345-0@lo:400:kworker.0 Request processed in 44us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872655.545818:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1788872655.545839:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327666688 00000100:00100000:3.0:1788872655.545842:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327666688 00000100:00100000:3.0:1788872655.545866:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327667200 00000100:00100000:3.0:1788872655.545868:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327667200 00000100:00100000:3.0:1788872655.545884:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:3.0:1788872655.545890:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327666688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.545921:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327666688:12345-0@lo:400:kworker.0 Request processed in 32us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872655.545927:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000100:00100000:3.0:1788872655.545938:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1788872655.545945:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327667200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.545975:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327667200:12345-0@lo:400:kworker.0 Request processed in 31us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872655.545981:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1788872655.546020:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327666304:0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.546031:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327666176:0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.546039:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327666688:0@lo:400:kworker.0 00000100:00100000:3.0:1788872655.546047:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327667200:0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.546423:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327666432:0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.546457:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872655.546485:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327666944:0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.546508:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872655.546531:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327667456:0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.546576:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872655.546595:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788872655.546603:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327666048:0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.546643:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872655.546673:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327666560:0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.546694:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872655.546708:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327667072:0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.546728:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872655.546745:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327667584:0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.546781:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872655.546809:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327666432 00000100:00100000:2.0:1788872655.546814:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327666432 00000100:00100000:2.0:1788872655.546839:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327666560 00000100:00100000:2.0:1788872655.546842:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327666560 00000100:00100000:2.0:1788872655.546855:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327667072 00000100:00100000:2.0:1788872655.546857:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327667072 00000100:00100000:2.0:1788872655.546867:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327667584 00000100:00100000:2.0:1788872655.546869:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327667584 00000100:00100000:2.0:1788872655.546882:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1788872655.546888:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327666432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.546930:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327666432:12345-0@lo:400:kworker.0 Request processed in 42us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872655.546936:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1788872655.546951:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1788872655.546957:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327666560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.546981:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327666560:12345-0@lo:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872655.546986:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1788872655.546996:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1788872655.547000:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327667072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.547023:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327667072:12345-0@lo:400:kworker.0 Request processed in 23us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872655.547028:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1788872655.547038:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1788872655.547043:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327667584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.547067:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327667584:12345-0@lo:400:kworker.0 Request processed in 24us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872655.547080:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1788872655.547108:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327666048 00000100:00100000:2.0:1788872655.547111:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327666048 00000100:00100000:2.0:1788872655.547135:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788872655.547141:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327666048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.547169:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327666048:12345-0@lo:400:kworker.0 Request processed in 28us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872655.547175:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788872655.547220:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327666048:0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.547231:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327666560:0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.547238:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327667072:0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.547245:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327667584:0@lo:400:kworker.0 00000100:00100000:2.0:1788872655.547254:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327666432:0@lo:400:kworker.0 00000100:00100000:1.0:1788872655.547461:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327666816 00000100:00100000:1.0:1788872655.547466:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327666816 00000100:00100000:1.0:1788872655.547489:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327667328 00000100:00100000:1.0:1788872655.547493:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327667328 00000100:00100000:1.0:1788872655.547509:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327666944 00000100:00100000:1.0:1788872655.547512:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327666944 00000100:00100000:1.0:1788872655.547526:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327667456 00000100:00100000:1.0:1788872655.547528:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327667456 00000100:00100000:1.0:1788872655.547545:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489 00000100:00100000:1.0:1788872655.547582:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327666816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872655.547634:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327666816:12345-0@lo:400:kworker.0 Request processed in 42us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872655.547651:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489 00000100:00100000:1.0:1788872655.547666:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:1.0:1788872655.547671:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327667328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872655.547702:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327667328:12345-0@lo:400:kworker.0 Request processed in 30us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872655.547707:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:1.0:1788872655.547720:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:1.0:1788872655.547725:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327666944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872655.547757:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327666944:12345-0@lo:400:kworker.0 Request processed in 32us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872655.547763:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:1.0:1788872655.547776:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492 00000100:00100000:1.0:1788872655.547781:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327667456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872655.547806:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327667456:12345-0@lo:400:kworker.0 Request processed in 26us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872655.547811:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492 00000100:00100000:1.0:1788872655.547834:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872655.547845:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327667712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872655.547875:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872655.547912:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327666944:0@lo:400:kworker.0 00000100:00100000:1.0:1788872655.547922:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 2 00000100:00100000:1.0:1788872655.547933:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327667456:0@lo:400:kworker.0 00000100:00100000:1.0:1788872655.547955:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327666816:0@lo:400:kworker.0 00000100:00100000:1.0:1788872655.547976:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 2 00000100:00100000:1.0:1788872655.547986:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327667328:0@lo:400:kworker.0 00000100:00080000:0.0:1788872655.548076:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872655.548080:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872655.548083:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872655.548091:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872655.548107:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327667712 00000100:00100000:0.0:1788872655.548111:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327667712 00000100:00100000:0.0:1788872655.548156:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:0.0:1788872655.548163:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327667712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788872655.548190:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:0.0:1788872655.548238:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327667712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872655.548244:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00100000:0.0:1788872655.548287:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327667712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872656.063120:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327667840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872656.063255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872656.063383:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327667840 00000100:00100000:2.0:1788872656.063393:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327667840 00000100:00100000:2.0:1788872656.063452:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:2.0:1788872656.063462:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327667840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872656.063493:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872656.063544:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327667840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872656.063576:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:2.0:1788872656.063643:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327667840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872656.063727:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872656.063748:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327667968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872656.063779:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872656.063809:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327667968 00000100:00100000:2.0:1788872656.063814:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327667968 00000100:00100000:2.0:1788872656.063841:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:2.0:1788872656.063848:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327667968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872656.063887:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:2.0:1788872656.063923:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327667968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872656.063929:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00100000:2.0:1788872656.063958:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327667968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872656.064349:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872656.064360:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327668096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872656.064418:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872656.064533:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327668096 00000100:00100000:0.0:1788872656.064538:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327668096 00000100:00100000:0.0:1788872656.064628:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:0.0:1788872656.064636:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327668096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872656.064655:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872656.064709:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327668096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872656.064715:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000100:00100000:1.0:1788872656.064848:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327668096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788872656.122269:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872656.152377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872656.152426:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872656.152469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872656.152529:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311148544 00000100:00100000:3.0:1788872656.152540:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311148544 00000100:00100000:0.0:1788872656.152637:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311148800 00000100:00100000:0.0:1788872656.152644:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311148800 00000100:00100000:3.0:1788872656.152649:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 78 00000100:00100000:3.0:1788872656.152664:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311148544:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872656.152707:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1148 00000100:00100000:0.0:1788872656.152718:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311148800:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872656.152752:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311148544:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 92us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872656.152762:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311148800:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 44us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872656.152767:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 78 00000100:00100000:0.0:1788872656.152797:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1148 00000100:00080000:0.0:1788872656.152826:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872656.153031:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872656.153063:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872656.153451:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311148672 00000100:00100000:3.0:1788872656.153457:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311148672 00000100:00100000:3.0:1788872656.153510:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1149 00000100:00100000:3.0:1788872656.153519:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311148672:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872656.153578:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311148672:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 61us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872656.153585:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1149 00000100:00080000:0.0:1788872656.154401:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788872656.158516:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311149056 00000100:00100000:1.0:1788872656.158531:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311149056 00000100:00100000:1.0:1788872656.158634:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311148928 00000100:00100000:1.0:1788872656.158637:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311148928 00000100:00100000:1.0:1788872656.158692:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2493 00000100:00100000:1.0:1788872656.158704:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311149056:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872656.158803:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311149056:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 100us (6332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872656.158811:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2493 00000100:00100000:1.0:1788872656.158829:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2494 00000100:00100000:1.0:1788872656.158835:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311148928:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872656.158860:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311148928:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 26us (5797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872656.158866:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2494 00000100:00080000:0.0:1788872656.159261:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872656.159267:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788872657.144896:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788872657.303267:0:87644:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:1.0:1788872658.170477:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788872659.179743:0:87692:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1788872659.193965:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872659.640805:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788872659.640872:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327668224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872659.640980:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872659.641024:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327668352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872659.641060:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872659.641196:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327668224 00000100:00100000:0.0:1788872659.641203:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327668224 00000100:00100000:0.0:1788872659.641306:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327668352 00000100:00100000:0.0:1788872659.641310:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327668352 00000100:00100000:0.0:1788872659.641345:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:0.0:1788872659.641355:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327668224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872659.641384:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872659.641402:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:3.0:1788872659.641417:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327668352:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872659.641440:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327668224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872659.641446:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00002000:00000024:3.0:1788872659.641448:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788872659.641519:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872659.641523:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872659.641684:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327668224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872659.648797:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327668352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7377us (7725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872659.648803:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327668352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872659.648814:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00010000:00010000:1.0:1788872660.217115:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872660.665086:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872660.665111:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327668480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872660.665235:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872660.665384:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327668480 00000100:00100000:3.0:1788872660.665393:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327668480 00000100:00100000:3.0:1788872660.665455:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1788872660.665464:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327668480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788872660.665510:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:3.0:1788872660.665588:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327668480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872660.665596:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1788872660.665646:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327668480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872660.666278:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327668992:0@lo:400:kworker.0 00000100:00100000:0.0:1788872660.666320:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872660.666358:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327669504:0@lo:400:kworker.0 00000100:00100000:0.0:1788872660.666383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872660.666403:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327670016:0@lo:400:kworker.0 00000100:00100000:0.0:1788872660.666423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872660.666441:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788872660.666455:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327668864:0@lo:400:kworker.0 00000100:00100000:3.0:1788872660.666591:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327668736:0@lo:400:kworker.0 00000100:00100000:3.0:1788872660.666624:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327668992 00000100:00100000:3.0:1788872660.666629:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327668992 00000100:00100000:3.0:1788872660.666695:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327670016 00000100:00100000:3.0:1788872660.666698:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327670016 00000100:00100000:3.0:1788872660.666719:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1788872660.666725:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327668992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872660.666825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872660.666852:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327669376:0@lo:400:kworker.0 00000100:00100000:0.0:1788872660.666875:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872660.666910:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327669888:0@lo:400:kworker.0 00000100:00100000:0.0:1788872660.666930:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872660.666957:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327669504 00000100:00100000:0.0:1788872660.666960:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327669504 00000100:00100000:2.0:1788872660.667072:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327668608:0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.667105:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872660.667132:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327669120:0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.667153:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872660.667168:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327669632:0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.667189:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872660.667213:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327668608 00000100:00100000:2.0:1788872660.667216:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327668608 00000100:00100000:2.0:1788872660.667242:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788872660.667249:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327668608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.667292:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327668608:12345-0@lo:400:kworker.0 Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872660.667299:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788872660.667345:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327668608:0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.667388:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327668864 00000100:00100000:2.0:1788872660.667392:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327668864 00000100:00100000:2.0:1788872660.667411:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327669120 00000100:00100000:2.0:1788872660.667414:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327669120 00000100:00100000:2.0:1788872660.667427:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327669632 00000100:00100000:2.0:1788872660.667428:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327669632 00000100:00100000:2.0:1788872660.667440:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1788872660.667445:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327670016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.667497:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327670016:12345-0@lo:400:kworker.0 Request processed in 50us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872660.667503:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1788872660.667517:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1788872660.667523:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327668864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.667599:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327668864:12345-0@lo:400:kworker.0 Request processed in 76us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872660.667606:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1788872660.667619:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:2.0:1788872660.667625:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327669120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.667657:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327669120:12345-0@lo:400:kworker.0 Request processed in 32us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872660.667663:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:2.0:1788872660.667674:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1788872660.667680:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327669632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.667705:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327669632:12345-0@lo:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872660.667711:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:3.0:1788872660.667863:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327668992:12345-0@lo:400:kworker.0 Request processed in 1137us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872660.667869:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1788872660.667896:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327669376 00000100:00100000:3.0:1788872660.667899:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327669376 00000100:00100000:0.0:1788872660.667968:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327669888 00000100:00100000:1.0:1788872660.668116:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:1.0:1788872660.668127:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327669504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872660.668165:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327669504:12345-0@lo:400:kworker.0 Request processed in 40us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872660.668172:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00100000:0.0:1788872660.668197:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327669888 00000100:00080000:2.0:1788872660.668229:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872660.668234:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872660.668236:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788872660.668267:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327669120:0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.668279:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327669632:0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.668316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872660.668344:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327669248:0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.668373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872660.668392:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327669760:0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.668412:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872660.668440:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327669248 00000100:00100000:2.0:1788872660.668444:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327669248 00000100:00100000:2.0:1788872660.668480:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:2.0:1788872660.668487:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327669248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872660.668522:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327669248:12345-0@lo:400:kworker.0 Request processed in 36us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872660.668539:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00100000:2.0:1788872660.668575:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327669760 00000100:00100000:2.0:1788872660.668578:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327669760 00000100:00100000:3.0:1788872660.669152:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496 00000100:00100000:3.0:1788872660.669166:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327669376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872660.669211:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327669376:12345-0@lo:400:kworker.0 Request processed in 51us (2334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872660.669218:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496 00000100:00100000:3.0:1788872660.669276:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327669248:0@lo:400:kworker.0 00000100:00100000:3.0:1788872660.669296:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327668736 00000100:00100000:3.0:1788872660.669300:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327668736 00000100:00100000:3.0:1788872660.669330:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1788872660.669337:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327668736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872660.669374:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327668736:12345-0@lo:400:kworker.0 Request processed in 38us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872660.669380:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1788872660.669420:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327668736:0@lo:400:kworker.0 00000100:00080000:3.0:1788872660.669442:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872660.669445:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872660.669471:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327668864:0@lo:400:kworker.0 00000100:00100000:3.0:1788872660.669481:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327669376:0@lo:400:kworker.0 00000100:00100000:3.0:1788872660.669492:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327668992:0@lo:400:kworker.0 00000100:00100000:3.0:1788872660.669503:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327669504:0@lo:400:kworker.0 00000100:00100000:3.0:1788872660.669516:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327670016:0@lo:400:kworker.0 00000100:00100000:0.0:1788872660.671709:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497 00000100:00100000:0.0:1788872660.671865:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327669888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872660.672109:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498 00000100:00100000:1.0:1788872660.672120:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327669760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872660.672170:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327669760:12345-0@lo:400:kworker.0 Request processed in 53us (3756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872660.672178:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498 00000100:00100000:1.0:1788872660.672224:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327669760:0@lo:400:kworker.0 00000100:00100000:0.0:1788872660.672295:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327669888:12345-0@lo:400:kworker.0 Request processed in 573us (5363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872660.672302:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497 00000100:00100000:3.0:1788872660.672356:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327669888:0@lo:400:kworker.0 00000100:00100000:0.0:1788872661.154208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872661.154300:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311149184 00000100:00100000:3.0:1788872661.154319:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311149184 00000100:00100000:3.0:1788872661.154410:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1144 00000100:00100000:3.0:1788872661.154421:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:67256:x1875765311149184:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872661.154473:0:66193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:3.0:1788872661.154588:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:67256:x1875765311149184:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 169us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872661.154595:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1144 00000100:00080000:2.0:1788872661.155182:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788872661.164134:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872661.164351:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311149312 00000100:00100000:0.0:1788872661.164361:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311149312 00000100:00100000:0.0:1788872661.164504:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1145 00000100:00100000:0.0:1788872661.164515:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:67256:x1875765311149312:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:0.0:1788872661.164877:0:66192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:0.0:1788872661.164965:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:67256:x1875765311149312:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 451us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872661.164974:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1145 00000100:00080000:2.0:1788872661.165198:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872661.169543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872661.169729:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311149440 00000100:00100000:0.0:1788872661.169743:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311149440 00000100:00100000:0.0:1788872661.169848:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2017 00000100:00100000:0.0:1788872661.169874:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:67256:x1875765311149440:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:0.0:1788872661.169918:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872661.169986:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:67256:x1875765311149440:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 115us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872661.170004:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2017 00000100:00080000:2.0:1788872661.170687:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872661.177673:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872661.177702:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327670144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872661.177777:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872661.178415:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872661.178427:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327670272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872661.178460:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872661.178602:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327670144 00000100:00100000:1.0:1788872661.178610:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327670144 00000100:00100000:1.0:1788872661.178657:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327670272 00000100:00100000:1.0:1788872661.178660:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327670272 00000100:00100000:1.0:1788872661.178679:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:1.0:1788872661.178687:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327670144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872661.178715:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872661.178764:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327670144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872661.178771:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:1.0:1788872661.178790:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:1.0:1788872661.178796:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327670272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872661.178806:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872661.179631:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327670144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872661.180072:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327670272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1275us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872661.180081:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:3.0:1788872661.180142:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788872661.180156:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327670400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872661.180190:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872661.180231:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327670400 00000100:00100000:3.0:1788872661.180236:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327670400 00000100:00100000:0.0:1788872661.180262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872661.180279:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:3.0:1788872661.180287:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327670400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872661.180308:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:3.0:1788872661.180359:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327670400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872661.180367:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000100:00100000:2.0:1788872661.180398:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327670272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872661.180412:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327670400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872661.180477:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311149568 00000100:00100000:1.0:1788872661.180482:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311149568 00000100:00100000:1.0:1788872661.180535:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2020 00000100:00100000:1.0:1788872661.180542:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:67256:x1875765311149568:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:1.0:1788872661.180578:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788872661.180687:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872661.180766:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:67256:x1875765311149568:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 224us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872661.180774:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2020 00000100:00100000:1.0:1788872661.229635:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872661.229934:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311149696 00000100:00100000:3.0:1788872661.229947:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311149696 00000100:00100000:3.0:1788872661.230028:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1146 00000100:00100000:3.0:1788872661.230039:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:67273:x1875765311149696:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872661.230060:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872661.230081:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9f94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae95 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230194:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9f9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230210:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9f9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230223:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9f9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230237:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230258:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230264:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230368:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01d9fa9 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230375:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01d9fa9 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230382:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01d9fa9 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872661.230418:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788872661.230423:0:66190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872661.230443:0:66190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01d9fa9 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230456:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9f9b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230463:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9f9b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230469:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9f9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230475:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9f9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230489:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872661.230493:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9f9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230500:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9f9b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230511:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c8112500) 00010000:00010000:3.0:1788872661.230514:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872661.230639:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9f9b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230647:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9f9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230664:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230670:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230675:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230679:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872661.230683:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230688:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fa2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230706:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff98a9c2b02b00) 00010000:00010000:3.0:1788872661.230708:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872661.230711:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fa2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230717:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fa2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230749:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9f94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae95 expref: 9 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230763:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01d9fa9 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae95 expref: 8 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.230769:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98a9c2b02400) 00010000:00010000:3.0:1788872661.230772:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872661.230774:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2800, rc 0) 00000100:00100000:3.0:1788872661.230972:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67273:x1875765311149696:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 934us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872661.230981:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1146 00010000:00010000:0.0:1788872661.240807:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872661.251643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872661.251795:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311149952 00000100:00100000:3.0:1788872661.251806:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311149952 00000100:00100000:3.0:1788872661.251876:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1147 00000100:00100000:3.0:1788872661.251888:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67273:x1875765311149952:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872661.251909:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872661.251930:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fb0 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fae9c expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252049:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fb7 lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252064:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fb7 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252074:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fb7 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252089:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fbe lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252096:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fbe lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252103:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fbe lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252178:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fb7 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252185:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fb7 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252190:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fb7 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252196:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fb7 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252202:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872661.252212:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fb7 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252219:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fb7 lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252231:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98a9c2b02400) 00010000:00010000:3.0:1788872661.252234:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872661.252238:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fb7 lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252245:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fb7 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252261:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fbe lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252267:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fbe lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252273:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fbe lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252278:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872661.252281:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fbe lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252286:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fbe lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252294:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff98a9c2b02b00) 00010000:00010000:3.0:1788872661.252391:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872661.252403:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fbe lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252409:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fbe lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252446:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fb0 lrc: 1/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae9c expref: 9 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252455:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98a9c2b02400) 00010000:00010000:3.0:1788872661.252458:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788872661.252461:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fb0 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae9c expref: 9 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.252470:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3600, rc 0) 00000100:00100000:3.0:1788872661.252653:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67273:x1875765311149952:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 767us (1019us total) trans 0 rc 301/301 00000100:00100000:3.0:1788872661.252660:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1147 00000100:00100000:0.0:1788872661.259599:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872661.261203:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311150208 00000100:00100000:1.0:1788872661.261218:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311150208 00000100:00100000:1.0:1788872661.261303:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1148 00000100:00100000:1.0:1788872661.261314:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67273:x1875765311150208:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:1.0:1788872661.261337:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872661.261360:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01d9fc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faea3 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872661.261467:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788872661.261645:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01d9fc5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faea3 expref: 10 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872661.261661:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c8112500) 00010000:00010000:1.0:1788872661.261664:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788872661.261669:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01d9fc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faea3 expref: 10 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872661.261696:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af000, rc 0) 00000100:00100000:1.0:1788872661.261769:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:67273:x1875765311150208:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 456us (2180us total) trans 107374182401 rc 301/301 00000100:00100000:1.0:1788872661.261777:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1148 00000100:00100000:1.0:1788872661.266840:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872661.267001:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311150336 00000100:00100000:3.0:1788872661.267017:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311150336 00000100:00100000:3.0:1788872661.267089:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 80 00000100:00100000:3.0:1788872661.267101:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311150336:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872661.267199:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311150336:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 99us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872661.267206:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 80 00000100:00100000:2.0:1788872661.281719:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872661.281933:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311150464 00000100:00100000:3.0:1788872661.281943:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311150464 00000100:00100000:3.0:1788872661.282028:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1149 00000100:00100000:3.0:1788872661.282040:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:67273:x1875765311150464:12345-192.168.204.39@tcp:34:lfs.0 00010000:00010000:3.0:1788872661.282398:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fd3 lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282417:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fd3 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282429:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fd3 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282448:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fda lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282456:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fda lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282462:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fda lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282770:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fe1 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282779:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fe1 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282787:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fe1 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872661.282830:0:66190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872661.282843:0:66190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fe1 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282858:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fd3 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282873:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fd3 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282878:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fd3 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282886:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fd3 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282892:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872661.282896:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fd3 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282905:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fd3 lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282917:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff98a9c2b02400) 00010000:00010000:3.0:1788872661.282920:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872661.282925:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fd3 lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282931:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01d9fd3 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282946:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fda lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282951:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fda lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282956:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fda lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282967:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872661.282970:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fda lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282976:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fda lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282983:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff98a9c2b02b00) 00010000:00010000:3.0:1788872661.282986:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872661.282989:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fda lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.282994:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01d9fda lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.283965:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fe1 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.283977:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fe1 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.283983:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fe1 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.283988:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872661.284480:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fe1 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.284490:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fe1 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.284536:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff98a9c2b02500) 00010000:00010000:3.0:1788872661.284539:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872661.284542:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fe1 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872661.284581:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01d9fe1 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872661.284683:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:67273:x1875765311150464:12345-192.168.204.39@tcp:34:lfs.0 Request processed in 2641us (2968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872661.284693:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1149 00000100:00100000:1.0:1788872661.288883:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872661.288966:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311150720 00000100:00100000:3.0:1788872661.288979:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311150720 00000100:00100000:3.0:1788872661.289059:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 220 00000100:00100000:3.0:1788872661.289072:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:67273:x1875765311150720:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:3.0:1788872661.289341:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:67273:x1875765311150720:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 271us (466us total) trans 107374182402 rc 0/0 00000100:00100000:3.0:1788872661.289349:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 220 00010000:00010000:1.0:1788872662.270015:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872663.289058:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872664.312699:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872664.763586:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872664.763609:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327670528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872664.763712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872664.763761:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327670528 00000100:00100000:1.0:1788872664.763768:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327670528 00000100:00100000:1.0:1788872664.763833:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:1.0:1788872664.763842:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327670528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872664.763873:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872664.763914:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327670528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872664.763921:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00100000:1.0:1788872664.763965:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327670528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872664.766504:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327670656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872664.766589:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872664.766645:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327670656 00000100:00100000:3.0:1788872664.766652:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327670656 00000100:00100000:3.0:1788872664.766705:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1788872664.766720:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327670656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872664.766747:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872664.766802:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327670656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872664.766822:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1788872664.766868:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327670656:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788872664.766990:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872664.766996:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788872665.336907:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872665.785495:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327670784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872665.785585:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872665.786193:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327671040:0@lo:400:kworker.0 00000100:00100000:0.0:1788872665.786228:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872665.786255:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327671552:0@lo:400:kworker.0 00000100:00100000:0.0:1788872665.786276:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872665.786294:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327672064:0@lo:400:kworker.0 00000100:00100000:0.0:1788872665.786318:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872665.786400:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788872665.786406:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327670912:0@lo:400:kworker.0 00000100:00100000:0.0:1788872665.786445:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872665.786473:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327671424:0@lo:400:kworker.0 00000100:00100000:0.0:1788872665.786495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872665.786512:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327671936:0@lo:400:kworker.0 00000100:00100000:0.0:1788872665.786533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872665.786610:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327670784 00000100:00100000:0.0:1788872665.786618:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327670784 00000100:00100000:0.0:1788872665.786659:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327671552 00000100:00100000:0.0:1788872665.786676:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327671552 00000100:00100000:0.0:1788872665.786701:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:0.0:1788872665.786710:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327670784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788872665.786742:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:0.0:1788872665.786785:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327670784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872665.786927:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000100:00100000:0.0:1788872665.786944:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:0.0:1788872665.786950:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327671552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872665.787048:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327671552:12345-0@lo:400:kworker.0 Request processed in 97us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872665.787055:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:0.0:1788872665.787075:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327670912 00000100:00100000:0.0:1788872665.787079:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327670912 00000100:00100000:0.0:1788872665.787102:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788872665.787109:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327670912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872665.787138:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327670912:12345-0@lo:400:kworker.0 Request processed in 30us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872665.787143:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788872665.787169:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327671040 00000100:00100000:0.0:1788872665.787172:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327671040 00000100:00100000:0.0:1788872665.787202:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327671424 00000100:00100000:0.0:1788872665.787205:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327671424 00000100:00100000:0.0:1788872665.787218:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327671936 00000100:00100000:0.0:1788872665.787220:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327671936 00000100:00100000:0.0:1788872665.787235:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1788872665.787240:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327671040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872665.787281:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327671040:12345-0@lo:400:kworker.0 Request processed in 41us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872665.787288:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1788872665.787299:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1788872665.787305:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327671424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.787452:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327672064 00000100:00100000:1.0:1788872665.787457:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327672064 00000100:00100000:1.0:1788872665.787489:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499 00000100:00100000:1.0:1788872665.787496:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327672064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.787530:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327672064:12345-0@lo:400:kworker.0 Request processed in 35us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872665.787542:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499 00000100:00100000:1.0:1788872665.787579:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1788872665.787586:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327671936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.787617:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327671936:12345-0@lo:400:kworker.0 Request processed in 32us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872665.787623:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1788872665.787676:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327671296:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.787700:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872665.787717:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327671808:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.787735:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872665.787749:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327672320:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.787769:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872665.787813:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327670784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872665.787831:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788872665.787837:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327671168:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.787859:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872665.787868:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327671680:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.787883:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872665.787897:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327672192:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.787915:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872665.787938:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327671808 00000100:00100000:1.0:1788872665.787941:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327671808 00000100:00100000:1.0:1788872665.787961:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327671680 00000100:00100000:1.0:1788872665.787963:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327671680 00000100:00100000:1.0:1788872665.788000:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327672192 00000100:00100000:1.0:1788872665.788003:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327672192 00000100:00100000:1.0:1788872665.788022:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500 00000100:00100000:1.0:1788872665.788027:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327671808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788057:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327671808:12345-0@lo:400:kworker.0 Request processed in 30us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872665.788062:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500 00000100:00100000:1.0:1788872665.788071:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501 00000100:00100000:1.0:1788872665.788076:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327671680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788095:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327671680:12345-0@lo:400:kworker.0 Request processed in 19us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872665.788100:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501 00000100:00100000:1.0:1788872665.788108:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502 00000100:00100000:1.0:1788872665.788112:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327672192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788131:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327672192:12345-0@lo:400:kworker.0 Request processed in 19us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872665.788137:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502 00000100:00100000:1.0:1788872665.788149:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327671296 00000100:00100000:1.0:1788872665.788152:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327671296 00000100:00100000:1.0:1788872665.788171:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327672320 00000100:00100000:1.0:1788872665.788173:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327672320 00000100:00100000:1.0:1788872665.788180:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327671168 00000100:00100000:1.0:1788872665.788182:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327671168 00000100:00100000:1.0:1788872665.788192:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:1.0:1788872665.788197:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327671296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788219:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327671296:12345-0@lo:400:kworker.0 Request processed in 22us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872665.788234:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:1.0:1788872665.788246:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1788872665.788251:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c56ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327672320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788276:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c56ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327672320:12345-0@lo:400:kworker.0 Request processed in 25us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872665.788282:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1788872665.788292:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1788872665.788297:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c56fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327671168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788321:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c56fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327671168:12345-0@lo:400:kworker.0 Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872665.788326:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1788872665.788362:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327671168:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788372:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327671680:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788380:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327672192:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788388:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327671296:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788397:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327671808:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788405:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327672320:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788470:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327670912:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788480:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327671424:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788490:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327671936:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788500:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327671040:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788519:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327671552:0@lo:400:kworker.0 00000100:00100000:1.0:1788872665.788528:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327672064:0@lo:400:kworker.0 00000100:00080000:2.0:1788872665.789276:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872665.789282:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872665.789285:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872665.789287:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872665.789845:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327671424:12345-0@lo:400:kworker.0 Request processed in 25us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872665.789860:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:2.0:1788872666.296970:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872666.296994:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327672704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872666.297070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872666.297117:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327672704 00000100:00100000:2.0:1788872666.297135:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327672704 00000100:00100000:2.0:1788872666.297184:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:2.0:1788872666.297192:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327672704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872666.298069:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:2.0:1788872666.298132:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327672704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 939us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872666.298140:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00100000:3.0:1788872666.298251:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327672704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872666.298480:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327672576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872666.298521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872666.298574:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872666.298581:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327672448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872666.298605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872666.298722:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327672576 00000100:00100000:3.0:1788872666.298729:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327672576 00000100:00100000:3.0:1788872666.298777:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327672448 00000100:00100000:3.0:1788872666.298780:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327672448 00000100:00100000:3.0:1788872666.298802:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1788872666.298810:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327672576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872666.298830:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872666.298868:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327672576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872666.298874:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1788872666.298886:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:3.0:1788872666.298893:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327672448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788872666.298975:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872666.299004:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327672448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872666.299010:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:3.0:1788872666.299044:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327672448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872666.299057:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327672576:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788872666.370130:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872666.421665:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872666.421713:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872666.421743:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872666.421764:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872666.421789:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872666.426360:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311150848 00000100:00100000:3.0:1788872666.426376:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311150848 00000100:00100000:3.0:1788872666.426476:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 82 00000100:00100000:3.0:1788872666.426487:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2406:x1875765311150848:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872666.426577:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2406:x1875765311150848:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 93us (4924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872666.426585:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 82 00000100:00100000:1.0:1788872666.434344:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311151104 00000100:00100000:1.0:1788872666.434360:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311151104 00000100:00100000:1.0:1788872666.434442:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311150976 00000100:00100000:1.0:1788872666.434446:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311150976 00000100:00100000:1.0:1788872666.434485:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1162 00000100:00100000:1.0:1788872666.434496:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311151104:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872666.434587:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311151104:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 92us (12873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872666.434595:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1162 00000100:00100000:1.0:1788872666.434613:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1163 00000100:00100000:1.0:1788872666.434621:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2406:x1875765311150976:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872666.434653:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2406:x1875765311150976:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 34us (12888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872666.434659:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1163 00000100:00100000:1.0:1788872666.434678:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311151360 00000100:00100000:1.0:1788872666.434681:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311151360 00000100:00100000:1.0:1788872666.434708:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311151232 00000100:00100000:1.0:1788872666.434711:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311151232 00000100:00100000:1.0:1788872666.434749:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2503 00000100:00100000:1.0:1788872666.434755:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311151360:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872666.434784:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311151360:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (13040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872666.434792:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2503 00000100:00100000:1.0:1788872666.434803:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2504 00000100:00100000:1.0:1788872666.434808:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311151232:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872666.434828:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311151232:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 20us (13038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872666.434834:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2504 00000100:00080000:1.0:1788872666.434989:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872666.435010:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872666.435013:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872666.435015:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:3.0:1788872666.810430:0:87060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182402 is committed 00010000:00010000:3.0:1788872667.384938:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872667.918263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872667.918353:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872667.918404:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872667.918457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872667.918524:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311151744 00000100:00100000:0.0:1788872667.918535:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311151744 00000100:00100000:0.0:1788872667.918617:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311151616 00000100:00100000:0.0:1788872667.918620:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311151616 00000100:00100000:0.0:1788872667.918643:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5950 00000100:00100000:0.0:1788872667.918653:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311151744:12345-192.168.204.39@tcp:17:kworker.0 00000100:00100000:0.0:1788872667.918745:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311151744:12345-192.168.204.39@tcp:17:kworker.0 Request processed in 94us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872667.918754:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5950 00000100:00100000:0.0:1788872667.918772:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5951 00000100:00100000:0.0:1788872667.918779:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311151616:12345-192.168.204.39@tcp:17:kworker.0 00000100:00100000:0.0:1788872667.918862:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311151616:12345-192.168.204.39@tcp:17:kworker.0 Request processed in 83us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872667.918882:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5951 00000100:00100000:3.0:1788872667.920380:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311151488 00000100:00100000:3.0:1788872667.920399:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311151488 00000100:00100000:3.0:1788872667.920617:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311151872 00000100:00100000:3.0:1788872667.920621:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311151872 00000100:00100000:0.0:1788872667.920689:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1150 00000100:00100000:0.0:1788872667.920699:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311151488:12345-192.168.204.39@tcp:17:kworker.0 00000100:00100000:0.0:1788872667.920773:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311151488:12345-192.168.204.39@tcp:17:kworker.0 Request processed in 76us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872667.920779:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1150 00000100:00100000:0.0:1788872667.920796:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1151 00000100:00100000:0.0:1788872667.920802:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2407:x1875765311151872:12345-192.168.204.39@tcp:17:kworker.0 00000100:00100000:0.0:1788872667.920833:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2407:x1875765311151872:12345-192.168.204.39@tcp:17:kworker.0 Request processed in 31us (2375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872667.920839:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1151 00010000:00010000:1.0:1788872668.409098:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872669.432717:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788872669.666819:0:87887:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 09:04:27 (1788872667) 00000100:00100000:1.0:1788872669.877026:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872669.877102:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311152000 00000100:00100000:2.0:1788872669.877113:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311152000 00000100:00100000:2.0:1788872669.877190:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1152 00000100:00100000:2.0:1788872669.877199:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67854:x1875765311152000:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788872669.877220:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872669.877242:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8e00/0xe4e6e89fb01d9fe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faeaa expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877303:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01d9fef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877317:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01d9fef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877330:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01d9fef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877373:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9ff6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877381:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877388:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877432:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01d9fef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877439:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01d9fef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877444:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01d9fef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877451:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01d9fef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877458:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872669.877462:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01d9fef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877470:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01d9fef lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877482:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c8112500) 00010000:00010000:2.0:1788872669.877485:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872669.877489:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01d9fef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877503:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01d9fef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877514:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877520:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9ff6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877526:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877531:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872669.877534:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877540:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9ff6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877570:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff98a9c329d200) 00010000:00010000:2.0:1788872669.877573:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872669.877576:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9ff6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877583:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01d9ff6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877613:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8e00/0xe4e6e89fb01d9fe8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeaa expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877635:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c8112500) 00010000:00010000:2.0:1788872669.877637:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872669.877641:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8e00/0xe4e6e89fb01d9fe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeaa expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872669.877651:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8e00, rc 0) 00000100:00100000:2.0:1788872669.877706:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67854:x1875765311152000:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 508us (690us total) trans 0 rc 301/301 00000100:00100000:2.0:1788872669.877714:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1152 00000100:00080000:1.0:1788872669.878222:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788872669.881247:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872669.881270:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327672832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872669.881330:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872669.881419:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327672832 00000100:00100000:0.0:1788872669.881428:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327672832 00000100:00100000:0.0:1788872669.881485:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:0.0:1788872669.881494:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327672832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872669.881520:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872669.881598:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327672832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872669.881605:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00100000:0.0:1788872669.881646:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327672832:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788872669.881700:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872669.882039:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872669.882048:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327672960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872669.882086:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872669.882113:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327672960 00000100:00100000:0.0:1788872669.882117:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327672960 00000100:00100000:0.0:1788872669.882154:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:0.0:1788872669.882160:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327672960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872669.882177:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872669.882214:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327672960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872669.882220:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00080000:0.0:1788872669.882234:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872669.882255:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327672960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872669.892241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872669.892340:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311152256 00000100:00100000:1.0:1788872669.892351:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311152256 00000100:00100000:1.0:1788872669.892422:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1153 00000100:00100000:1.0:1788872669.892432:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67854:x1875765311152256:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:1.0:1788872669.892454:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872669.892457:0:68674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788872669.892498:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01d9f7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae8e expref: 8 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.892516:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c8112500) 00010000:00010000:1.0:1788872669.892528:0:68674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872669.892544:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01d9ffd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faeb1 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.892674:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01da004 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.892687:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01da004 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.892696:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01da004 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.892709:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01da00b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.892717:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01da00b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.892723:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01da00b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893116:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01da012 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893125:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01da012 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893142:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01da012 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872669.893152:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:1.0:1788872669.893177:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01da004 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893184:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01da004 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893190:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01da004 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893196:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01da004 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893203:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872669.893207:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01da004 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893215:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01da004 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893224:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:1.0:1788872669.893227:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872669.893230:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01da004 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893238:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01da004 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872669.893248:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003737aeec reply state 000000009060606a transno 107374182403 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01da00b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893266:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01da00b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893272:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff98a9e7bf4a00) 00010000:00010000:1.0:1788872669.893275:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872669.893277:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788872669.893302:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01d9ffd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeb1 expref: 10 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893320:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01da012 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeb1 expref: 9 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872669.893327:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9e7bf4600) 00010000:00010000:1.0:1788872669.893329:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872669.893331:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af200, rc 0) 00000100:00100000:1.0:1788872669.893401:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:67854:x1875765311152256:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 970us (1171us total) trans 107374182403 rc 0/0 00000100:00100000:1.0:1788872669.893409:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1153 00000100:00100000:2.0:1788872669.900897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872669.900989:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311152512 00000100:00100000:3.0:1788872669.901007:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311152512 00000100:00100000:3.0:1788872669.901074:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1154 00000100:00100000:3.0:1788872669.901086:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:67854:x1875765311152512:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872669.901110:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872669.901133:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faeb8 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.901250:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.901266:0:66192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01da012 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeb1 expref: 11 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.901275:0:66192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.901319:0:66192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01da012 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeb1 expref: 11 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.901333:0:66192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01da012 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeb1 expref: 11 pid: 68674 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872669.901347:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66192:1875765327673088:192.168.204.39@tcp:104: 00000100:00100000:3.0:1788872669.901440:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9eedbc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872669.909100:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872669.909140:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311152640 00000100:00100000:0.0:1788872669.909149:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311152640 00010000:00010000:0.0:1788872669.909190:0:26197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01da012 lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeb1 expref: 12 pid: 68674 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872669.909227:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2554 00000100:00100000:0.0:1788872669.909237:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2405:x1875765311152640:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788872669.909254:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872669.909261:0:26197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01da012 lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeb1 expref: 12 pid: 68674 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872669.909276:0:26197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01da012 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeb1 expref: 12 pid: 68674 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872669.909302:0:26197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9e7bf4600) 00010000:00010000:0.0:1788872669.909316:0:26197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872669.909326:0:26197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872669.909334:0:26197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872669.909364:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872669.909415:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2405:x1875765311152640:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 180us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872669.909422:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2554 00010000:00010000:3.0:1788872669.909794:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01da012 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeb1 expref: 11 pid: 68674 timeout: 3707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872669.909810:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66192:1875765327673088:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788872669.909836:0:66192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.909845:0:66192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.909850:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872669.909871:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:3.0:1788872669.910094:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.910103:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.910120:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.910125:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872669.910129:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.910137:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.910147:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9e7bf4600) 00010000:00010000:3.0:1788872669.910149:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788872669.910153:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.910159:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da027 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.910208:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da020 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeb8 expref: 11 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.910218:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c2b02000) 00010000:00010000:3.0:1788872669.910220:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788872669.910223:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faeb8 expref: 11 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872669.910236:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3e00, rc 0) 00000100:00100000:3.0:1788872669.910274:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:67854:x1875765311152512:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 9192us (9386us total) trans 107374182404 rc 301/301 00000100:00100000:3.0:1788872669.910290:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1154 00000100:00100000:0.0:1788872669.914793:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872669.914876:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311152896 00000100:00100000:3.0:1788872669.914885:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311152896 00000100:00100000:3.0:1788872669.914948:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 221 00000100:00100000:3.0:1788872669.914959:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:67854:x1875765311152896:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:3.0:1788872669.915194:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:67854:x1875765311152896:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 237us (410us total) trans 107374182405 rc 0/0 00000100:00100000:3.0:1788872669.915203:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 221 00000100:00100000:2.0:1788872669.922195:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872669.922303:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311153152 00000100:00100000:3.0:1788872669.922314:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311153152 00000100:00100000:3.0:1788872669.922381:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 222 00000100:00100000:3.0:1788872669.922392:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0953c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:67854:x1875765311153152:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:3.0:1788872669.922638:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0953c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:67854:x1875765311153152:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 247us (450us total) trans 107374182406 rc 0/0 00000100:00100000:3.0:1788872669.922647:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 222 00010000:00010000:2.0:1788872670.457357:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872670.909713:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327673216:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.909783:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872670.909847:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327673728:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.909874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872670.909905:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327674240:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.909925:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872670.909953:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327674752:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.909990:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872670.910027:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788872670.910033:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327673600:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.910053:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872670.910073:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327674112:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.910094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872670.910130:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327673728 00000100:00100000:2.0:1788872670.910139:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327673728 00000100:00100000:0.0:1788872670.910139:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327674624:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.910167:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872670.910203:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327673344:0@lo:400:kworker.0 00000100:00100000:2.0:1788872670.910219:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327674240 00000100:00100000:2.0:1788872670.910224:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327674240 00000100:00100000:0.0:1788872670.910232:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872670.910254:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327674752 00000100:00100000:2.0:1788872670.910258:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327674752 00000100:00100000:0.0:1788872670.910259:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327673856:0@lo:400:kworker.0 00000100:00100000:2.0:1788872670.910277:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327673600 00000100:00100000:2.0:1788872670.910281:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327673600 00000100:00100000:0.0:1788872670.910291:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872670.910297:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327673344 00000100:00100000:2.0:1788872670.910300:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327673344 00000100:00100000:2.0:1788872670.910316:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:2.0:1788872670.910325:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327673728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872670.910347:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:3.0:1788872670.910364:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327674240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872670.910414:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327673728:12345-0@lo:400:kworker.0 Request processed in 88us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872670.910426:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327674240:12345-0@lo:400:kworker.0 Request processed in 59us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872670.910434:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:3.0:1788872670.910441:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1788872670.910459:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:3.0:1788872670.910466:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1788872670.910470:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327674752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872670.910480:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327673600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872670.910513:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327674752:12345-0@lo:400:kworker.0 Request processed in 46us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872670.910521:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:3.0:1788872670.910526:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327673600:12345-0@lo:400:kworker.0 Request processed in 48us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872670.910539:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1788872670.910569:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1788872670.910579:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327673344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872670.910611:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327673344:12345-0@lo:400:kworker.0 Request processed in 62us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872670.910617:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1788872670.911666:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327674112 00000100:00100000:2.0:1788872670.911676:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327674112 00000100:00100000:2.0:1788872670.911905:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327674624 00000100:00100000:2.0:1788872670.911909:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327674624 00000100:00100000:2.0:1788872670.911943:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2505 00000100:00100000:2.0:1788872670.911950:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327674112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872670.912008:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327674112:12345-0@lo:400:kworker.0 Request processed in 59us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872670.912014:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2505 00000100:00100000:2.0:1788872670.912026:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506 00000100:00100000:2.0:1788872670.912032:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327674624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872670.912056:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327674624:12345-0@lo:400:kworker.0 Request processed in 25us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872670.912061:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506 00000100:00080000:2.0:1788872670.912089:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872670.912094:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788872670.912096:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872670.912116:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327673216 00000100:00100000:2.0:1788872670.912120:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327673216 00000100:00100000:2.0:1788872670.912147:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788872670.912153:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327673216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872670.912184:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327673216:12345-0@lo:400:kworker.0 Request processed in 31us (2400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872670.912190:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788872670.912224:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327673472:0@lo:400:kworker.0 00000100:00100000:2.0:1788872670.912353:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872670.912378:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327673984:0@lo:400:kworker.0 00000100:00100000:2.0:1788872670.912403:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872670.913753:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327674368:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.914332:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872670.914374:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327674880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872670.914394:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872670.914442:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327673344:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.914479:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327673472 00000100:00100000:0.0:1788872670.914484:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327673472 00000100:00100000:0.0:1788872670.914545:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1788872670.914570:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f098bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327673472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.914616:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f098bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327673472:12345-0@lo:400:kworker.0 Request processed in 48us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872670.914623:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1788872670.914651:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327673856 00000100:00100000:0.0:1788872670.914655:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327673856 00000100:00100000:0.0:1788872670.914677:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327674368 00000100:00100000:0.0:1788872670.914680:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327674368 00000100:00100000:0.0:1788872670.914690:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327674880 00000100:00100000:0.0:1788872670.914692:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327674880 00000100:00100000:0.0:1788872670.914700:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:0.0:1788872670.914705:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327673856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.914758:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327673856:12345-0@lo:400:kworker.0 Request processed in 52us (4467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872670.914764:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:0.0:1788872670.914775:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:0.0:1788872670.916358:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327674368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.916434:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327674368:12345-0@lo:400:kworker.0 Request processed in 1653us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872670.916441:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00000100:00100000:0.0:1788872670.916465:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:0.0:1788872670.916472:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327674880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788872670.916538:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:0.0:1788872670.916586:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327674880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872670.916592:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00080000:0.0:1788872670.916617:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872670.916658:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327673600:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.916670:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327674112:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.916681:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327674624:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.916692:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327673216:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.916703:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327673728:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.916714:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327674240:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.916724:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327674752:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.916791:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327673856:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.916803:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327674368:0@lo:400:kworker.0 00000100:00100000:0.0:1788872670.916816:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327674880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872670.927330:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327674496:0@lo:400:kworker.0 00000100:00100000:2.0:1788872670.927410:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872670.945474:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327673472:0@lo:400:kworker.0 00000100:00100000:3.0:1788872670.953433:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327673984 00000100:00100000:3.0:1788872670.953449:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327673984 00000100:00100000:2.0:1788872670.953582:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327674496 00000100:00100000:2.0:1788872670.953588:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327674496 00000100:00080000:2.0:1788872670.953612:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872670.953642:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507 00000100:00100000:2.0:1788872670.953652:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327673984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872670.953760:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327673984:12345-0@lo:400:kworker.0 Request processed in 109us (41355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872670.953768:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507 00000100:00100000:3.0:1788872670.953817:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508 00000100:00100000:2.0:1788872670.953831:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327673984:0@lo:400:kworker.0 00000100:00100000:3.0:1788872670.953836:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327674496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872670.953893:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327674496:12345-0@lo:400:kworker.0 Request processed in 68us (26482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872670.953901:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508 00000100:00100000:2.0:1788872670.954388:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327674496:0@lo:400:kworker.0 00000100:00100000:3.0:1788872671.417069:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327675008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872671.417286:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327675136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872671.417353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872671.417464:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327675136 00000100:00100000:1.0:1788872671.417472:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327675136 00000100:00100000:1.0:1788872671.417517:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1788872671.417526:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327675136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872671.417571:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872671.417616:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327675136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872671.417632:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1788872671.417697:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327675136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872671.418019:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872671.418674:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327675008 00000100:00100000:1.0:1788872671.418679:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327675008 00000100:00100000:1.0:1788872671.418711:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:1.0:1788872671.418718:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327675008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788872671.418745:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:1.0:1788872671.418791:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327675008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872671.418798:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000100:00100000:1.0:1788872671.418832:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327675008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872671.418851:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327675264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872671.418879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872671.418922:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327675264 00000100:00100000:1.0:1788872671.418925:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327675264 00000100:00100000:1.0:1788872671.418950:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:1.0:1788872671.418955:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327675264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872671.418968:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872671.418998:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327675264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872671.419003:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:1.0:1788872671.419029:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327675264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788872671.483156:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872671.504898:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872671.504953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872671.504984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872671.505005:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872671.505034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872671.505068:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311153536 00000100:00100000:0.0:1788872671.505081:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311153536 00000100:00100000:0.0:1788872671.505146:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311153408 00000100:00100000:0.0:1788872671.505150:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311153408 00000100:00100000:2.0:1788872671.505254:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1170 00000100:00100000:2.0:1788872671.505267:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311153536:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872671.505368:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311153536:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 104us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872671.505376:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1170 00000100:00100000:0.0:1788872671.505581:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1171 00000100:00100000:0.0:1788872671.505590:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2404:x1875765311153408:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872671.505630:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2404:x1875765311153408:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 42us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872671.505637:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1171 00000100:00080000:0.0:1788872671.505654:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872671.505658:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872671.505945:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311153280 00000100:00100000:1.0:1788872671.505950:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311153280 00000100:00100000:1.0:1788872671.506010:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 84 00000100:00100000:1.0:1788872671.506018:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311153280:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872671.506047:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311153280:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 31us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872671.506054:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 84 00000100:00100000:1.0:1788872671.506086:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311153792 00000100:00100000:1.0:1788872671.506089:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311153792 00000100:00100000:1.0:1788872671.506118:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2509 00000100:00100000:1.0:1788872671.506125:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311153792:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872671.506146:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311153792:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 23us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872671.506152:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2509 00000100:00100000:1.0:1788872671.506234:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311153664 00000100:00100000:1.0:1788872671.506237:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311153664 00000100:00100000:1.0:1788872671.506258:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2510 00000100:00100000:1.0:1788872671.506264:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311153664:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872671.506287:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311153664:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 24us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872671.506293:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2510 00000100:00080000:0.0:1788872671.506640:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872671.506642:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788872671.533619:0:87060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182406 is committed 00010000:00010000:0.0:1788872671.541063:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01da00b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.541081:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01da00b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.541112:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01da00b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.541118:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52afa00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872671.541123:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01da00b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.541131:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01da00b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.541148:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff98a9e7bf4a00) 00010000:00010000:0.0:1788872671.541151:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872671.541156:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01da00b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.541163:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01da00b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872671.659337:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872671.659445:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311153920 00000100:00100000:3.0:1788872671.659456:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311153920 00000100:00100000:3.0:1788872671.659530:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1155 00000100:00100000:3.0:1788872671.659543:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:67870:x1875765311153920:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872671.659585:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872671.659609:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da035 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faebf expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.659749:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da03c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.659764:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da03c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.659775:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da03c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872671.659837:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872671.659841:0:83669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872671.659873:0:83669:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da03c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.659909:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da035 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faebf expref: 9 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.659930:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da03c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faebf expref: 8 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.659941:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d00b4a00) 00010000:00010000:3.0:1788872671.659944:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872671.659948:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3400, rc 0) 00000100:00100000:3.0:1788872671.660019:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67870:x1875765311153920:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 480us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872671.660025:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1155 00000100:00100000:1.0:1788872671.669932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872671.671624:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311154048 00000100:00100000:3.0:1788872671.671637:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311154048 00000100:00100000:3.0:1788872671.671705:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1156 00000100:00100000:3.0:1788872671.671717:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67870:x1875765311154048:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872671.671764:0:66193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:3.0:1788872671.671840:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67870:x1875765311154048:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 125us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872671.671848:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1156 00000100:00100000:3.0:1788872671.678878:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872671.679344:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311154176 00000100:00100000:1.0:1788872671.679356:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311154176 00000100:00100000:1.0:1788872671.679422:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1157 00000100:00100000:1.0:1788872671.679434:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:67870:x1875765311154176:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:1.0:1788872671.679468:0:66190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872671.679582:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:67870:x1875765311154176:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 150us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872671.679590:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1157 00000100:00100000:1.0:1788872671.687566:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872671.687659:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311154304 00000100:00100000:2.0:1788872671.687669:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311154304 00000100:00100000:2.0:1788872671.687735:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2029 00000100:00100000:2.0:1788872671.687746:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:67870:x1875765311154304:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:2.0:1788872671.687773:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872671.687844:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:67870:x1875765311154304:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 99us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872671.687853:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2029 00000100:00100000:1.0:1788872671.690787:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872671.700668:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311154432 00000100:00100000:2.0:1788872671.700685:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311154432 00000100:00100000:2.0:1788872671.700994:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2030 00000100:00100000:2.0:1788872671.701006:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:67870:x1875765311154432:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:2.0:1788872671.701034:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872671.701241:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:67870:x1875765311154432:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 236us (10462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872671.701250:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2030 00000100:00100000:3.0:1788872671.851415:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872671.851541:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311154688 00000100:00100000:0.0:1788872671.851611:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311154688 00000100:00100000:0.0:1788872671.851674:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1158 00000100:00100000:0.0:1788872671.851685:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67877:x1875765311154688:12345-192.168.204.39@tcp:36:mcreate.0 00010000:00010000:0.0:1788872671.851757:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872671.851786:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01da03c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faebf expref: 8 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.851805:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d00b4a00) 00010000:00010000:0.0:1788872671.851827:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872671.851902:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01da043 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.851914:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01da043 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.851924:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01da043 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.851937:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fc00/0xe4e6e89fb01da04a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.851944:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fc00/0xe4e6e89fb01da04a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.851951:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fc00/0xe4e6e89fb01da04a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.852879:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01da043 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.852889:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01da043 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.852895:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01da043 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.852901:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98fe00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872671.852906:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01da043 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.852914:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01da043 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.852933:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd26b500) 00010000:00010000:0.0:1788872671.852936:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872671.852941:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01da043 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.852948:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fe00/0xe4e6e89fb01da043 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872671.852963:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000272b2c0f reply state 0000000027a978e1 transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fc00/0xe4e6e89fb01da04a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.852973:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fc00/0xe4e6e89fb01da04a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872671.852980:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9cd26bb00) 00010000:00010000:0.0:1788872671.852983:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872671.852985:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788872671.854857:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:67877:x1875765311154688:12345-192.168.204.39@tcp:36:mcreate.0 Request processed in 3164us (3440us total) trans 107374182407 rc 0/0 00000100:00100000:0.0:1788872671.854870:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1158 00000100:00100000:2.0:1788872671.883706:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872671.884499:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311154816 00000100:00100000:3.0:1788872671.884511:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311154816 00000100:00100000:3.0:1788872671.884598:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1159 00000100:00100000:3.0:1788872671.884610:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f098b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:67880:x1875765311154816:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:3.0:1788872671.884640:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872671.884666:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da051 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faec6 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.884735:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01da058 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.884749:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01da058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.884762:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01da058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872671.884813:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872671.884817:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872671.884836:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01da058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.884862:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da051 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faec6 expref: 11 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.884882:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01da058 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faec6 expref: 10 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.884891:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d00b4200) 00010000:00010000:3.0:1788872671.884910:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872671.884914:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3600, rc 0) 00000100:00100000:3.0:1788872671.884973:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f098b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:67880:x1875765311154816:12345-192.168.204.39@tcp:101:rm.0 Request processed in 365us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872671.884980:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1159 00000100:00100000:0.0:1788872671.926833:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872671.926969:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311154944 00000100:00100000:3.0:1788872671.926979:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311154944 00000100:00100000:3.0:1788872671.927056:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1160 00000100:00100000:3.0:1788872671.927068:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:67880:x1875765311154944:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:3.0:1788872671.927090:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872671.927111:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01da05f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faecd expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927181:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da066 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927195:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da066 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927206:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da066 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927217:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da06d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927225:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da06d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927232:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da06d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927339:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01da074 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927348:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01da074 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927356:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01da074 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872671.927402:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788872671.927405:0:66190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872671.927426:0:66190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01da074 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927438:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01da074 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927448:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da066 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927454:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da066 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927461:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da066 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927468:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da066 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927475:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872671.927479:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da066 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927495:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da066 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927509:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d00b4200) 00010000:00010000:3.0:1788872671.927512:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872671.927517:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da066 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927523:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927536:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da06d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927542:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da06d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927573:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da06d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927579:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872671.927581:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da06d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927588:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da06d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927595:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9cd26bb00) 00010000:00010000:3.0:1788872671.927598:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872671.927601:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da06d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927617:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da06d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927645:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01da05f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faecd expref: 12 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927657:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01da074 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faecd expref: 11 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872671.927664:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff98a9d00b4700) 00010000:00010000:3.0:1788872671.927666:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788872671.927669:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3000, rc 0) 00000100:00100000:3.0:1788872671.927727:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:67880:x1875765311154944:12345-192.168.204.39@tcp:101:rm.0 Request processed in 663us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872671.927735:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1160 00000100:00100000:1.0:1788872671.945227:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872671.945307:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311155200 00000100:00100000:2.0:1788872671.945343:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311155200 00000100:00100000:2.0:1788872671.945404:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1161 00000100:00100000:2.0:1788872671.945415:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:67880:x1875765311155200:12345-192.168.204.39@tcp:36:rm.0 00010000:00010000:2.0:1788872671.945467:0:66979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788872671.945517:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01da074 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faecd expref: 11 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.945538:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff98a9d00b4700) 00010000:00010000:2.0:1788872671.945584:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01da058 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faec6 expref: 10 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.945593:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d00b4200) 00010000:00010000:2.0:1788872671.945599:0:66979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872671.945622:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da07b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.945634:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da07b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.945644:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da07b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.945655:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01da082 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.945663:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01da082 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.945669:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01da082 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.945776:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da089 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.945785:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da089 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.945792:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da089 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946222:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da090 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946232:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da090 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946241:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da090 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946248:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da090 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946254:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da090 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946260:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da090 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946276:0:66979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872671.946295:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da089 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946302:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da089 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946324:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da089 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946331:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872671.946335:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da089 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946343:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da089 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946352:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff98a9d24aab00) 00010000:00010000:2.0:1788872671.946355:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788872671.946359:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da089 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946365:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da089 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946382:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da07b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946388:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da07b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946393:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da07b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946398:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da07b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946402:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872671.946410:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da07b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946416:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da07b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946425:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d24aa700) 00010000:00010000:2.0:1788872671.946427:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872671.946430:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da07b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946436:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da07b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872671.946449:0:66979:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005079965d reply state 000000003d696d19 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01da082 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946459:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01da082 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872671.946465:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9cd26bb00) 00010000:00010000:2.0:1788872671.946467:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872671.946469:0:66979:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872671.946568:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:67880:x1875765311155200:12345-192.168.204.39@tcp:36:rm.0 Request processed in 1135us (1329us total) trans 107374182408 rc 0/0 00000100:00100000:2.0:1788872671.946577:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1161 00010000:00010000:1.0:1788872671.946818:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872671.946825:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da090 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872671.946831:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872671.946835:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da090 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872671.946840:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da090 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872671.946851:0:14981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff98a9d24aab00) 00010000:00010000:1.0:1788872671.946854:0:14981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788872671.946856:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da090 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872671.946861:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da090 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872671.946874:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872671.946876:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872671.946877:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872672.505832:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872673.531208:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872674.553683:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872675.001908:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327675520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872675.002013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872675.002088:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872675.002095:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327675392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872675.002124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872675.002932:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327675520 00000100:00100000:2.0:1788872675.002943:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327675520 00000100:00100000:2.0:1788872675.003026:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327675392 00000100:00100000:2.0:1788872675.003029:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327675392 00000100:00100000:2.0:1788872675.003068:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:2.0:1788872675.003076:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327675520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872675.003135:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872675.003192:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327675520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872675.003199:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:2.0:1788872675.003218:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:2.0:1788872675.003224:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327675392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872675.003239:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872675.003277:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327675392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872675.003284:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00080000:1.0:1788872675.004521:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872675.004529:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872675.004606:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327675392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872675.004623:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327675520:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788872675.582362:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872676.032440:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327675648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872676.033897:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872676.034423:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327675648 00000100:00100000:2.0:1788872676.034433:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327675648 00000100:00100000:2.0:1788872676.034487:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:2.0:1788872676.034497:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327675648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872676.034538:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872676.034640:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327675648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872676.034648:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00000100:00100000:2.0:1788872676.034698:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327675648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872676.036951:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327675776:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.037017:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872676.038258:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327676288:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.038306:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872676.038354:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327676800:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.038379:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872676.038408:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788872676.038414:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327676160:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.038434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872676.038453:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327676672:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.038473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872676.038491:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327677184:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.038509:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872676.038538:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327675904:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.038578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872676.038597:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327676416:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.038618:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872676.038638:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327676928:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.038659:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872676.038681:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788872676.038688:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327676032:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.038709:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872676.039914:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327676288 00000100:00100000:1.0:1788872676.039927:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327676288 00000100:00100000:1.0:1788872676.040040:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327676800 00000100:00100000:1.0:1788872676.040044:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327676800 00000100:00100000:1.0:1788872676.040061:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1788872676.040070:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327676288:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788872676.040857:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872676.041059:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327676544:0@lo:400:kworker.0 00000100:00100000:1.0:1788872676.049411:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327676288:12345-0@lo:400:kworker.0 Request processed in 9332us (11094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872676.049428:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1788872676.049466:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327676160 00000100:00100000:1.0:1788872676.049475:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327676160 00000100:00100000:1.0:1788872676.049518:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327677184 00000100:00100000:1.0:1788872676.049521:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327677184 00000100:00100000:1.0:1788872676.049532:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327675904 00000100:00100000:1.0:1788872676.049535:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327675904 00000100:00100000:1.0:1788872676.049545:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327676032 00000100:00100000:1.0:1788872676.049567:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327676032 00000100:00100000:1.0:1788872676.049586:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1788872676.049593:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327676800:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788872676.049617:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6527800 x1875765327676800/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:602/0 lens 224/224 e 0 to 0 dl 1788872687 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872676.049673:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327676800:12345-0@lo:400:kworker.0 Request processed in 80us (11292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872676.049679:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1788872676.049693:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1788872676.049698:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327676160:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788872676.049710:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6524700 x1875765327676160/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:602/0 lens 224/224 e 0 to 0 dl 1788872687 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872676.049749:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327676160:12345-0@lo:400:kworker.0 Request processed in 51us (11314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872676.049755:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1788872676.049767:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1788872676.049772:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327677184:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788872676.049781:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6526300 x1875765327677184/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:602/0 lens 224/224 e 0 to 0 dl 1788872687 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872676.049808:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327677184:12345-0@lo:400:kworker.0 Request processed in 35us (11297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872676.049813:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1788872676.049823:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1788872676.049829:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327675904:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788872676.049842:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6526d80 x1875765327675904/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:602/0 lens 224/224 e 0 to 0 dl 1788872687 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872676.049869:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327675904:12345-0@lo:400:kworker.0 Request processed in 40us (11290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872676.049875:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1788872676.049896:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1788872676.049902:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327676032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872676.049931:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327676032:12345-0@lo:400:kworker.0 Request processed in 30us (11222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872676.049937:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1788872676.049966:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327676672 00000100:00100000:1.0:1788872676.049970:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327676672 00000100:00100000:1.0:1788872676.049996:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327676928 00000100:00100000:1.0:1788872676.050000:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327676928 00000100:00100000:1.0:1788872676.050034:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2511 00000100:00100000:1.0:1788872676.050040:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327676672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872676.050074:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327676672:12345-0@lo:400:kworker.0 Request processed in 34us (11600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872676.050080:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2511 00000100:00100000:1.0:1788872676.050091:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2512 00000100:00100000:1.0:1788872676.050096:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327676928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872676.050123:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327676928:12345-0@lo:400:kworker.0 Request processed in 27us (11463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872676.050128:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512 00000100:00100000:1.0:1788872676.050145:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327676416 00000100:00100000:1.0:1788872676.050149:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327676416 00000100:00100000:1.0:1788872676.050174:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:1.0:1788872676.050180:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327676416:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788872676.050195:0:23717:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6524e00 x1875765327676416/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:602/0 lens 224/224 e 0 to 0 dl 1788872687 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872676.050223:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327676416:12345-0@lo:400:kworker.0 Request processed in 43us (11604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872676.050247:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00100000:1.0:1788872676.050290:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327675776 00000100:00100000:1.0:1788872676.050295:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327675776 00000100:00100000:1.0:1788872676.050319:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788872676.050325:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327675776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872676.050359:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327675776:12345-0@lo:400:kworker.0 Request processed in 34us (13343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872676.050366:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788872676.050433:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872676.050439:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872676.050442:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788872676.068718:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872676.068853:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327677056:0@lo:400:kworker.0 00000100:00100000:1.0:1788872676.068895:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872676.068983:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327675904:0@lo:400:kworker.0 00000100:00100000:1.0:1788872676.068997:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327676416:0@lo:400:kworker.0 00000100:00100000:1.0:1788872676.069008:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327676928:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.069522:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327676544 00000100:00100000:0.0:1788872676.069531:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327676544 00000100:00100000:1.0:1788872676.069655:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327676032:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.070451:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327677056 00000100:00100000:0.0:1788872676.070459:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327677056 00000100:00100000:0.0:1788872676.070501:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513 00000100:00100000:0.0:1788872676.070512:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327676544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.070694:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327676544:12345-0@lo:400:kworker.0 Request processed in 184us (1986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872676.070703:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513 00000100:00100000:1.0:1788872676.070824:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514 00000100:00100000:1.0:1788872676.070835:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327677056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872676.070873:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327677056:12345-0@lo:400:kworker.0 Request processed in 41us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872676.070879:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514 00000100:00100000:1.0:1788872676.070913:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327676544:0@lo:400:kworker.0 00000100:00100000:1.0:1788872676.070933:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327677056:0@lo:400:kworker.0 00000100:00080000:0.0:1788872676.070999:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872676.071094:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327676160:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.071109:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327676672:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.071121:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327677184:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.071132:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327675776:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.071143:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327676288:0@lo:400:kworker.0 00000100:00100000:0.0:1788872676.071153:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327676800:0@lo:400:kworker.0 00000100:00100000:1.0:1788872676.539176:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872676.539198:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327677312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872676.539276:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872676.539951:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327677312 00000100:00100000:2.0:1788872676.539961:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327677312 00000100:00100000:2.0:1788872676.540140:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:2.0:1788872676.540153:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327677312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872676.540194:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872676.540268:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327677312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872676.540276:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:2.0:1788872676.540301:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872676.540311:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327677440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872676.540343:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872676.540372:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327677440 00000100:00100000:2.0:1788872676.540376:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327677440 00000100:00100000:2.0:1788872676.540402:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:2.0:1788872676.540408:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327677440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872676.540419:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872676.540450:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327677440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872676.540456:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:2.0:1788872676.540501:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327677440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872676.540532:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327677312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872676.541199:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872676.551705:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327677568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872676.551867:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872676.552056:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327677568 00000100:00100000:3.0:1788872676.552065:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327677568 00000100:00100000:3.0:1788872676.552112:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:3.0:1788872676.552122:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327677568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872676.552155:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00010000:00000080:3.0:1788872676.552172:0:8446:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6524380 x1875765327677568/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:602/0 lens 224/368 e 0 to 0 dl 1788872687 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872676.552219:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327677568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872676.552236:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:0.0:1788872676.552381:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327677568:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788872676.604169:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872676.617544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872676.617609:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872676.617636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872676.617658:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872676.617684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872676.617726:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311155584 00000100:00100000:3.0:1788872676.617736:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311155584 00000100:00100000:3.0:1788872676.617799:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311155456 00000100:00100000:3.0:1788872676.617803:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311155456 00000100:00100000:3.0:1788872676.617825:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1178 00000100:00100000:3.0:1788872676.617835:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311155584:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872676.617916:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311155584:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872676.617923:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1178 00000100:00100000:3.0:1788872676.617941:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1179 00000100:00100000:3.0:1788872676.617949:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2405:x1875765311155456:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000080:3.0:1788872676.617967:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4f34e00 x1875765311155456/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:602/0 lens 224/224 e 0 to 0 dl 1788872687 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872676.617990:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2405:x1875765311155456:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 43us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872676.617996:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1179 00000100:00100000:3.0:1788872676.618026:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311155840 00000100:00100000:3.0:1788872676.618030:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311155840 00000100:00100000:3.0:1788872676.618055:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311155712 00000100:00100000:3.0:1788872676.618057:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311155712 00000100:00100000:3.0:1788872676.618077:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2515 00000100:00100000:3.0:1788872676.618083:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311155840:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872676.618122:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311155840:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 39us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872676.618129:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2515 00000100:00100000:3.0:1788872676.618141:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2516 00000100:00100000:3.0:1788872676.618148:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311155712:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872676.618172:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311155712:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872676.618178:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2516 00000100:00080000:3.0:1788872676.618200:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872676.618203:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872676.618206:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872676.618208:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872676.621535:0:87071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311155328 00000100:00100000:2.0:1788872676.621576:0:87071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311155328 00000100:00100000:2.0:1788872676.621632:0:87071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 86 00000100:00100000:2.0:1788872676.621641:0:87071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c771f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311155328:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872676.621714:0:87071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c771f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311155328:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 73us (4181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872676.621722:0:87071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 86 00010000:00010000:2.0:1788872677.626862:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872678.649854:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872679.699015:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788872680.047782:0:87060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:1.0:1788872680.048085:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fc00/0xe4e6e89fb01da04a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048099:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fc00/0xe4e6e89fb01da04a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048108:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fc00/0xe4e6e89fb01da04a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048114:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98fc00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872680.048120:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fc00/0xe4e6e89fb01da04a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048128:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fc00/0xe4e6e89fb01da04a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048146:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9cd26bb00) 00010000:00010000:1.0:1788872680.048150:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872680.048154:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fc00/0xe4e6e89fb01da04a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048160:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fc00/0xe4e6e89fb01da04a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048188:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01da082 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048207:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01da082 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048213:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01da082 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048218:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872680.048221:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01da082 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048225:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01da082 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048232:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9cd26bb00) 00010000:00010000:1.0:1788872680.048234:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872680.048237:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01da082 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872680.048243:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01da082 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872680.121099:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788872680.121126:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327677696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872680.121208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872680.122425:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327677696 00000100:00100000:1.0:1788872680.122437:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327677696 00000100:00100000:3.0:1788872680.122933:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327677824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872680.122994:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872680.123043:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327677824 00000100:00100000:3.0:1788872680.123047:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327677824 00000100:00100000:1.0:1788872680.123731:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:1.0:1788872680.123744:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327677696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872680.123776:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872680.123840:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327677696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (2631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872680.123846:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:3.0:1788872680.124960:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1788872680.124978:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327677824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872680.125003:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872680.125059:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327677824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872680.125066:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1788872680.125158:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327677824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872680.125197:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327677696:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788872680.133896:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872680.133909:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788872680.705109:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872681.145895:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327678080:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.145964:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146008:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327678592:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.146034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146052:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327679104:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.146070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146090:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788872681.146096:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327677952:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.146120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146171:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327678464:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.146192:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146207:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327678976:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.146222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146235:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327679488:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.146252:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146273:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327678208:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.146292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146304:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327678720:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.146323:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146335:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327679232:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.146351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146381:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788872681.146386:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327678336:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.146605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146634:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327678848:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.146790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146808:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327679360:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.146825:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.146855:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327678080 00000100:00100000:3.0:1788872681.146862:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327678080 00000100:00100000:3.0:1788872681.146905:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327678464 00000100:00100000:3.0:1788872681.146907:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327678464 00000100:00100000:3.0:1788872681.146918:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327678976 00000100:00100000:3.0:1788872681.146920:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327678976 00000100:00100000:3.0:1788872681.146935:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327679488 00000100:00100000:3.0:1788872681.146937:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327679488 00000100:00100000:3.0:1788872681.146945:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327678208 00000100:00100000:3.0:1788872681.146947:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327678208 00000100:00100000:3.0:1788872681.146957:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327678336 00000100:00100000:3.0:1788872681.146959:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327678336 00000100:00100000:3.0:1788872681.147304:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1788872681.147312:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327678080:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872681.147333:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9df457b80 x1875765327678080/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:607/0 lens 224/224 e 0 to 0 dl 1788872692 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872681.147370:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327678080:12345-0@lo:400:kworker.0 Request processed in 59us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872681.147377:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1788872681.147392:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1788872681.147534:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872681.147575:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327679616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872681.147614:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872681.147675:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327678720 00000100:00100000:0.0:1788872681.147679:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327678720 00000100:00100000:0.0:1788872681.147705:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327679232 00000100:00100000:0.0:1788872681.147707:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327679232 00000100:00100000:0.0:1788872681.147722:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327678848 00000100:00100000:0.0:1788872681.147733:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327678848 00000100:00100000:0.0:1788872681.147750:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327679360 00000100:00100000:0.0:1788872681.147753:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327679360 00000100:00100000:0.0:1788872681.147770:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517 00000100:00100000:0.0:1788872681.147775:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327678720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872681.147814:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327678720:12345-0@lo:400:kworker.0 Request processed in 38us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872681.147820:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517 00000100:00100000:0.0:1788872681.147832:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518 00000100:00100000:0.0:1788872681.147837:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327679232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872681.147861:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327679232:12345-0@lo:400:kworker.0 Request processed in 24us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872681.147867:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518 00000100:00100000:0.0:1788872681.147875:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:0.0:1788872681.147880:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327678848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872681.147903:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327678848:12345-0@lo:400:kworker.0 Request processed in 23us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872681.147908:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00100000:0.0:1788872681.147918:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:0.0:1788872681.147923:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327679360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872681.147946:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327679360:12345-0@lo:400:kworker.0 Request processed in 23us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872681.147951:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:0.0:1788872681.148005:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327678848:0@lo:400:kworker.0 00000100:00100000:0.0:1788872681.148017:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327679360:0@lo:400:kworker.0 00000100:00100000:0.0:1788872681.148038:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327678720:0@lo:400:kworker.0 00000100:00100000:0.0:1788872681.148046:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327679232:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.148907:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327678464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872681.149873:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327678592 00000100:00100000:2.0:1788872681.149883:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327678592 00000100:00100000:2.0:1788872681.149929:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327679104 00000100:00100000:2.0:1788872681.149933:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327679104 00000100:00100000:2.0:1788872681.149943:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327679616 00000100:00100000:2.0:1788872681.149946:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327679616 00000100:00100000:2.0:1788872681.149958:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:2.0:1788872681.149976:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327678592:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788872681.149998:0:8446:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9df454000 x1875765327678592/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:607/0 lens 224/224 e 0 to 0 dl 1788872692 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872681.165279:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:1.0:1788872681.165300:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327679104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872681.165455:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327678592:12345-0@lo:400:kworker.0 Request processed in 15489us (19418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872681.165464:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00100000:2.0:1788872681.165489:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:2.0:1788872681.165496:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327679616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872681.165519:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872681.165572:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327679616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (17958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872681.165578:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:2.0:1788872681.165627:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327679616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872681.171348:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1788872681.174364:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327678976:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788872681.174418:0:66192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9df456d80 x1875765327678976/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:607/0 lens 224/224 e 0 to 0 dl 1788872692 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872681.174525:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327678976:12345-0@lo:400:kworker.0 Request processed in 3165us (28301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872681.174536:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1788872681.174592:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1788872681.174608:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327679488:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788872681.174619:0:66192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9df455f80 x1875765327679488/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:607/0 lens 224/224 e 0 to 0 dl 1788872692 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872681.177535:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327679488:12345-0@lo:400:kworker.0 Request processed in 2927us (31273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872681.177578:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1788872681.179112:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1788872681.179132:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327678208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872681.179239:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327678208:12345-0@lo:400:kworker.0 Request processed in 115us (32945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872681.179246:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1788872681.179259:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1788872681.179267:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327678336:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788872681.179280:0:66192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9df456680 x1875765327678336/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:607/0 lens 224/224 e 0 to 0 dl 1788872692 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872681.179307:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327678336:12345-0@lo:400:kworker.0 Request processed in 42us (32701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872681.179312:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1788872681.179352:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327677952 00000100:00100000:2.0:1788872681.179359:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327677952 00000100:00100000:2.0:1788872681.179424:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788872681.179430:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327677952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872681.179460:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327677952:12345-0@lo:400:kworker.0 Request processed in 31us (33339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872681.179466:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788872681.180562:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327678464:12345-0@lo:400:kworker.0 Request processed in 33150us (34354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872681.180572:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00080000:3.0:1788872681.180607:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872681.180612:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872681.180616:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872681.180619:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872681.180675:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327677952:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.180692:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327678464:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.180704:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327678976:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.180715:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327679488:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.180726:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327678080:0@lo:400:kworker.0 00000100:00100000:3.0:1788872681.180736:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327678592:0@lo:400:kworker.0 00000100:00100000:0.0:1788872681.183061:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327678336:0@lo:400:kworker.0 00000100:00100000:0.0:1788872681.183081:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327678208:0@lo:400:kworker.0 00000100:00100000:2.0:1788872681.190107:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327679104:0@lo:400:kworker.0 00000100:00100000:1.0:1788872681.190182:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327679104:12345-0@lo:400:kworker.0 Request processed in 24671us (43892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872681.190194:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00100000:3.0:1788872681.657355:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327679744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872681.657428:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872681.658071:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327679744 00000100:00100000:0.0:1788872681.658082:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327679744 00000100:00100000:0.0:1788872681.658147:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1788872681.658159:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327679744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872681.658182:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872681.658253:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327679744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872681.658363:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327679872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872681.658397:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872681.658432:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327679872 00000100:00100000:3.0:1788872681.658436:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327679872 00000100:00100000:3.0:1788872681.658472:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1788872681.658479:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327679872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872681.658507:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00010000:00000080:3.0:1788872681.658533:0:8446:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9efa59f80 x1875765327679872/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:607/0 lens 224/368 e 0 to 0 dl 1788872692 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872681.658602:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327679872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872681.658610:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1788872681.658657:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327679872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872681.658693:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327679744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872681.661010:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1788872681.663481:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872681.663507:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327680000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872681.663598:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872681.663705:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327680000 00000100:00100000:1.0:1788872681.663712:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327680000 00000100:00100000:1.0:1788872681.663764:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:1.0:1788872681.663772:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327680000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872681.663794:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872681.663839:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327680000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872681.663846:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:1.0:1788872681.663884:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327680000:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788872681.720954:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788872681.736963:0:88283:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1788872681.738204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872681.738253:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872681.738292:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872681.738312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872681.738341:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872681.738369:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311156224 00000100:00100000:3.0:1788872681.738378:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311156224 00000100:00100000:3.0:1788872681.738443:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311156096 00000100:00100000:3.0:1788872681.738447:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311156096 00000100:00100000:3.0:1788872681.738475:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1186 00000100:00100000:3.0:1788872681.738487:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311156224:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872681.738586:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311156224:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 100us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872681.738594:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1186 00000100:00100000:3.0:1788872681.738614:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1187 00000100:00100000:3.0:1788872681.738623:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2407:x1875765311156096:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000080:3.0:1788872681.738637:0:66979:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9efa5b800 x1875765311156096/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:607/0 lens 224/224 e 0 to 0 dl 1788872692 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872681.738683:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2407:x1875765311156096:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 63us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872681.738691:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1187 00000100:00080000:3.0:1788872681.738708:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872681.738713:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872681.739099:0:87064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311155968 00000100:00100000:1.0:1788872681.739106:0:87064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311155968 00000100:00100000:1.0:1788872681.739160:0:87064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 88 00000100:00100000:1.0:1788872681.739168:0:87064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2407:x1875765311155968:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872681.739202:0:87064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2407:x1875765311155968:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 35us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872681.739209:0:87064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 88 00000100:00100000:1.0:1788872681.739244:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311156480 00000100:00100000:1.0:1788872681.739248:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311156480 00000100:00100000:1.0:1788872681.739284:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311156352 00000100:00100000:1.0:1788872681.739286:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311156352 00000100:00100000:1.0:1788872681.739307:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2521 00000100:00100000:1.0:1788872681.739313:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311156480:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872681.739352:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311156480:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 39us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872681.739359:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2521 00000100:00100000:1.0:1788872681.739371:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2522 00000100:00100000:1.0:1788872681.739377:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311156352:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872681.739400:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2407:x1875765311156352:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 23us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872681.739407:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2522 00000100:00080000:1.0:1788872681.739430:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872681.739433:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872681.899717:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872681.904716:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311156608 00000100:00100000:1.0:1788872681.904730:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311156608 00000100:00100000:1.0:1788872681.910330:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1162 00000100:00100000:1.0:1788872681.910347:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:67949:x1875765311156608:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872681.910374:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872681.910402:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae400/0xe4e6e89fb01da097 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faed4 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872681.910476:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01da09e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872681.910491:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01da09e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872681.910504:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01da09e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872681.910579:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788872681.910601:0:66190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788872681.910638:0:66190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01da09e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872681.910663:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae400/0xe4e6e89fb01da097 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faed4 expref: 9 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872681.910681:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01da09e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faed4 expref: 8 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872681.910690:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:1.0:1788872681.910694:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788872681.910697:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af600, rc 0) 00010000:00000080:1.0:1788872681.910705:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c3b49f80 x1875765311156608/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:607/0 lens 576/688 e 0 to 0 dl 1788872692 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872681.910788:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67949:x1875765311156608:12345-192.168.204.39@tcp:101:dd.0 Request processed in 444us (11081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872681.910795:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1162 00000100:00100000:3.0:1788872681.922869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872681.923267:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311156864 00000100:00100000:2.0:1788872681.923278:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311156864 00000100:00100000:2.0:1788872681.923348:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1163 00000100:00100000:2.0:1788872681.923359:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:67949:x1875765311156864:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872681.923382:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872681.923386:0:66979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788872681.923416:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01da09e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faed4 expref: 8 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.923437:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:2.0:1788872681.923449:0:66979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872681.923465:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01da0a5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faedb expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.923627:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da0ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.923641:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da0ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.923669:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da0ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.923686:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da0b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.923694:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.923702:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.923773:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.923782:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.923789:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872681.925265:0:66979:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1788872681.925273:0:66979:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1788872670 00000004:00010000:2.0:1788872681.925276:0:66979:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1788872670 00000004:00010000:2.0:1788872681.925279:0:66979:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1788872670 00000004:00010000:2.0:1788872681.925281:0:66979:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:2.0:1788872681.925285:0:66979:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:2.0:1788872681.925294:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da0ac lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925304:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da0ac lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925322:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da0ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925330:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da0ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925337:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872681.925342:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da0ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925350:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da0ac lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925365:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d24aaa00) 00010000:00010000:2.0:1788872681.925368:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872681.925372:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da0ac lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925379:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01da0ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925394:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925400:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da0b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925407:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925413:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872681.925422:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925429:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da0b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925438:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff98a9d24aad00) 00010000:00010000:2.0:1788872681.925441:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872681.925444:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da0b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925450:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01da0b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925506:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01da0a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 10 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925525:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872681.925532:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9d24aa500) 00010000:00010000:2.0:1788872681.926027:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1788872681.926035:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8400, rc 0) 00010000:00000080:2.0:1788872681.926045:0:66979:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9efa58e00 x1875765311156864/t107374182409(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:607/0 lens 752/824 e 0 to 0 dl 1788872692 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872681.926139:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:67949:x1875765311156864:12345-192.168.204.39@tcp:101:dd.0 Request processed in 2782us (3280us total) trans 107374182409 rc 0/0 00000100:00100000:2.0:1788872681.926150:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1163 00000100:00100000:0.0:1788872681.940181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872681.940304:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311156992 00000100:00100000:3.0:1788872681.940317:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311156992 00000100:00100000:3.0:1788872681.940418:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1164 00000100:00100000:3.0:1788872681.940432:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:67949:x1875765311156992:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872681.940457:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872681.940485:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01da0c8 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faee2 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.940523:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da0cf lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.940538:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da0cf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.940576:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da0cf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.940728:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01da0c8 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faee2 expref: 11 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.940748:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da0cf lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faee2 expref: 10 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.940769:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9d24aa500) 00010000:00010000:3.0:1788872681.940772:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788872681.940776:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2e00, rc 0) 00010000:00000080:3.0:1788872681.940784:0:66193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6526a00 x1875765311156992/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:607/0 lens 568/1272 e 0 to 0 dl 1788872692 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872681.940864:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:67949:x1875765311156992:12345-192.168.204.39@tcp:101:dd.0 Request processed in 435us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872681.940870:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1164 00000100:00100000:0.0:1788872681.950834:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872681.950962:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311157248 00000100:00100000:3.0:1788872681.950974:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311157248 00000100:00100000:3.0:1788872681.951058:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1165 00000100:00100000:3.0:1788872681.951070:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:67949:x1875765311157248:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:3.0:1788872681.951223:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.951242:0:68674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 10 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.951253:0:68674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.951291:0:68674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 10 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.951306:0:68674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 10 pid: 66979 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872681.951344:0:68674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68674:1875765327680128:192.168.204.39@tcp:104: 00000100:00100000:3.0:1788872681.951429:0:68674:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872681.958660:0:68674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68674:1875765327680128:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788872681.958706:0:68674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872681.961423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872681.961715:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311157376 00000100:00100000:3.0:1788872681.961726:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311157376 00010000:00010000:3.0:1788872681.961773:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 11 pid: 66979 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872681.961823:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2555 00000100:00100000:3.0:1788872681.961835:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2405:x1875765311157376:12345-192.168.204.39@tcp:102:ldlm_bl.0 00010000:00010000:3.0:1788872681.961853:0:7929:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 11 pid: 66979 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.961866:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 11 pid: 66979 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.961879:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 11 pid: 66979 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.961888:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9d24aa500) 00010000:00010000:3.0:1788872681.961891:0:7929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1788872681.961896:0:7929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.961930:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.961937:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872681.961976:0:7929:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 11 pid: 66979 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872681.962046:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2405:x1875765311157376:12345-192.168.204.39@tcp:102:ldlm_bl.0 Request processed in 214us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872681.962053:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2555 00010000:00010000:0.0:1788872681.962464:0:68674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872681.962472:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872681.962663:0:68674:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1788872681.962667:0:68674:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1788872670 -> 1788872682 00000004:00010000:0.0:1788872681.962677:0:68674:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1788872670 -> 1788872670 00000004:00010000:0.0:1788872681.962679:0:68674:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1788872670 -> 1788872682 00000004:00010000:0.0:1788872681.962681:0:68674:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1788872681.962689:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005cd6703 reply state 00000000e4b703d9 transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872681.962702:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872681.962709:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9d24aa500) 00010000:00010000:0.0:1788872681.962711:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872681.962714:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1788872681.962772:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6524a80 x1875765311157248/t107374182410(0) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:607/0 lens 488/456 e 0 to 0 dl 1788872692 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872681.962810:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:67949:x1875765311157248:12345-192.168.204.39@tcp:36:dd.0 Request processed in 11743us (11986us total) trans 107374182410 rc 0/0 00000100:00100000:0.0:1788872681.962816:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1165 00000100:00100000:0.0:1788872681.969373:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872681.969491:0:66205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311157504 00000100:00100000:1.0:1788872681.969502:0:66205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311157504 00002000:00010000:1.0:1788872681.969546:0:66205:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:1.0:1788872681.969574:0:66205:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff98a9df455180 with x1875765311157504 00000100:00100000:1.0:1788872681.969618:0:66205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 0 00000100:00100000:1.0:1788872681.969628:0:66205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2404:x1875765311157504:12345-192.168.204.39@tcp:10:dd.0 00000004:00010000:1.0:1788872681.969821:0:66205:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1788872681.969825:0:66205:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1788872682 -> 1788872682 00000004:00010000:1.0:1788872681.969828:0:66205:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1788872670 -> 1788872670 00000004:00010000:1.0:1788872681.969831:0:66205:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1788872682 -> 1788872682 00000004:00010000:1.0:1788872681.969847:0:66205:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788872681.969869:0:66205:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9df455180 x1875765311157504/t107374182411(0) o10->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:607/0 lens 440/432 e 0 to 0 dl 1788872692 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872681.969951:0:66205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:2404:x1875765311157504:12345-192.168.204.39@tcp:10:dd.0 Request processed in 324us (588us total) trans 107374182411 rc 0/0 00000100:00100000:1.0:1788872681.969962:0:66205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 0 00002000:00010000:1.0:1788872681.969966:0:66205:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:1.0:1788872681.969968:0:66205:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff98a9df455180 with x1875765311157504 00000100:00100000:1.0:1788872681.974143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872681.974238:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311157760 00000100:00100000:3.0:1788872681.974249:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311157760 00000100:00100000:3.0:1788872681.974316:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 223 00000100:00100000:3.0:1788872681.974327:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:67949:x1875765311157760:12345-192.168.204.39@tcp:35:dd.0 00010000:00000080:3.0:1788872681.974514:0:80566:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4df1f80 x1875765311157760/t107374182412(0) o35->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:607/0 lens 392/456 e 0 to 0 dl 1788872692 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872681.975057:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+14:67949:x1875765311157760:12345-192.168.204.39@tcp:35:dd.0 Request processed in 730us (934us total) trans 107374182412 rc 0/0 00000100:00100000:3.0:1788872681.975065:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 223 00010000:00010000:2.0:1788872682.745413:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872683.768908:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788872684.370709:0:88380:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788872684.370769:0:88380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.370785:0:88380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.370792:0:88380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.370800:0:88380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.370824:0:88380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788872684.370830:0:88380:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788872684.370853:0:88380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788872684.370857:0:88380:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788872684.370862:0:88380:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788872684.370888:0:88380:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe90000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788872684.370982:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327680256:0@lo:39:umount.0 00000100:00100000:0.0:1788872684.371058:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788872684.371184:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872684.371192:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.371201:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872684.371205:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.371214:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872684.371221:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872684.371227:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788872684.371229:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788872684.371231:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788872684.371258:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.371717:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872684.371751:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.371761:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9efac4200/0xe4e6e89fb01d9c53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9c5a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.371779:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872684.371782:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872684.371784:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872684.371794:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872684.371816:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327680384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872684.371855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872684.371944:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327680384 00000100:00100000:0.0:1788872684.371952:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327680384 00000100:00100000:0.0:1788872684.372017:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1788872684.372027:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327680384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872684.372042:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872684.372061:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01d9c5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c53 expref: 24 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872684.372098:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872684.372148:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3644:x1875765327680384:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872684.372155:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1788872684.372195:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327680384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872684.372278:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327680256 00000100:00100000:1.0:1788872684.372283:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327680256 00000100:00100000:1.0:1788872684.372324:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1788872684.372332:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875765327680256:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788872684.372353:0:83669:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9d6b 00000100:00080000:1.0:1788872684.372368:0:83669:0:(import.c:65:import_set_state_nolock()) ffff98aa002c6000 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1788872684.372406:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9df454380 x1875765327680256/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:610/0 lens 224/224 e 0 to 0 dl 1788872695 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872684.372447:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1875765327680256:12345-0@lo:39:umount.0 Request processed in 116us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872684.372454:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000020:00000080:1.0:1788872684.372475:0:83669:0:(genops.c:906:class_export_put()) final put ffff98aa002c0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788872684.372522:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa002c0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788872684.372597:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa002c6000 for lustre-MDT0000 00000100:00080000:0.0:1788872684.372732:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe90000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788872684.372750:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327680256:0@lo:39:umount.0 00000100:00080000:1.0:1788872684.372878:0:88380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788872684.372882:0:88380:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788872684.372887:0:88380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788872684.373615:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872684.375092:0:88380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375113:0:88380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375122:0:88380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375129:0:88380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375177:0:88380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872684.375184:0:88380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375191:0:88380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375197:0:88380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375203:0:88380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375221:0:88380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788872684.375227:0:88380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375233:0:88380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375238:0:88380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375244:0:88380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375257:0:88380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788872684.375262:0:88380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375274:0:88380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375280:0:88380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375285:0:88380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.375296:0:88380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788872684.375298:0:88380:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788872684.375330:0:88380:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788872684.375335:0:88380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1788872684.375339:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788872684.375345:0:88380:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000004:00000080:1.0:1788872684.377461:0:88380:0:(mdt_handler.c:8248:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1788872684.378013:0:87060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182412 is committed 00010000:00010000:1.0:1788872684.378048:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.378059:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.378067:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.378074:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872684.378091:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.378116:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.378135:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9d24aa500) 00010000:00010000:1.0:1788872684.378139:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872684.378144:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872684.378150:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da0d6 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788872684.378204:0:88380:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1788872684.378214:0:88380:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9ff639800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872684.378220:0:88380:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9ff60b800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872684.378224:0:88380:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9ff63a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872684.378228:0:88380:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9e99a0800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872684.378235:0:88380:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9e99a1000 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 192.168.204.39@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 107374182412 stale:0 00000020:00080000:1.0:1788872684.378241:0:88380:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff98a9e9b08000) has exports, disconnecting them 00000020:00080000:1.0:1788872684.378246:0:88380:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9ff639800), last request at 1788872645 00000020:00000080:1.0:1788872684.378254:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9d64 00000100:00080000:1.0:1788872684.378262:0:88380:0:(import.c:65:import_set_state_nolock()) ffff98a9ff63c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788872684.378277:0:88380:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9ff639800): rc 0 00000020:00000080:1.0:1788872684.378279:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9ff639800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788872684.378292:0:88380:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9ff60b800), last request at 1788872681 00000020:00000080:1.0:1788872684.378295:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9d5d 00000100:00080000:1.0:1788872684.378299:0:88380:0:(import.c:65:import_set_state_nolock()) ffff98a9df96b000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788872684.378317:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff639800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788872684.378356:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ff63c800 for lustre-MDT0000 00000020:00080000:1.0:1788872684.378370:0:88380:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9ff60b800): rc 0 00000020:00000080:1.0:1788872684.378372:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9ff60b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788872684.378378:0:88380:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9ff63a000), last request at 1788872681 00000020:00000080:1.0:1788872684.378381:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9d56 00000100:00080000:1.0:1788872684.378385:0:88380:0:(import.c:65:import_set_state_nolock()) ffff98a9ff63d000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788872684.378392:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff60b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788872684.378426:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9df96b000 for lustre-MDT0000 00000020:00080000:1.0:1788872684.378435:0:88380:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9ff63a000): rc 0 00000020:00000080:1.0:1788872684.378437:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9ff63a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788872684.378443:0:88380:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9e99a0800), last request at 1788872640 00000020:00000080:1.0:1788872684.378449:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9bc7 00000100:00080000:1.0:1788872684.378459:0:88380:0:(import.c:65:import_set_state_nolock()) ffff98a9c5f13000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788872684.378466:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff63a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788872684.378484:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ff63d000 for lustre-MDT0000 00000020:00080000:1.0:1788872684.378516:0:88380:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9e99a0800): rc 0 00000020:00000080:1.0:1788872684.378518:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9e99a0800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:1.0:1788872684.378525:0:88380:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.39@tcp (ffff98a9e99a1000), last request at 1788872681 00000020:00000080:1.0:1788872684.378528:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9bc0 00000020:00010000:1.0:1788872684.378534:0:88380:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9e99a1000: total 1 00000100:00080000:1.0:1788872684.378537:0:88380:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788872684.378545:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788872684.378590:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c5f13000 for lustre-MDT0000 00000020:00080000:1.0:1788872684.378604:0:88380:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a9e99a1000): rc 0 00000004:00000080:1.0:1788872684.378611:0:88380:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb002c1c9bae0 00000100:00080000:1.0:1788872684.378628:0:88380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788872684.378632:0:88380:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:0.0:1788872684.379165:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9e99a1000: total 0 00010000:00010000:0.0:1788872684.379224:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9e99a1000, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1788872684.379257:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01da0cf lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faee2 expref: 4 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872684.379279:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01d9fa9 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae95 expref: 3 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872684.379303:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01da0ba lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 2 pid: 66979 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872684.379319:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9e99a1000, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1788872684.382873:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788872684.382889:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.382903:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872684.382907:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.382918:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872684.382925:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872684.382931:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788872684.382933:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788872684.382937:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788872684.382980:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.382986:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872684.383010:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383018:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01d9b73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9b7a expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383035:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788872684.383039:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383061:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5c00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872684.383064:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383071:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872684.383077:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872684.383094:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788872684.383096:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788872684.383099:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788872684.383116:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383122:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872684.383129:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383135:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9efac5c00/0xe4e6e89fb01d9c76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9c7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383144:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788872684.383148:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383153:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872684.383157:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383170:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872684.383176:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872684.383181:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788872684.383183:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788872684.383185:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788872684.383201:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383207:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872684.383225:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383232:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9efac4600/0xe4e6e89fb01d9c45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9c4c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383241:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872684.383244:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383249:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872684.383252:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383258:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872684.383276:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872684.383281:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788872684.383283:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788872684.383285:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788872684.383304:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383310:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872684.383316:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383321:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01d9b65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01d9b6c expref: -99 pid: 87059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383330:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872684.383332:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872684.383334:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872684.383356:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327680896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872684.383443:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872684.383492:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872684.383499:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327680768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872684.383525:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872684.383582:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327680896 00000100:00100000:2.0:1788872684.383590:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327680896 00000100:00100000:2.0:1788872684.383634:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327680768 00000100:00100000:2.0:1788872684.383637:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327680768 00000100:00100000:2.0:1788872684.383661:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:2.0:1788872684.383676:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327680896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872684.383691:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872684.383707:0:26197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac5e00/0xe4e6e89fb01d9b6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9b65 expref: 24 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383720:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872684.383755:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3645:x1875765327680896:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872684.383761:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:2.0:1788872684.383808:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1788872684.383814:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3645:x1875765327680768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872684.383821:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872684.383830:0:26197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98ea00/0xe4e6e89fb01d9c4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c45 expref: 22 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872684.383837:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872684.383857:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3645:x1875765327680768:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872684.383863:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1788872684.383911:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327680768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872684.383920:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327680896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872684.384275:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872684.384288:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327680512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872684.384320:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872684.384346:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872684.384362:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327680640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872684.384387:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872684.384418:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327680512 00000100:00100000:3.0:1788872684.384422:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327680512 00000100:00100000:3.0:1788872684.384449:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327680640 00000100:00100000:3.0:1788872684.384452:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327680640 00000100:00100000:3.0:1788872684.384486:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1788872684.384492:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3646:x1875765327680512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872684.384499:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872684.384511:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5dea600/0xe4e6e89fb01d9b7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9b73 expref: 22 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.384523:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872684.384572:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3646:x1875765327680512:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872684.384579:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1788872684.384593:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1788872684.384598:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3646:x1875765327680640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872684.384607:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872684.384616:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5dea400/0xe4e6e89fb01d9c7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c76 expref: 20 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.384624:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872684.384646:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:3646:x1875765327680640:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872684.384652:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1788872684.384686:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327680640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872684.384694:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327680512:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788872684.387420:0:88380:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788872684.387458:0:88380:0:(import.c:65:import_set_state_nolock()) ffff98a9c8f4a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788872684.388796:0:88380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788872684.388801:0:88380:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 3 00000004:00080000:1.0:1788872684.388815:0:88380:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00080000:1.0:1788872684.390591:0:88380:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788872684.390629:0:88380:0:(import.c:65:import_set_state_nolock()) ffff98a8c36d1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788872684.390643:0:88380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788872684.390647:0:88380:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 3 00000004:00080000:1.0:1788872684.390669:0:88380:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872684.391608:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327681024:0@lo:39:umount.0 00000100:00100000:3.0:1788872684.391693:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872684.391730:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327681152:0@lo:9:umount.0 00000100:00100000:3.0:1788872684.391755:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872684.391800:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327681152 00000100:00100000:3.0:1788872684.391809:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327681152 00000100:00100000:3.0:1788872684.391886:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5952 00000100:00100000:3.0:1788872684.391897:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327681152:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788872684.391925:0:26183:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9c22 00000100:00080000:3.0:1788872684.391933:0:26183:0:(import.c:65:import_set_state_nolock()) ffff98a8c6773000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788872684.392093:0:88380:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788872684.392120:0:88380:0:(import.c:65:import_set_state_nolock()) ffff98a9f0832800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788872684.392176:0:88380:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98a9e9b08000) has no exports 00000001:00000004:3.0:1788872684.392221:0:26183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:3.0:1788872684.392368:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3643:x1875765327681152:12345-0@lo:9:umount.0 Request processed in 473us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872684.392376:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5952 00000100:00080000:3.0:1788872684.392398:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872684.392414:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327681280:0@lo:9:umount.0 00000100:00100000:3.0:1788872684.392440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872684.392603:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327681024 00000100:00100000:2.0:1788872684.392608:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327681024 00000100:00100000:2.0:1788872684.392641:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:2.0:1788872684.392648:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327681024:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788872684.392669:0:23717:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9bf8 00000100:00080000:2.0:1788872684.392690:0:23717:0:(import.c:65:import_set_state_nolock()) ffff98a9ef97b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788872684.392709:0:23717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411436 00000100:00100000:2.0:1788872684.392807:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3643:x1875765327681024:12345-0@lo:39:umount.0 Request processed in 160us (1114us total) trans 77309411437 rc 0/0 00000100:00100000:2.0:1788872684.392815:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00000100:00100000:1.0:1788872684.393277:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327681280 00000100:00100000:1.0:1788872684.393283:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327681280 00000100:00100000:1.0:1788872684.393329:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5953 00000100:00100000:1.0:1788872684.393337:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327681280:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788872684.393353:0:26190:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9c37 00000100:00080000:1.0:1788872684.393359:0:26190:0:(import.c:65:import_set_state_nolock()) ffff98aa002c7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788872684.393389:0:26190:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00000100:00080000:3.0:1788872684.393999:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9c8f4a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788872684.394008:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327681024:0@lo:39:umount.0 00000100:00080000:3.0:1788872684.394021:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c36d1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788872684.394033:0:3643:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:3.0:1788872684.394035:0:3643:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872684.394038:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327681152:0@lo:9:umount.0 00010000:00010000:3.0:1788872684.394070:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872684.394093:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788872684.394154:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872684.394648:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3643:x1875765327681280:12345-0@lo:9:umount.0 Request processed in 1309us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872684.394658:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5953 00000100:00080000:3.0:1788872684.396001:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9f0832800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788872684.396038:0:3643:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:3.0:1788872684.396041:0:3643:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872684.396046:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327681280:0@lo:9:umount.0 00000020:00080000:1.0:1788872684.396220:0:88380:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98a9e9b08000) has no exports 00010000:00010000:2.0:1788872684.397604:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788872684.427750:0:6509:0:(genops.c:906:class_export_put()) final put ffff98a9e99a1000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00010000:00010000:0.0:1788872684.428432:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872684.428436:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872684.428438:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788872684.431956:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a1000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-MDT0000 00000020:00000080:3.0:1788872684.432121:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c1f5a000 for lustre-MDT0000 00000020:00000080:1.0:1788872684.483484:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9bdc 00000020:00000080:1.0:1788872684.483503:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a8c2795800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788872684.483524:0:88380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788872684.483951:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c2795800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788872684.483975:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872684.483988:0:88380:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788872684.483992:0:88380:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98a9efa799c0) has no exports 00000020:00000080:3.0:1788872684.484445:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9bd5 00000020:00000080:3.0:1788872684.484452:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a8c37f7000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788872684.484500:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872684.484508:0:88380:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788872684.484511:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9c73c1800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788872684.484514:0:88380:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c73c1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788872684.484519:0:88380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788872684.485376:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c37f7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788872684.485765:0:88380:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9c5d23900 - data ffff98a8c2261e58/ffff98a8cc822800 00000020:01000000:3.0:1788872684.485916:0:88380:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9e951ba20 - data ffff98a8c2297360/ffff98a9e7793400 00000100:00080000:1.0:1788872684.557454:0:88380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788872684.557481:0:88380:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788872684.557496:0:88380:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98a9f9ec2d80 x1875765327681024/t77309411437(77309411437) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872694 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872684.557521:0:88380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788872684.560400:0:88380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788872684.560409:0:88380:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 4 00000004:00080000:1.0:1788872684.560429:0:88380:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872684.560432:0:88380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788872684.560829:0:87079:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788872684.560834:0:87079:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:2.0:1788872684.560847:0:87079:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:1.0:1788872684.562588:0:88380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788872684.562596:0:88380:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 4 00000004:00080000:1.0:1788872684.562609:0:88380:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872684.562611:0:88380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788872684.563143:0:87081:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788872684.563149:0:87081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:2.0:1788872684.563158:0:87081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:1.0:1788872684.564529:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9b8f 00000020:00000080:1.0:1788872684.564538:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a8c36d2000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788872684.564948:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c36d2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788872684.568218:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9ba4 00000020:00000080:1.0:1788872684.568234:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9e99a7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788872684.568254:0:88380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788872684.568261:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872684.568274:0:88380:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788872684.568278:0:88380:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff98a9e9b099c0) has no exports 00000004:01000000:1.0:1788872684.568632:0:88380:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788872684.568644:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9c29 00000020:00000080:1.0:1788872684.568650:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9ef0aa000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788872684.568655:0:88380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788872684.568659:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872684.568667:0:88380:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788872684.568670:0:88380:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff98a8c3408000) has no exports 00000020:00000080:1.0:1788872684.568676:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9c1b 00000020:00000080:1.0:1788872684.568681:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9f0833800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788872684.569201:0:88380:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788872684.569207:0:88380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788872684.569211:0:88380:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 5 00000004:00080000:1.0:1788872684.569235:0:88380:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872684.569238:0:88380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788872684.569273:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872684.569283:0:88380:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872684.569290:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9c0d 00000020:00000080:1.0:1788872684.569297:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9ef0a9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788872684.569301:0:88380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788872684.569305:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872684.569309:0:88380:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788872684.569312:0:88380:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff98a9efa7b380) has no exports 00000020:00000080:1.0:1788872684.569317:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9c06 00000020:00000080:1.0:1788872684.569320:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a8c67ee000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788872684.569592:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788872684.569602:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef0aa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788872684.569607:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f0833800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788872684.569611:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9f0832800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788872684.569616:0:86506:0:(genops.c:906:class_export_put()) final put ffff98a9ef0ad800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872684.569618:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef0ad800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788872684.569621:0:86506:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872684.569702:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef0a9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788872684.569707:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c67ee000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788872684.571221:0:88380:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788872684.571228:0:88380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788872684.571231:0:88380:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 5 00000004:00080000:1.0:1788872684.571239:0:88380:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872684.571241:0:88380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788872684.571283:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872684.571294:0:88380:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788872684.571308:0:88380:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788872684.571315:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9bf1 00000020:00000080:1.0:1788872684.571323:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a8c67ea800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788872684.571329:0:88380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788872684.571334:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872684.571339:0:88380:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788872684.571343:0:88380:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff98a8c72ecd40) has no exports 00000020:00000080:1.0:1788872684.571350:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9bea 00000020:00000080:1.0:1788872684.571353:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a8c3bcb000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788872684.572519:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c36d1000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788872684.572571:0:86506:0:(genops.c:906:class_export_put()) final put ffff98a9f0836800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872684.572575:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f0836800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788872684.572582:0:86506:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872684.572672:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c67ea800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788872684.572679:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c3bcb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788872684.574646:0:88380:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788872684.574653:0:88380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788872684.574658:0:88380:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788872684.574666:0:88380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788872684.574726:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872684.574741:0:88380:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872684.574780:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872684.574785:0:88380:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872684.574791:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a8c3109000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788872684.574795:0:88380:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c3109000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788872684.574802:0:88380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872684.574914:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9bab 00000020:00000080:2.0:1788872684.574922:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9e99a4800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788872684.574927:0:88380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788872684.574931:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872684.574937:0:88380:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788872684.574940:0:88380:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff98a8c340b380) has no exports 00000020:00000080:2.0:1788872684.574971:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872684.574976:0:88380:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788872684.574980:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9bb2 00000020:00000080:2.0:1788872684.574984:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9e99a5000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788872684.574991:0:88380:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9f6655000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788872684.574994:0:88380:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9f6655000 3 00000020:01000004:2.0:1788872684.574997:0:88380:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a9f6655000 from lustre-MDT0000 00000020:00000080:2.0:1788872684.575018:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872684.575022:0:88380:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788872684.575025:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a8c36d2800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788872684.575027:0:88380:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c36d2800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788872684.575034:0:88380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788872684.575071:0:88380:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788872684.575074:0:88380:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788872684.575087:0:88380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788872684.575090:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872684.575093:0:88380:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788872684.575102:0:88380:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98a8c394c000 8a09bb38-f574-4ce9-b65f-ec6facc58f7e 192.168.204.39@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788872684.575108:0:88380:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98a9c5f10800 f2e885a0-f180-4b85-9f87-6a01e20afd1a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788872684.575111:0:88380:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff98a9e9b0cd40) has exports, disconnecting them 00000020:00080000:2.0:1788872684.575115:0:88380:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.39@tcp (ffff98a8c394c000), last request at 1788872639 00000020:00000080:2.0:1788872684.575137:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9b57 00000020:00010000:2.0:1788872684.575142:0:88380:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a8c394c000: total 2 00000100:00080000:2.0:1788872684.575145:0:88380:0:(import.c:65:import_set_state_nolock()) ffff98a8c394d000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788872684.575158:0:88380:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a8c394c000): rc 0 00000020:00080000:2.0:1788872684.575162:0:88380:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98a9c5f10800), last request at 1788872639 00000020:00000080:2.0:1788872684.575210:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9b50 00000020:00010000:2.0:1788872684.575213:0:88380:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9c5f10800: total 2 00000100:00080000:2.0:1788872684.575216:0:88380:0:(import.c:65:import_set_state_nolock()) ffff98a9c5f15800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788872684.575224:0:88380:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9c5f10800): rc 0 00000020:00080000:2.0:1788872684.575234:0:88380:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff98a9e9b0cd40) has no exports 00000100:00100000:2.0:1788872684.575295:0:87071:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff98a8c33ac800:87071] 4 exiting: rc = 0 00000100:00100000:2.0:1788872684.575395:0:87072:0:(service.c:3183:ptlrpc_main()) ll_mgs_0005: service thread [ffff98a8c33ad600:87072] 5 exiting: rc = 0 00000100:00100000:2.0:1788872684.575455:0:87066:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98a8c4f33a00:87066] 1 exiting: rc = 0 00000020:00010000:3.0:1788872684.575647:0:14981:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a8c394c000: total 2 00010000:00010000:3.0:1788872684.575688:0:14981:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a8c394c000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1788872684.575722:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01d9d3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae72 expref: 5 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575738:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01d9d48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae80 expref: 4 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575753:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01d9d41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae79 expref: 3 pid: 87067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575764:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98e200/0xe4e6e89fb01d9d4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fae87 expref: 2 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575772:0:14981:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a8c394c000, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1788872684.575790:0:14981:0:(genops.c:906:class_export_put()) final put ffff98a8c394c000/8a09bb38-f574-4ce9-b65f-ec6facc58f7e 00000020:00010000:3.0:1788872684.575795:0:14981:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9c5f10800: total 3 00010000:00010000:3.0:1788872684.575798:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872684.575814:0:14981:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9c5f10800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788872684.575829:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5deaa00/0xe4e6e89fb01d9cd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cca expref: 14 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575840:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5deac00/0xe4e6e89fb01d9cb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cae expref: 13 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575884:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac5a00/0xe4e6e89fb01d9d33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9d2c expref: 12 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575896:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac5800/0xe4e6e89fb01d9cc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cbc expref: 11 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575908:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5deba00/0xe4e6e89fb01d9cdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cd8 expref: 10 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575919:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac4400/0xe4e6e89fb01d9ced lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9ce6 expref: 9 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575931:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98f000/0xe4e6e89fb01d9cfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9cf4 expref: 8 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575942:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01d9c8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c84 expref: 7 pid: 87071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575953:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac4e00/0xe4e6e89fb01d9d09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9d02 expref: 6 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575963:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01d9d17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9d10 expref: 5 pid: 87064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575974:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01d9ca7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9ca0 expref: 4 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.575985:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01d9d25 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9d1e expref: 3 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.576010:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01d9c99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01d9c92 expref: 2 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872684.576019:0:14981:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9c5f10800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788872684.576034:0:14981:0:(genops.c:906:class_export_put()) final put ffff98a9c5f10800/f2e885a0-f180-4b85-9f87-6a01e20afd1a 00010000:00010000:3.0:1788872684.576039:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872684.576041:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872684.576043:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872684.576051:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788872684.576059:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c8f4a000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788872684.576066:0:86506:0:(genops.c:906:class_export_put()) final put ffff98a8c67e9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872684.576068:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c67e9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788872684.576086:0:86506:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872684.576129:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788872684.576133:0:86506:0:(genops.c:906:class_export_put()) final put ffff98a8c36d5000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788872684.576135:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c36d5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788872684.576140:0:86506:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788872684.576165:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788872684.576169:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c394c000/8a09bb38-f574-4ce9-b65f-ec6facc58f7e for MGS 00000020:00000080:3.0:1788872684.576192:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c5f10800/f2e885a0-f180-4b85-9f87-6a01e20afd1a for MGS 00000020:00000080:3.0:1788872684.576204:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c394d000 for MGS 00000020:00000080:3.0:1788872684.576207:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c5f15800 for MGS 00000100:00100000:2.0:1788872684.578650:0:87067:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98a8c5d47200:87067] 2 exiting: rc = 0 00000100:00100000:2.0:1788872684.578768:0:87070:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff98aa002eec00:87070] 3 exiting: rc = 0 00000100:00100000:1.0:1788872684.626815:0:87064:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98a9ef284000:87064] 0 exiting: rc = 1 00000100:00100000:3.0:1788872684.627199:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627209:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627215:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627221:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627226:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627231:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627252:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627258:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627264:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627270:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627276:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627283:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627289:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627294:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627306:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627313:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627319:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627325:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627331:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627337:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627341:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627347:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627352:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627358:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627363:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627369:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627374:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627379:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627385:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627391:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627397:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627403:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627410:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627416:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627422:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627428:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627434:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627440:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627446:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627452:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627457:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627471:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627476:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627482:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627487:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627493:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627499:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627504:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627510:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627514:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627520:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627525:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627531:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627535:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627540:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627545:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627627:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627633:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627638:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627644:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627649:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627655:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627660:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872684.627668:0:88380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788872684.628838:0:88380:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9d0dca0c0 - data ffff98a9e91babd0/ffff98a8c3922000 00000020:01000000:3.0:1788872684.628966:0:88380:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9fa58d480 - data ffff98a9e91ca360/ffff98a8c371ec00 00000020:00000080:3.0:1788872684.629438:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9b49 00000020:00000080:3.0:1788872684.629447:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a8c3949000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788872684.629508:0:88380:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9f6655000 from MGS, refs=2 00000020:01000004:3.0:1788872684.629512:0:88380:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9f6655000 2 00000020:01000004:3.0:1788872684.629516:0:88380:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a9f6655000 from MGS 00000020:00000080:3.0:1788872684.629537:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872684.629546:0:88380:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788872684.629575:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a8c394b800/MGS 00000020:00000080:3.0:1788872684.629579:0:88380:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c394b800/MGS for MGS 00000020:01000000:3.0:1788872684.629585:0:88380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788872684.629671:0:88380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788872684.629675:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872684.629684:0:88380:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788872684.629692:0:88380:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98a9dfe97000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788872684.629698:0:88380:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff98a9fa793380) has exports, disconnecting them 00000020:00080000:3.0:1788872684.629703:0:88380:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98a9dfe97000), last request at 1788872640 00000020:00000080:3.0:1788872684.629707:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9c68 00000020:00080000:3.0:1788872684.629718:0:88380:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9dfe97000): rc 0 00000020:00000080:3.0:1788872684.629722:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9dfe97000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788872684.632729:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c3949000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788872684.639205:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9dfe97000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788872684.665600:0:88380:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788872684.665609:0:88380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788872684.665614:0:88380:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788872684.665621:0:88380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788872684.665783:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872684.665798:0:88380:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788872684.665806:0:88380:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9f6655000 1 00000020:00000080:2.0:1788872684.665812:0:88380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9b3b 00000020:00000080:2.0:1788872684.665822:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a8c3948000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788872684.665827:0:88380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788872684.665832:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872684.665836:0:88380:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788872684.665839:0:88380:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff98a9efa78000) has no exports 00000020:00000080:1.0:1788872684.668381:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9dfe90000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788872684.668411:0:52416:0:(genops.c:906:class_export_put()) final put ffff98a9ef256800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788872684.668415:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef256800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788872684.668428:0:52416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788872684.668523:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c3948000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788872684.781706:0:88380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872684.781721:0:88380:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788872684.781727:0:88380:0:(genops.c:906:class_export_put()) final put ffff98a9c4c3d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788872684.781732:0:88380:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c4c3d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788872684.781743:0:88380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788872684.781865:0:88380:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98a9f6653800 00000020:02000400:3.0:1788872684.781941:0:88380:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788872684.837356:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872685.240909:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327681408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872685.241003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872685.241062:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872685.241079:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327681536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872685.241104:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872685.241179:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327681408 00000100:00100000:1.0:1788872685.241187:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327681408 00000100:00100000:1.0:1788872685.241248:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327681536 00000100:00100000:1.0:1788872685.241252:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327681536 00000100:00100000:1.0:1788872685.241281:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:1.0:1788872685.241290:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327681408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872685.241321:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872685.241371:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327681408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872685.241379:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:1.0:1788872685.241399:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:1.0:1788872685.241406:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327681536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872685.241420:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872685.241449:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327681536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872685.241456:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00080000:3.0:1788872685.242578:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872685.242587:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872685.242713:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327681536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872685.242729:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327681408:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788872685.884924:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872686.265211:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327681664:0@lo:400:kworker.0 00000400:00000100:1.0:1788872686.265293:0:3644:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327681664 offset 0 length 224: 4 00000100:00100000:1.0:1788872686.265339:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327682176:0@lo:400:kworker.0 00000100:00100000:1.0:1788872686.265376:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872686.265412:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327682688:0@lo:400:kworker.0 00000100:00100000:1.0:1788872686.265480:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872686.265509:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788872686.265514:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327681792:0@lo:400:kworker.0 00000100:00100000:1.0:1788872686.265535:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872686.265577:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327682304:0@lo:400:kworker.0 00000100:00100000:1.0:1788872686.265604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872686.265635:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327682176 00000100:00100000:1.0:1788872686.265643:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327682176 00000100:00100000:1.0:1788872686.265712:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327682688 00000100:00100000:1.0:1788872686.265715:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327682688 00000100:00100000:1.0:1788872686.265729:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327681792 00000100:00100000:1.0:1788872686.265731:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327681792 00000100:00100000:1.0:1788872686.265750:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1788872686.265761:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327682176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872686.266061:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327682176:12345-0@lo:400:kworker.0 Request processed in 301us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872686.266069:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1788872686.266093:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1788872686.266097:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875765327682688:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788872686.266103:0:66190:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788872686.266129:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875765327682688:12345-0@lo:400:kworker.0 Request processed in 31us (648us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788872686.266135:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1788872686.266147:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:1.0:1788872686.266151:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875765327681792:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788872686.266155:0:66190:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788872686.266172:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875765327681792:12345-0@lo:400:kworker.0 Request processed in 20us (636us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788872686.266185:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00080000:1.0:1788872686.266231:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788872686.266237:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788872686.266241:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788872686.266248:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872686.266261:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3582 00000100:00080000:1.0:1788872686.266267:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872686.266294:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f9ec1c00 x1875765327682816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872686.266315:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327681792:0@lo:400:kworker.0 00000100:00100000:1.0:1788872686.266332:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327682176:0@lo:400:kworker.0 00000100:00080000:1.0:1788872686.266353:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788872686.266356:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788872686.266359:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788872686.266362:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872686.266365:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3582 00000100:00080000:1.0:1788872686.266370:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872686.266381:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f9ec0380 x1875765327682944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872686.266392:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327682688:0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.266689:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327681920:0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.266736:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872686.266762:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327682432:0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.266784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872686.266815:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788872686.266822:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327682048:0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.266851:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872686.266867:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327682560:0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.266886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872686.266916:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327681920 00000100:00100000:3.0:1788872686.266920:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327681920 00000100:00100000:3.0:1788872686.266953:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327682048 00000100:00100000:3.0:1788872686.266955:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327682048 00000100:00100000:3.0:1788872686.266968:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1788872686.266975:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327681920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.267012:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327681920:12345-0@lo:400:kworker.0 Request processed in 38us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872686.267018:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1788872686.267031:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1788872686.267034:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875765327682048:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788872686.267039:0:66193:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788872686.267077:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875765327682048:12345-0@lo:400:kworker.0 Request processed in 41us (225us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788872686.267082:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1788872686.267101:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327682304 00000100:00100000:3.0:1788872686.267104:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327682304 00000100:00100000:3.0:1788872686.267127:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:3.0:1788872686.267131:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1875765327682304:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788872686.267143:0:8446:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788872686.267168:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1875765327682304:12345-0@lo:400:kworker.0 Request processed in 36us (1563us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788872686.267174:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00000100:00080000:3.0:1788872686.267190:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872686.267202:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327682816:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788872686.267225:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872686.267241:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327682944:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788872686.267257:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872686.267283:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327682432 00000100:00100000:3.0:1788872686.267287:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327682432 00000100:00100000:3.0:1788872686.267309:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327682560 00000100:00100000:3.0:1788872686.267311:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327682560 00000100:00100000:3.0:1788872686.267328:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523 00000100:00100000:3.0:1788872686.267335:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327682432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.267363:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327682432:12345-0@lo:400:kworker.0 Request processed in 29us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872686.267369:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523 00000100:00100000:3.0:1788872686.267378:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:3.0:1788872686.267383:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327682560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.267404:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327682560:12345-0@lo:400:kworker.0 Request processed in 20us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872686.267409:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:3.0:1788872686.267436:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327682816 00000100:00100000:3.0:1788872686.267440:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327682816 00000100:00100000:3.0:1788872686.267450:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327682944 00000100:00100000:3.0:1788872686.267452:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327682944 00000100:00100000:3.0:1788872686.267490:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1788872686.267494:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327682816:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788872686.267515:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872686.267546:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327682816:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 50us (320us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872686.267580:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1788872686.267591:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1788872686.267595:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327682944:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788872686.267604:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872686.267635:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327682944:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 39us (377us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872686.267640:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00080000:3.0:1788872686.267678:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872686.267682:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872686.267686:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327682816:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788872686.267693:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872686.267696:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872686.267699:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327682944:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788872686.267726:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788872686.267729:0:3646:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788872686.267733:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788872686.267737:0:3646:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872686.267741:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3582 00000100:00080000:3.0:1788872686.267746:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872686.267774:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c49f8000 x1875765327683072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872686.267792:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327682048:0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.267805:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327682560:0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.267815:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327681920:0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.267824:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327682432:0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.267845:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327683072:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788872686.267866:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872686.267885:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327683072 00000100:00100000:3.0:1788872686.267888:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327683072 00000100:00100000:3.0:1788872686.267903:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1788872686.267907:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327683072:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788872686.267916:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872686.267939:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327683072:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 31us (73us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872686.267945:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00080000:3.0:1788872686.267962:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872686.267966:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872686.267968:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327683072:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788872686.268809:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788872686.268816:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788872686.271699:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788872686.271711:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872686.271718:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3582 00000100:00080000:1.0:1788872686.271731:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872686.271786:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f9ec0380 x1875765327683200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872686.272743:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327683200:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788872686.272869:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872686.273082:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327682304:0@lo:400:kworker.0 00000100:00100000:3.0:1788872686.273790:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327683200 00000100:00100000:3.0:1788872686.273802:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327683200 00000100:00100000:3.0:1788872686.273872:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:3.0:1788872686.273882:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327683200:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788872686.273927:0:23717:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872686.274008:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327683200:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 126us (1138us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872686.274017:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00080000:0.0:1788872686.274176:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872686.274182:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872686.274187:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327683200:0@lo:38:ptlrpcd_00_00.0 00000400:00000100:1.0:1788872686.873808:0:3637:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311157888 offset 0 length 224: 4 00000100:00100000:1.0:1788872686.873860:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872686.873894:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872686.873912:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872686.873992:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872686.874044:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311158144 00000100:00100000:1.0:1788872686.874054:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311158144 00000100:00100000:1.0:1788872686.874130:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311158016 00000100:00100000:1.0:1788872686.874133:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311158016 00000100:00100000:1.0:1788872686.874151:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1190 00000100:00100000:1.0:1788872686.874160:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311158144:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872686.874230:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311158144:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 71us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872686.874237:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1190 00000100:00100000:1.0:1788872686.874253:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1173 00000100:00100000:1.0:1788872686.874257:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2404:x1875765311158016:12345-192.168.204.39@tcp:400:kworker.0 00000020:00080000:1.0:1788872686.874263:0:66192:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.39@tcp 00000100:00100000:1.0:1788872686.874283:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2404:x1875765311158016:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 24us (370us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788872686.874298:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1173 00000100:00100000:0.0:1788872686.875275:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311158400 00000100:00100000:0.0:1788872686.875286:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311158400 00000100:00100000:0.0:1788872686.875329:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311158272 00000100:00100000:0.0:1788872686.875331:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311158272 00000100:00100000:0.0:1788872686.875354:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2525 00000100:00100000:0.0:1788872686.875361:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311158400:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872686.875410:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311158400:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 49us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872686.875416:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2525 00000100:00100000:0.0:1788872686.875432:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2526 00000100:00100000:0.0:1788872686.875437:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311158272:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872686.875456:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311158272:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 20us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872686.875461:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2526 00000100:00080000:0.0:1788872686.877000:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872686.877010:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872686.877014:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872686.881467:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872686.885110:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311158528 00000100:00100000:3.0:1788872686.885124:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311158528 00000100:00100000:3.0:1788872686.885181:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1174 00000100:00100000:3.0:1788872686.885190:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311158528:12345-192.168.204.39@tcp:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788872686.885214:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872686.885393:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311158528:12345-192.168.204.39@tcp:38:ptlrpcd_00_00.0 Request processed in 202us (3934us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872686.885402:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1174 00010000:00010000:3.0:1788872686.907399:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872687.928787:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872688.954171:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788872689.855508:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872689.855523:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a8c6775000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872689.855951:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c6775000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788872689.856033:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c6773000 for lustre-OST0000 00000001:00100000:0.0:1788872689.858315:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872689.858327:0:9516:0:(genops.c:906:class_export_put()) final put ffff98aa002c7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872689.858529:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa002c7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788872689.858638:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa002c7800 for lustre-OST0001 00000001:00100000:2.0:1788872689.861639:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788872689.861662:0:75620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411437 is committed 00000020:00000080:2.0:1788872689.861669:0:75620:0:(genops.c:906:class_export_put()) final put ffff98a9ef979800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872689.866172:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef979800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788872689.870513:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ef97b800 for lustre-MDT0001 00010000:00010000:0.0:1788872689.977586:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872690.368503:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327683328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872690.368711:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872690.374168:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327683328 00000100:00100000:0.0:1788872690.374190:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327683328 00000100:00100000:0.0:1788872690.374302:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:0.0:1788872690.374317:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327683328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872690.374364:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872690.374503:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327683328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 189us (5791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872690.374512:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:3.0:1788872690.382152:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327683456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872690.382282:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872690.382454:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327683328:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788872690.386187:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872690.386236:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327683456 00000100:00100000:1.0:1788872690.386253:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327683456 00000100:00100000:1.0:1788872690.386382:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1788872690.386396:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327683456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872690.386447:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872690.386622:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327683456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 229us (4339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872690.386630:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00080000:3.0:1788872690.399306:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872690.400805:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327683456:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788872691.001776:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872691.386680:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1788872691.387176:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872691.387183:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872691.387188:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872691.387199:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3623 00000100:00080000:0.0:1788872691.387206:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788872691.387215:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872691.387262:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff7f1880 x1875765327683712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872691.388102:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872691.388110:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872691.388113:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872691.388119:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3623 00000100:00080000:0.0:1788872691.388123:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788872691.388129:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872691.388154:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff7f1180 x1875765327683968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872691.388200:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872691.388204:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872691.388205:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872691.388209:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3623 00000100:00080000:0.0:1788872691.388211:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788872691.388215:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872691.388225:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a40380 x1875765327684224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872691.388485:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327683840:0@lo:400:kworker.0 00000100:00100000:2.0:1788872691.388607:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872691.388658:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872691.388664:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327684096:0@lo:400:kworker.0 00000100:00100000:2.0:1788872691.388689:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872691.388734:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327683840 00000100:00100000:2.0:1788872691.388744:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327683840 00000100:00100000:2.0:1788872691.388824:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327684096 00000100:00100000:2.0:1788872691.388827:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327684096 00000100:00100000:2.0:1788872691.388854:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1788872691.388864:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327683840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872691.388924:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327683840:12345-0@lo:400:kworker.0 Request processed in 61us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872691.388931:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1788872691.390341:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1788872691.390366:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327684096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872691.390446:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327684096:12345-0@lo:400:kworker.0 Request processed in 92us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872691.390454:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1788872691.390785:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327684096:0@lo:400:kworker.0 00000100:00100000:2.0:1788872691.390802:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327683840:0@lo:400:kworker.0 00000100:00100000:3.0:1788872691.391298:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327683712:0@lo:38:kworker.0 00000100:00100000:3.0:1788872691.391387:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872691.391657:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327683968:0@lo:38:kworker.0 00000100:00100000:3.0:1788872691.391686:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872691.391712:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327684224:0@lo:38:kworker.0 00000100:00100000:3.0:1788872691.391743:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872691.391788:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327683712 00000100:00100000:3.0:1788872691.391795:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327683712 00000100:00100000:3.0:1788872691.391830:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327683968 00000100:00100000:3.0:1788872691.391832:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327683968 00000100:00100000:3.0:1788872691.391846:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:3.0:1788872691.391851:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327683712:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872691.391875:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872691.391915:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327683712:12345-0@lo:38:kworker.0 Request processed in 63us (529us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872691.391922:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:3.0:1788872691.391936:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:3.0:1788872691.391939:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327683968:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872691.392089:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872691.392117:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327683968:12345-0@lo:38:kworker.0 Request processed in 176us (430us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872691.392123:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:3.0:1788872691.392145:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327684224 00000100:00100000:3.0:1788872691.392148:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327684224 00000100:00100000:3.0:1788872691.392170:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:3.0:1788872691.392174:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327684224:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872691.392184:0:8446:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872691.392220:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327684224:12345-0@lo:38:kworker.0 Request processed in 44us (476us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872691.392227:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00080000:3.0:1788872691.392248:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872691.392277:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872691.392282:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872691.392286:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327683712:0@lo:38:kworker.0 00000100:00080000:3.0:1788872691.392294:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872691.392297:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872691.392300:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327683968:0@lo:38:kworker.0 00000100:00080000:3.0:1788872691.392307:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872691.392310:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872691.392312:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327684224:0@lo:38:kworker.0 00000100:00100000:3.0:1788872691.393145:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872691.393253:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327683584:0@lo:400:kworker.0 00000400:00000100:1.0:1788872691.393304:0:3646:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327683584 offset 0 length 224: 4 00000100:00100000:3.0:1788872691.393828:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327684480:0@lo:400:kworker.0 00000100:00100000:3.0:1788872691.393878:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788872691.394027:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872691.394033:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872691.394038:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872691.394045:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3623 00000100:00080000:0.0:1788872691.394051:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788872691.394058:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872691.394088:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a41c00 x1875765327684608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872691.394131:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327684608:0@lo:38:kworker.0 00000100:00100000:0.0:1788872691.394165:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872691.394365:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327684608 00000100:00100000:0.0:1788872691.394373:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327684608 00000100:00100000:0.0:1788872691.394419:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1788872691.394427:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327684608:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872691.394451:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872691.394518:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327684608:12345-0@lo:38:kworker.0 Request processed in 91us (351us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872691.394526:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00080000:0.0:1788872691.394913:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872691.394919:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872691.394923:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327684608:0@lo:38:kworker.0 00000100:00100000:3.0:1788872691.395110:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327684352:0@lo:400:kworker.0 00000100:00100000:3.0:1788872691.395143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872691.395786:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327684480 00000100:00100000:2.0:1788872691.395795:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327684480 00000100:00100000:2.0:1788872691.395853:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327684352 00000100:00100000:2.0:1788872691.395856:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327684352 00000100:00100000:2.0:1788872691.396011:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:2.0:1788872691.396022:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327684480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872691.396096:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327684480:12345-0@lo:400:kworker.0 Request processed in 77us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872691.396103:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:2.0:1788872691.396122:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:2.0:1788872691.396128:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327684352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872691.396157:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327684352:12345-0@lo:400:kworker.0 Request processed in 30us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872691.396428:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00100000:1.0:1788872691.396536:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327684480:0@lo:400:kworker.0 00000100:00100000:1.0:1788872691.396546:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327684352:0@lo:400:kworker.0 00000400:00000100:3.0:1788872691.985323:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311158912 offset 0 length 224: 4 00000100:00100000:3.0:1788872691.985380:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872691.985428:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872691.985671:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311159040 00000100:00100000:2.0:1788872691.985680:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311159040 00000100:00100000:2.0:1788872691.985745:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311159168 00000100:00100000:2.0:1788872691.985748:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311159168 00000100:00100000:2.0:1788872691.985801:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1193 00000100:00100000:2.0:1788872691.985810:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311159168:12345-192.168.204.39@tcp:400:kworker.0 00000100:00080000:0.0:1788872691.985843:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872691.985896:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311159168:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 85us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872691.985913:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1178 00000100:00100000:0.0:1788872691.985926:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875765311159040:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:0.0:1788872691.985973:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872691.986045:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875765311159040:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 119us (664us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872691.987681:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1193 00000100:00100000:0.0:1788872691.990039:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1178 00000100:00100000:3.0:1788872691.994062:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872691.994107:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872691.994197:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311159296 00000100:00100000:1.0:1788872691.994207:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311159296 00000100:00100000:1.0:1788872691.994285:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311159424 00000100:00100000:1.0:1788872691.994289:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311159424 00000100:00100000:1.0:1788872691.994319:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5954 00000100:00100000:1.0:1788872691.994329:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2403:x1875765311159296:12345-192.168.204.39@tcp:9:kworker.0 00000020:00000080:1.0:1788872691.994376:0:26199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9f86 00000100:00080000:1.0:1788872691.994385:0:26199:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788872691.994427:0:26199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:1.0:1788872691.994697:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+2:2403:x1875765311159296:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 368us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872691.994705:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5954 00000100:00100000:1.0:1788872691.994735:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5955 00000100:00100000:1.0:1788872691.994742:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2403:x1875765311159424:12345-192.168.204.39@tcp:9:kworker.0 00000020:00000080:1.0:1788872691.994755:0:26199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d9f8d 00000100:00080000:1.0:1788872691.994761:0:26199:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788872691.994782:0:26199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:1.0:1788872691.994862:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+2:2403:x1875765311159424:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 119us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872691.994869:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5955 00010000:00010000:3.0:1788872691.995006:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872691.995013:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788872691.995132:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872691.995137:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788872692.025908:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872693.053818:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872694.075181:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872695.101981:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872695.481705:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872695.481733:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327684736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872695.481804:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872695.482098:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872695.482109:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327684864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872695.482141:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872695.482201:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327684736 00000100:00100000:1.0:1788872695.482211:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327684736 00000100:00100000:0.0:1788872695.482229:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327684864 00000100:00100000:0.0:1788872695.482235:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327684864 00000100:00080000:2.0:1788872695.482292:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872695.482296:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872695.482344:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:0.0:1788872695.482354:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327684864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872695.482384:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872695.482440:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327684864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872695.482447:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1788872695.482524:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327684864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872695.496343:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1788872695.496366:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327684736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872695.496401:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872695.496485:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327684736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (14681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872695.496491:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:3.0:1788872695.496757:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327684736:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788872696.121477:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788872696.504865:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872696.504873:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872696.504890:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872696.504898:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3628 00000100:00080000:0.0:1788872696.504905:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788872696.504912:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872696.504937:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a41c00 x1875765327685120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872696.504972:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872696.504976:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872696.504977:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872696.504990:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3628 00000100:00080000:0.0:1788872696.504998:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788872696.505002:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872696.505013:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a41500 x1875765327685376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872696.505034:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872696.505038:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872696.505039:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872696.505043:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3628 00000100:00080000:0.0:1788872696.505045:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788872696.505049:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872696.505062:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a42680 x1875765327685632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872696.505083:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872696.505087:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872696.505093:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872696.505097:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3628 00000100:00080000:0.0:1788872696.505099:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788872696.505103:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872696.505115:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1eed500 x1875765327686016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872696.505442:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327685120:0@lo:38:kworker.0 00000100:00100000:2.0:1788872696.505509:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872696.505570:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327685376:0@lo:38:kworker.0 00000100:00100000:2.0:1788872696.505593:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872696.505609:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327685632:0@lo:38:kworker.0 00000100:00100000:2.0:1788872696.505633:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872696.505652:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327686016:0@lo:38:kworker.0 00000100:00100000:2.0:1788872696.505673:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872696.505707:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327685632 00000100:00100000:2.0:1788872696.505721:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327685632 00000100:00100000:2.0:1788872696.505755:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:2.0:1788872696.505763:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327685632:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872696.505783:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872696.505826:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327685632:12345-0@lo:38:kworker.0 Request processed in 63us (192us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872696.505834:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00100000:2.0:1788872696.505870:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327685504:0@lo:400:kworker.0 00000100:00100000:2.0:1788872696.505896:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872696.505916:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872696.505922:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327685760:0@lo:400:kworker.0 00000100:00100000:2.0:1788872696.505944:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872696.505967:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327685120 00000100:00100000:2.0:1788872696.505971:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327685120 00000100:00100000:2.0:1788872696.506257:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327685376 00000100:00100000:2.0:1788872696.506261:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327685376 00000100:00100000:2.0:1788872696.506275:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327686016 00000100:00100000:2.0:1788872696.506277:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327686016 00000100:00100000:2.0:1788872696.506284:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327685504 00000100:00100000:2.0:1788872696.506286:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327685504 00000100:00100000:1.0:1788872696.506465:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327684992:0@lo:400:kworker.0 00000400:00000100:1.0:1788872696.506494:0:3646:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327684992 offset 0 length 224: 4 00000100:00100000:1.0:1788872696.506520:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327685888:0@lo:400:kworker.0 00000100:00100000:1.0:1788872696.506579:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872696.506601:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872696.506607:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327685248:0@lo:400:kworker.0 00000100:00100000:1.0:1788872696.506631:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872696.506667:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327685248 00000100:00100000:1.0:1788872696.506671:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327685248 00000100:00100000:1.0:1788872696.506694:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1788872696.506702:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327685248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872696.506746:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327685248:12345-0@lo:400:kworker.0 Request processed in 44us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872696.506751:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1788872696.506768:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1788872696.506772:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327685120:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872696.506784:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872696.506808:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327685120:12345-0@lo:38:kworker.0 Request processed in 35us (1299us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872696.506813:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1788872696.506823:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1788872696.506826:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327685376:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872696.506833:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872696.506862:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327685376:12345-0@lo:38:kworker.0 Request processed in 24us (1258us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872696.506868:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1788872696.506880:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1788872696.506883:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327686016:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872696.506901:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872696.506925:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327686016:12345-0@lo:38:kworker.0 Request processed in 40us (1251us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872696.506931:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1788872696.506963:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327685248:0@lo:400:kworker.0 00000100:00100000:2.0:1788872696.507280:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1788872696.507289:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327685504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872696.507486:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327685760 00000100:00100000:3.0:1788872696.507492:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327685760 00000100:00100000:2.0:1788872696.507562:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327685504:12345-0@lo:400:kworker.0 Request processed in 261us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872696.507570:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00080000:2.0:1788872696.507588:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872696.507610:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327685504:0@lo:400:kworker.0 00000100:00100000:2.0:1788872696.507647:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327685888 00000100:00100000:2.0:1788872696.507661:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327685888 00000100:00080000:0.0:1788872696.507757:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872696.507764:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872696.507767:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327685120:0@lo:38:kworker.0 00000100:00080000:0.0:1788872696.507776:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872696.507780:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872696.507783:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327685376:0@lo:38:kworker.0 00000100:00080000:0.0:1788872696.507792:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872696.507795:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872696.507798:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327685632:0@lo:38:kworker.0 00000100:00080000:0.0:1788872696.507807:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872696.507809:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872696.507812:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327686016:0@lo:38:kworker.0 00000100:00100000:3.0:1788872696.513371:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:3.0:1788872696.513395:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327685760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872696.513564:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327685760:12345-0@lo:400:kworker.0 Request processed in 165us (7602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872696.513573:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:0.0:1788872696.513701:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327685760:0@lo:400:kworker.0 00000100:00100000:2.0:1788872696.515339:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:2.0:1788872696.515360:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327685888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872696.515445:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327685888:12345-0@lo:400:kworker.0 Request processed in 96us (8864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872696.515451:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:1.0:1788872696.516064:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327685888:0@lo:400:kworker.0 00000100:00100000:1.0:1788872697.099867:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000400:00000100:1.0:1788872697.099907:0:3637:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311159552 offset 0 length 224: 4 00000100:00100000:3.0:1788872697.100826:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311159680 00000100:00100000:3.0:1788872697.100839:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311159680 00000100:00100000:3.0:1788872697.100910:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1182 00000100:00100000:3.0:1788872697.100918:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875765311159680:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:3.0:1788872697.100944:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872697.101013:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875765311159680:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 94us (1184us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872697.101020:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1182 00000100:00100000:3.0:1788872697.106032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872697.106152:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311159808 00000100:00100000:0.0:1788872697.106175:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311159808 00000100:00100000:0.0:1788872697.106265:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1196 00000100:00100000:0.0:1788872697.106277:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311159808:12345-192.168.204.39@tcp:400:kworker.0 00000100:00080000:2.0:1788872697.106814:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872697.106952:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311159808:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 675us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872697.106976:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1196 00010000:00010000:3.0:1788872697.144830:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788872698.045260:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:3.0:1788872698.045279:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a8c1f59800/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:0.0:1788872698.045371:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c1f59800/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-OST0000 00000020:00000080:0.0:1788872698.050285:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c1f5d800 for lustre-OST0000 00000001:00100000:1.0:1788872698.057282:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:1.0:1788872698.057295:0:9516:0:(genops.c:906:class_export_put()) final put ffff98a8c1f5e000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:0.0:1788872698.057418:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c1f5e000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-OST0001 00000020:00000080:0.0:1788872698.057472:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c1f5c000 for lustre-OST0001 00010000:00010000:3.0:1788872698.169403:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872699.192847:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872700.219540:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872700.600911:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327686144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872700.600988:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872700.601096:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327686144 00000100:00100000:2.0:1788872700.601106:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327686144 00000100:00100000:2.0:1788872700.601180:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:2.0:1788872700.601189:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327686144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872700.601229:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872700.601288:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327686144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872700.601297:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00100000:2.0:1788872700.601349:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327686144:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788872700.601703:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872700.602881:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327686272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872700.602941:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872700.602987:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327686272 00000100:00100000:2.0:1788872700.602993:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327686272 00000100:00100000:2.0:1788872700.603038:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:2.0:1788872700.603047:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327686272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872700.603073:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872700.603115:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327686272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872700.603122:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00080000:2.0:1788872700.603158:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872700.603202:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327686272:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788872701.248918:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788872701.628347:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872701.628355:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872701.628359:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872701.628367:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3633 00000100:00100000:3.0:1788872701.628372:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327686400:0@lo:400:kworker.0 00000100:00080000:1.0:1788872701.628373:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872701.628380:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872701.628403:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c273e300 x1875765327686528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1788872701.628428:0:3645:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327686400 offset 0 length 224: 4 00000100:00080000:1.0:1788872701.628451:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872701.628454:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872701.628456:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872701.628460:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3633 00000100:00080000:1.0:1788872701.628462:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872701.628465:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872701.628490:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c273ce00 x1875765327686784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872701.628506:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872701.628509:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872701.628511:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872701.628514:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3633 00000100:00080000:1.0:1788872701.628517:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872701.628520:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872701.628531:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a42680 x1875765327687040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872701.628600:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327686528:0@lo:38:kworker.0 00000100:00100000:2.0:1788872701.628653:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872701.628675:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327686784:0@lo:38:kworker.0 00000100:00100000:2.0:1788872701.628695:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872701.628711:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327687040:0@lo:38:kworker.0 00000100:00100000:2.0:1788872701.628733:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872701.628775:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327686912:0@lo:400:kworker.0 00000100:00100000:2.0:1788872701.628800:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872701.628820:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872701.628826:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327686656:0@lo:400:kworker.0 00000100:00100000:2.0:1788872701.628846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872701.628874:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327686528 00000100:00100000:2.0:1788872701.628883:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327686528 00000100:00100000:2.0:1788872701.628915:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327686784 00000100:00100000:2.0:1788872701.628918:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327686784 00000100:00100000:2.0:1788872701.628930:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327686912 00000100:00100000:2.0:1788872701.628933:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327686912 00000100:00100000:2.0:1788872701.628961:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327686656 00000100:00080000:3.0:1788872701.628962:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872701.628963:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327686656 00000100:00080000:3.0:1788872701.628972:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872701.628983:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1788872701.628991:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327686912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872701.629048:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327686912:12345-0@lo:400:kworker.0 Request processed in 57us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872701.629055:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1788872701.629074:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1788872701.629086:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327686656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872701.629115:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327686656:12345-0@lo:400:kworker.0 Request processed in 29us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872701.629120:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1788872701.629132:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1788872701.629136:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327686528:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872701.629154:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872701.629186:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327686528:12345-0@lo:38:kworker.0 Request processed in 47us (533us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872701.629192:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1788872701.629203:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1788872701.629207:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327686784:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872701.629216:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872701.629239:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327686784:12345-0@lo:38:kworker.0 Request processed in 30us (543us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872701.629244:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1788872701.629261:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327687040 00000100:00100000:2.0:1788872701.629265:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327687040 00000100:00100000:2.0:1788872701.629282:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:2.0:1788872701.629286:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327687040:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872701.629295:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872701.629320:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327687040:12345-0@lo:38:kworker.0 Request processed in 32us (585us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872701.629325:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00080000:2.0:1788872701.629360:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872701.629370:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872701.629374:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327686528:0@lo:38:kworker.0 00000100:00080000:2.0:1788872701.629385:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872701.629387:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872701.629390:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327686784:0@lo:38:kworker.0 00000100:00080000:2.0:1788872701.629397:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872701.629400:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872701.629402:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327687040:0@lo:38:kworker.0 00000100:00100000:3.0:1788872701.630053:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327686656:0@lo:400:kworker.0 00000100:00100000:3.0:1788872701.630068:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327686912:0@lo:400:kworker.0 00000100:00080000:1.0:1788872701.636901:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872701.636908:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872701.636912:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872701.636920:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3633 00000100:00080000:1.0:1788872701.636926:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872701.636933:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872701.636958:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a40380 x1875765327687424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872701.637026:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327687296:0@lo:400:kworker.0 00000100:00100000:1.0:1788872701.637095:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872701.637136:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327687424:0@lo:38:kworker.0 00000100:00100000:1.0:1788872701.637163:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872701.637201:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327687296 00000100:00100000:1.0:1788872701.637209:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327687296 00000100:00100000:1.0:1788872701.637260:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:1.0:1788872701.637269:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327687296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872701.637327:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327687296:12345-0@lo:400:kworker.0 Request processed in 59us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872701.637334:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00100000:1.0:1788872701.637377:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327687296:0@lo:400:kworker.0 00000100:00100000:3.0:1788872701.637584:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327687424 00000100:00100000:3.0:1788872701.637589:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327687424 00000100:00100000:3.0:1788872701.637614:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1788872701.637619:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327687424:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872701.637638:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872701.637674:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327687424:12345-0@lo:38:kworker.0 Request processed in 53us (510us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872701.637679:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00080000:1.0:1788872701.637824:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872701.637830:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872701.637833:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327687424:0@lo:38:kworker.0 00000100:00100000:1.0:1788872701.638641:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327687168:0@lo:400:kworker.0 00000100:00100000:3.0:1788872701.638817:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872701.639105:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327687168 00000100:00100000:1.0:1788872701.639112:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327687168 00000100:00100000:1.0:1788872701.639165:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:1.0:1788872701.639175:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327687168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872701.639233:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327687168:12345-0@lo:400:kworker.0 Request processed in 60us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872701.639239:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:1.0:1788872701.639271:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327687168:0@lo:400:kworker.0 00000100:00100000:1.0:1788872702.218057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872702.218103:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000400:00000100:1.0:1788872702.218145:0:3639:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311159936 offset 0 length 224: 4 00000100:00100000:0.0:1788872702.218244:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311160064 00000100:00100000:0.0:1788872702.218255:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311160064 00000100:00100000:0.0:1788872702.218305:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311160192 00000100:00100000:0.0:1788872702.218309:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311160192 00000100:00100000:0.0:1788872702.218361:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1199 00000100:00100000:0.0:1788872702.218372:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311160192:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872702.218447:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311160192:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 77us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872702.218456:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1199 00000100:00100000:0.0:1788872702.218474:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1186 00000100:00100000:0.0:1788872702.218479:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311160064:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:0.0:1788872702.218499:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872702.218524:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311160064:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 44us (477us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872702.218544:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1186 00000100:00080000:3.0:1788872702.218831:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788872702.265587:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788872702.648695:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788872686/real 1788872686] req@ffff98a9f5eead80 x1875765327681664/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872702 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872702.648732:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff98a9f5eead80 x1875765327681664/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872702 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872702.648772:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788872702.648777:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788872702.648781:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.139@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788872702.648783:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788872702.648787:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9f5eead80 x1875765327681664/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872702 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872702.648798:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9ff7f1500 x1875765327683584/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872707 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872702.648823:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a8c5a42d80 x1875765327684992/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872712 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872702.648834:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a8c273e680 x1875765327686400/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872717 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788872702.648861:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788872702.648865:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788872702.648867:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788872702.648869:0:3644:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1788872702.648907:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327681664:0@lo:400:kworker.0 00000100:00100000:3.0:1788872702.649039:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327684992:0@lo:400:kworker.0 00000100:00100000:3.0:1788872702.649047:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327683584:0@lo:400:kworker.0 00000100:00080000:0.0:1788872702.649141:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872702.649146:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788872702.649149:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872702.649155:0:82775:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3576 00000100:00080000:0.0:1788872702.649171:0:82775:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872702.649202:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1eed500 x1875765327687552/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872702.649235:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872702.649239:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872702.649241:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872702.649244:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3638 00000100:00080000:0.0:1788872702.649247:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872702.649251:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872702.649267:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1eece00 x1875765327687680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872702.649300:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872702.649304:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872702.649306:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872702.649310:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3638 00000100:00080000:0.0:1788872702.649312:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872702.649315:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872702.649328:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1eeea00 x1875765327687936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872702.649343:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872702.649347:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872702.649349:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872702.649352:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3638 00000100:00080000:0.0:1788872702.649355:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872702.649359:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872702.649376:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1eed880 x1875765327688192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872702.649400:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872702.649403:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872702.649405:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872702.649408:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3638 00000100:00080000:0.0:1788872702.649410:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872702.649414:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872702.649425:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f5b35c00 x1875765327688576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872702.649455:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327688064:0@lo:400:kworker.0 00000100:00100000:0.0:1788872702.649525:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872702.649611:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872702.649618:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327687808:0@lo:400:kworker.0 00000100:00100000:0.0:1788872702.649643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872702.649680:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327688064 00000100:00100000:0.0:1788872702.649687:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327688064 00000100:00100000:0.0:1788872702.649732:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327687808 00000100:00100000:0.0:1788872702.649747:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327687808 00000100:00100000:0.0:1788872702.649772:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1788872702.649780:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327688064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872702.649835:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327688064:12345-0@lo:400:kworker.0 Request processed in 55us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872702.649842:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1788872702.649862:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1788872702.649868:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327687808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872702.649907:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327687808:12345-0@lo:400:kworker.0 Request processed in 39us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872702.649914:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1788872702.649961:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327687808:0@lo:400:kworker.0 00000100:00100000:0.0:1788872702.649971:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327688064:0@lo:400:kworker.0 00000100:00100000:2.0:1788872702.650067:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327688448:0@lo:400:kworker.0 00000100:00100000:2.0:1788872702.650103:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872702.650133:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327686400:0@lo:400:kworker.0 00000100:00100000:2.0:1788872702.650146:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872702.650151:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327688320:0@lo:400:kworker.0 00000100:00100000:2.0:1788872702.650173:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872702.650250:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327687552:0@lo:250:kworker.0 00000400:00000100:1.0:1788872702.650273:0:3643:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327687552 offset 0 length 520: 4 00000100:00100000:1.0:1788872702.650295:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327687680:0@lo:38:kworker.0 00000100:00100000:1.0:1788872702.650319:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872702.650345:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327687936:0@lo:38:kworker.0 00000100:00100000:1.0:1788872702.650368:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872702.650389:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327688192:0@lo:38:kworker.0 00000100:00100000:1.0:1788872702.650414:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872702.650441:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327688576:0@lo:38:kworker.0 00000100:00100000:1.0:1788872702.650467:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872702.650494:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327687680 00000100:00100000:1.0:1788872702.650498:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327687680 00000100:00100000:1.0:1788872702.650517:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327687936 00000100:00100000:1.0:1788872702.650519:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327687936 00000100:00100000:1.0:1788872702.650530:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327688576 00000100:00100000:1.0:1788872702.650532:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327688576 00000100:00100000:1.0:1788872702.650544:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1788872702.650575:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327687680:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872702.650593:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872702.650629:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327687680:12345-0@lo:38:kworker.0 Request processed in 54us (309us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872702.650636:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1788872702.650651:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1788872702.650655:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327687936:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872702.650664:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872702.650687:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327687936:12345-0@lo:38:kworker.0 Request processed in 31us (318us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872702.650695:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1788872702.650707:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:1.0:1788872702.650710:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327688576:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872702.650719:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872702.650757:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327688576:12345-0@lo:38:kworker.0 Request processed in 45us (289us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872702.650763:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00080000:1.0:1788872702.650799:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872702.650804:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872702.650807:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327687680:0@lo:38:kworker.0 00000100:00080000:1.0:1788872702.650813:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872702.650816:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872702.650818:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327687936:0@lo:38:kworker.0 00000100:00080000:1.0:1788872702.650825:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872702.650827:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872702.650829:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327688576:0@lo:38:kworker.0 00000100:00100000:2.0:1788872702.651364:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327688192 00000100:00100000:2.0:1788872702.651370:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327688192 00000100:00100000:2.0:1788872702.651407:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:2.0:1788872702.651412:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327688192:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872702.651425:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872702.651471:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327688192:12345-0@lo:38:kworker.0 Request processed in 58us (1056us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872702.651477:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00100000:0.0:1788872702.652471:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327688448 00000100:00100000:0.0:1788872702.652480:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327688448 00000100:00080000:3.0:1788872702.653450:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872702.653605:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872702.653614:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872702.653619:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327688192:0@lo:38:kworker.0 00000100:00100000:0.0:1788872702.653712:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327688320 00000100:00100000:0.0:1788872702.653718:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327688320 00000100:00080000:3.0:1788872702.653787:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872702.660731:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:2.0:1788872702.660769:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327688448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872702.660891:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327688448:12345-0@lo:400:kworker.0 Request processed in 137us (10786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872702.660900:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:2.0:1788872702.660932:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:2.0:1788872702.660939:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327688320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872702.660971:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327688320:12345-0@lo:400:kworker.0 Request processed in 33us (10796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872702.660976:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534 00000100:00100000:3.0:1788872702.661805:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327688320:0@lo:400:kworker.0 00000100:00100000:3.0:1788872702.661821:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327688448:0@lo:400:kworker.0 00000400:00000100:2.0:1788872703.250401:0:3637:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311160320 offset 0 length 520: 4 00000100:00100000:2.0:1788872703.250455:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872703.250756:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311160448 00000100:00100000:3.0:1788872703.250767:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311160448 00000100:00100000:3.0:1788872703.250821:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1190 00000100:00100000:3.0:1788872703.250830:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311160448:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:3.0:1788872703.250856:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872703.250916:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311160448:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 86us (460us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872703.250923:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1190 00000100:00100000:3.0:1788872703.258893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872703.259626:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311160576 00000100:00100000:1.0:1788872703.259639:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311160576 00000100:00100000:1.0:1788872703.259800:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1202 00000100:00100000:1.0:1788872703.259811:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311160576:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872703.259896:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311160576:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 86us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872703.259903:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1202 00010000:00010000:2.0:1788872703.289852:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872704.316662:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872705.345932:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872705.721805:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327688704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872705.721892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872705.721956:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327688704 00000100:00100000:2.0:1788872705.721964:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327688704 00000100:00100000:2.0:1788872705.722020:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1788872705.722029:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327688704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872705.722060:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872705.722107:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327688704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872705.722114:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00080000:2.0:1788872705.722137:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872705.722175:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327688704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872705.722608:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327688832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872705.722643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872705.722751:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327688832 00000100:00100000:0.0:1788872705.722756:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327688832 00000100:00100000:0.0:1788872705.722802:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:0.0:1788872705.722810:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327688832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872705.722829:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872705.722875:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327688832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872705.722882:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00080000:2.0:1788872705.722982:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872705.723008:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327688832:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788872706.361475:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872707.388971:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788872707.769591:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872707.769603:0:82775:0:(pinger.c:247:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788872707.769606:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872707.769609:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872707.769613:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872707.769623:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3639 00000100:00080000:2.0:1788872707.769627:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872707.769634:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872707.769685:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c273f100 x1875765327688960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872707.769733:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872707.769738:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872707.769739:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872707.769743:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3639 00000100:00080000:2.0:1788872707.769745:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872707.769749:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872707.769760:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c273e300 x1875765327689216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872707.769977:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327688960:0@lo:38:kworker.0 00000100:00100000:1.0:1788872707.770052:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872707.770107:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327688960 00000100:00100000:1.0:1788872707.770115:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327688960 00000100:00100000:1.0:1788872707.770159:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1788872707.770166:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327688960:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872707.770206:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872707.770258:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327688960:12345-0@lo:38:kworker.0 Request processed in 90us (205us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872707.770266:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00080000:1.0:1788872707.770311:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872707.770316:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872707.770318:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327688960:0@lo:38:kworker.0 00000100:00080000:2.0:1788872707.770394:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872707.770398:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872707.770400:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872707.770411:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3639 00000100:00080000:2.0:1788872707.770414:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872707.770419:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872707.770447:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a4b100 x1875765327689472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872707.770481:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872707.770485:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872707.770487:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872707.770491:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3639 00000100:00080000:2.0:1788872707.770493:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872707.770497:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872707.770507:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a49c00 x1875765327689856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872707.770534:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327689344:0@lo:400:kworker.0 00000100:00100000:2.0:1788872707.770593:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872707.770619:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872707.770625:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327689088:0@lo:400:kworker.0 00000100:00100000:2.0:1788872707.770658:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872707.770683:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327689600:0@lo:400:kworker.0 00000100:00100000:2.0:1788872707.770709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872707.770728:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872707.770733:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327689728:0@lo:400:kworker.0 00000100:00100000:2.0:1788872707.770755:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872707.770955:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327689344 00000100:00100000:2.0:1788872707.770961:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327689344 00000100:00100000:2.0:1788872707.771014:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327689088 00000100:00100000:2.0:1788872707.771018:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327689088 00000100:00100000:2.0:1788872707.771037:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1788872707.771043:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327689344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872707.771089:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327689344:12345-0@lo:400:kworker.0 Request processed in 45us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872707.771096:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1788872707.771110:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1788872707.771117:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327689088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872707.771143:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327689088:12345-0@lo:400:kworker.0 Request processed in 27us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872707.771148:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1788872707.771169:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327689600 00000100:00100000:2.0:1788872707.771173:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327689600 00000100:00100000:2.0:1788872707.771196:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327689728 00000100:00100000:2.0:1788872707.771199:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327689728 00000100:00100000:2.0:1788872707.771220:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535 00000100:00100000:2.0:1788872707.771225:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327689600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872707.771258:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327689600:12345-0@lo:400:kworker.0 Request processed in 32us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872707.771265:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535 00000100:00100000:2.0:1788872707.771276:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:2.0:1788872707.771281:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327689728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872707.771305:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327689728:12345-0@lo:400:kworker.0 Request processed in 25us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872707.771310:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00000100:00080000:2.0:1788872707.771326:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872707.771335:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872707.771338:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872707.771373:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327689728:0@lo:400:kworker.0 00000100:00100000:2.0:1788872707.771383:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327689600:0@lo:400:kworker.0 00000100:00100000:2.0:1788872707.771412:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327689088:0@lo:400:kworker.0 00000100:00100000:1.0:1788872707.771565:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327689216:0@lo:38:kworker.0 00000100:00100000:2.0:1788872707.771709:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327689344:0@lo:400:kworker.0 00000100:00100000:1.0:1788872707.774022:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872707.774124:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327689472:0@lo:38:kworker.0 00000100:00100000:1.0:1788872707.774166:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872707.774722:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327689856:0@lo:38:kworker.0 00000100:00100000:1.0:1788872707.774753:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872707.774812:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327689472 00000100:00100000:2.0:1788872707.774820:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327689472 00000100:00100000:2.0:1788872707.774861:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:2.0:1788872707.774867:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327689472:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872707.774888:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872707.774927:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327689472:12345-0@lo:38:kworker.0 Request processed in 59us (760us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872707.774933:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00080000:1.0:1788872707.775141:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872707.775147:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872707.775150:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327689472:0@lo:38:kworker.0 00000100:00100000:0.0:1788872707.775271:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327689216 00000100:00100000:0.0:1788872707.775276:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327689216 00000100:00100000:0.0:1788872707.775312:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327689856 00000100:00100000:0.0:1788872707.775316:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327689856 00000100:00100000:0.0:1788872707.775336:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:0.0:1788872707.775342:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327689216:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872707.775353:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872707.775401:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327689216:12345-0@lo:38:kworker.0 Request processed in 58us (1386us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872707.775432:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:0.0:1788872707.775449:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1788872707.775453:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327689856:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872707.775463:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872707.775491:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327689856:12345-0@lo:38:kworker.0 Request processed in 37us (738us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872707.775497:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00080000:0.0:1788872707.775844:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872707.775849:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872707.775852:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327689216:0@lo:38:kworker.0 00000100:00080000:0.0:1788872707.775861:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872707.775864:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872707.775866:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327689856:0@lo:38:kworker.0 00000100:00100000:1.0:1788872708.362947:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872708.363037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872708.363299:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311160832 00000100:00100000:3.0:1788872708.363311:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311160832 00000100:00100000:3.0:1788872708.363382:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311160704 00000100:00100000:3.0:1788872708.363386:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311160704 00000100:00100000:3.0:1788872708.363416:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1205 00000100:00100000:3.0:1788872708.363435:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311160832:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872708.363517:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311160832:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 91us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872708.363526:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1205 00000100:00100000:3.0:1788872708.363546:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1194 00000100:00100000:3.0:1788872708.363578:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311160704:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:3.0:1788872708.363609:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872708.363647:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311160704:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 68us (609us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872708.363654:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1194 00000100:00080000:1.0:1788872708.364024:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788872708.409146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872709.434321:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788872710.287369:0:89002:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788872710.287383:0:89002:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788872710.287384:0:89002:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788872710.287509:0:89002:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98a8c37f5000 00000020:01000004:0.0:1788872710.287527:0:89002:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788872710.287546:0:89002:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788872710.287607:0:89002:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98a8c72e8000) 00000020:00000080:0.0:1788872710.287629:0:89002:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788872710.457969:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788872710.478342:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788872710.494348:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.500721:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788872710.503465:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788872710.508280:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788872710.508858:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788872710.509324:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788872710.510389:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788872710.511683:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788872710.512704:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788872710.513319:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788872710.513778:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788872710.514581:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788872710.514990:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788872710.515445:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788872710.523802:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788872710.525351:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788872710.526681:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788872710.527338:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788872710.542890:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788872710.543809:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788872710.545446:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.549625:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.550308:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.552847:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.553927:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.554732:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.556693:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.557478:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.558499:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.558907:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.559218:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.559880:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.560406:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.560690:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.560941:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.561471:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.561805:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.562063:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.562473:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.562905:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.563808:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.564310:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.564712:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.576735:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.577397:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788872710.577919:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788872710.578934:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788872710.583807:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788872710.587061:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788872710.589897:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788872710.590399:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788872710.590715:0:89002:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1788872710.592946:0:89002:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788872710.593230:0:89002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788872710.593239:0:89002:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788872710.593252:0:89002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da0e4 00000020:01000004:2.0:1788872710.593259:0:89002:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788872710.593272:0:89002:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788872710.593277:0:89002:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a8c37f5000 from MGS 00000020:01000004:2.0:1788872710.593292:0:89002:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788872710.593304:0:89002:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98a9fa794d40) 00000020:00000080:2.0:1788872710.593317:0:89002:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:2.0:1788872710.593395:0:89002:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a8c37f5000 from MGS, refs=2 00080000:01000000:2.0:1788872710.593400:0:89002:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788872710.593405:0:89002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da0f2 00010000:00010000:2.0:1788872710.593515:0:89002:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1788872710.604750:0:89002:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788872710.621346:0:89002:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788872710.621427:0:89002:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 10000000:01000000:2.0:1788872710.622435:0:89006:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788872710.622609:0:89002:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788872710.622878:0:89002:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788872710.625688:0:89002:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788872710.625699:0:89002:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788872710.630163:0:89002:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788872710.630181:0:89002:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788872710.631572:0:89002:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788872710.631592:0:89002:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788872710.642539:0:89002:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788872710.642954:0:89002:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788872710.642956:0:89002:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.139@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788872710.642960:0:89002:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.139@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788872710.642966:0:89002:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98a9e98d3800 already not connected (conn 64, was 0): CONNECTING 00000100:00100000:1.0:1788872710.642971:0:89002:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1788872710.840938:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327689984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872710.841014:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872710.841311:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327689984 00000100:00100000:2.0:1788872710.841319:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327689984 00000100:00080000:0.0:1788872710.841447:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872710.841518:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:2.0:1788872710.841531:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327689984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872710.841600:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872710.841783:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327689984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 253us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872710.841792:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:2.0:1788872710.841840:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327690112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872710.841869:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872710.841901:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327690112 00000100:00100000:2.0:1788872710.841905:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327690112 00000100:00100000:2.0:1788872710.841933:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:2.0:1788872710.841939:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327690112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872710.841958:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872710.841988:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327690112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872710.841993:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00080000:2.0:1788872710.842010:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872710.842038:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327690112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872710.847852:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327689984:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788872711.480971:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872712.506401:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00020000:1.0:1788872712.697281:0:89002:0:(import.c:339:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) 00000100:00020000:1.0:1788872712.710379:0:89002:0:(import.c:363:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff98a8c1eed500 x1875765327687552/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788872712 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00020000:1.0:1788872712.758456:0:89002:0:(import.c:373:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. 00000100:00100000:1.0:1788872712.779307:0:89002:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1788872712.888754:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788872702/real 1788872702] req@ffff98a8c1eed500 x1875765327687552/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788872712 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872712.888791:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98a8c1eed500 x1875765327687552/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788872712 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872712.888813:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872712.888838:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788872712.888854:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327687552:0@lo:250:kworker.0 10000000:01000000:3.0:1788872712.888888:0:89002:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1788872712.888907:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea000/0xe4e6e89fb01d9d1e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9d25 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872712.888918:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea000/0xe4e6e89fb01d9d1e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9d25 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872712.888924:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00080000:1.0:1788872712.888935:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872712.888941:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788872712.888944:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00010000:00010000:3.0:1788872712.888947:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1788872712.888948:0:86506:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3639 00010000:00010000:3.0:1788872712.888956:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea000/0xe4e6e89fb01d9d1e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9d25 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788872712.888970:0:86506:0:(import.c:589:import_select_connection()) MGC192.168.204.139@tcp: tried all connections, increasing latency to 5s 00010000:00010000:3.0:1788872712.888972:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9efac5400/0xe4e6e89fb01d9c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9c8b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788872712.888976:0:86506:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 10000000:00010000:3.0:1788872712.888984:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac5400/0xe4e6e89fb01d9c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9c8b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872712.888989:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872712.888992:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872712.888996:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9efac5400/0xe4e6e89fb01d9c84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9c8b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872712.889005:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c38b7100 x1875765327690240/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788872712.889015:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01d9ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9ca7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872712.889021:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01d9ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9ca7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788872712.889021:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872712.889025:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 10000000:01000000:3.0:1788872712.889026:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:1.0:1788872712.889027:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:3.0:1788872712.889030:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1788872712.889030:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3644 00000100:00080000:1.0:1788872712.889033:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00010000:00010000:3.0:1788872712.889034:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01d9ca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9ca7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788872712.889036:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00010000:00010000:3.0:1788872712.889043:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01d9cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9cd1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872712.889049:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01d9cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9cd1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872712.889049:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c38b5880 x1875765327690368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:3.0:1788872712.889055:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872712.889058:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872712.889061:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01d9cca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9cd1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.889078:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9cdf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788872712.889079:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872712.889083:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872712.889084:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 10000000:00010000:3.0:1788872712.889086:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9cdf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788872712.889088:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3644 00000100:00080000:1.0:1788872712.889090:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 10000000:01000000:3.0:1788872712.889091:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:1.0:1788872712.889093:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00010000:00010000:3.0:1788872712.889094:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872712.889098:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9cc00/0xe4e6e89fb01d9cd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9cdf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872712.889104:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c38b4700 x1875765327690624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788872712.889106:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01d9cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9cfb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872712.889113:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01d9cf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9cfb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872712.889117:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872712.889120:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1788872712.889122:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:3.0:1788872712.889124:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01d9cf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9cfb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788872712.889125:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872712.889127:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872712.889130:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3644 00010000:00010000:3.0:1788872712.889132:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d9d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9d09 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788872712.889132:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 10000000:00010000:3.0:1788872712.889138:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d9d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9d09 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788872712.889140:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 10000000:01000000:3.0:1788872712.889143:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872712.889151:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1788872712.889151:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f85c5c00 x1875765327690880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788872712.889154:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa98ee00/0xe4e6e89fb01d9d02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9d09 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.889164:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea200/0xe4e6e89fb01d9d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9d33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872712.889169:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea200/0xe4e6e89fb01d9d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9d33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872712.889174:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872712.889177:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1788872712.889178:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:3.0:1788872712.889180:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c5dea200/0xe4e6e89fb01d9d2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9d33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788872712.889182:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872712.889183:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872712.889187:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3644 00000100:00080000:1.0:1788872712.889189:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872712.889192:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00010000:00010000:3.0:1788872712.889193:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb600/0xe4e6e89fb01d9c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9c99 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872712.889199:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb600/0xe4e6e89fb01d9c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9c99 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872712.889201:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f85c4a80 x1875765327691264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:3.0:1788872712.889205:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872712.889208:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872712.889211:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c5deb600/0xe4e6e89fb01d9c92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9c99 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.889225:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01d9cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9cb5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872712.889231:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01d9cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9cb5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872712.889243:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327690752:0@lo:400:kworker.0 10000000:01000000:3.0:1788872712.889245:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872712.889249:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872712.889252:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01d9cae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9cb5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.889262:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01d9cbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9cc3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872712.889267:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01d9cbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9cc3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872712.889271:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788872712.889274:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872712.889277:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01d9cbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9cc3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.889284:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9efac4a00/0xe4e6e89fb01d9ce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9ced expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872712.889289:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac4a00/0xe4e6e89fb01d9ce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9ced expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872712.889293:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788872712.889297:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872712.889299:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9efac4a00/0xe4e6e89fb01d9ce6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9ced expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.889306:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9d10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01d9d17 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872712.889307:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1788872712.889321:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9d10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01d9d17 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872712.889327:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788872712.889330:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872712.889334:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01d9d10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01d9d17 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788872712.889348:0:89002:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98a9e98d3800 already not connected (conn 65, was 0): CONNECTING 00000100:00100000:1.0:1788872712.889351:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1788872712.889353:0:89002:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1788872712.889357:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327690496:0@lo:400:kworker.0 00000100:00100000:1.0:1788872712.889380:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872712.889381:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327691136:0@lo:400:kworker.0 00000100:00100000:1.0:1788872712.889408:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327690752 00000100:00100000:3.0:1788872712.889413:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872712.889417:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327690752 00000100:00100000:3.0:1788872712.889433:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872712.889438:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327691008:0@lo:400:kworker.0 00000100:00100000:3.0:1788872712.889459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872712.889466:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327690496 00000100:00100000:1.0:1788872712.889469:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327690496 00000100:00100000:3.0:1788872712.889492:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327691136 00000100:00100000:1.0:1788872712.889493:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1788872712.889495:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327691136 00000100:00100000:1.0:1788872712.889501:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327690752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872712.889516:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327691008 00000100:00100000:3.0:1788872712.889532:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327691008 00000100:00100000:1.0:1788872712.889581:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327690752:12345-0@lo:400:kworker.0 Request processed in 80us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872712.889588:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1788872712.889593:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:1.0:1788872712.889602:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1788872712.889605:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327691136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872712.889613:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327690496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872712.889640:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327691136:12345-0@lo:400:kworker.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872712.889640:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327690496:12345-0@lo:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872712.889647:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:1.0:1788872712.889647:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1788872712.889658:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1788872712.889665:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327691008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872712.889687:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327690496:0@lo:400:kworker.0 00000100:00100000:1.0:1788872712.889697:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327690752:0@lo:400:kworker.0 00000100:00080000:1.0:1788872712.889724:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872712.889727:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872712.889730:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872712.890055:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327691136:0@lo:400:kworker.0 00000100:00100000:0.0:1788872712.890130:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327690240:0@lo:250:kworker.0 00000100:00100000:0.0:1788872712.890164:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872712.890208:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327690368:0@lo:38:kworker.0 00000100:00100000:0.0:1788872712.890231:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872712.890382:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327691008:12345-0@lo:400:kworker.0 Request processed in 718us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872712.890389:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:0.0:1788872712.890466:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327690624:0@lo:38:kworker.0 00000100:00100000:2.0:1788872712.890491:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327691008:0@lo:400:kworker.0 00000100:00100000:0.0:1788872712.890495:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872712.890517:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327690240 00000100:00100000:2.0:1788872712.890521:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327690240 00000100:00100000:0.0:1788872712.890521:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327690880:0@lo:38:kworker.0 00000100:00100000:2.0:1788872712.890570:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788872712.890573:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872712.890575:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1875765327690240:12345-0@lo:250:kworker.0 00000100:00100000:0.0:1788872712.890593:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327691264:0@lo:38:kworker.0 00010000:00080000:2.0:1788872712.890597:0:89008:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo t0 exp 0000000000000000 cur 3650 last 0 00000100:00100000:0.0:1788872712.890613:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788872712.890626:0:89008:0:(genops.c:1406:class_connect()) connect: client f2e885a0-f180-4b85-9f87-6a01e20afd1a, cookie 0xe4e6e89fb01da0f9 00000100:00100000:0.0:1788872712.890644:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327690880 00000100:00100000:0.0:1788872712.890647:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327690880 00000100:00100000:0.0:1788872712.890668:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:0.0:1788872712.890694:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327690880:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872712.890708:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872712.890745:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327690880:12345-0@lo:38:kworker.0 Request processed in 50us (170us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872712.890750:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00000100:00080000:2.0:1788872712.890758:0:89008:0:(import.c:65:import_set_state_nolock()) ffff98a9ff609800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872712.890771:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327690368 00000100:00100000:0.0:1788872712.890773:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327690368 00000100:00100000:0.0:1788872712.890789:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327690624 00000100:00100000:0.0:1788872712.890791:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327690624 00000100:00100000:2.0:1788872712.890795:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:3643:x1875765327690240:12345-0@lo:250:kworker.0 Request processed in 219us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872712.890801:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788872712.890802:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327691264 00000100:00100000:0.0:1788872712.890804:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327691264 00000100:00100000:0.0:1788872712.890816:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1788872712.890820:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327690368:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872712.890830:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872712.890837:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1788872712.890842:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327690624:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872712.890851:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872712.890855:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327690368:12345-0@lo:38:kworker.0 Request processed in 34us (623us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872712.890872:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327690624:12345-0@lo:38:kworker.0 Request processed in 29us (377us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872712.890873:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1788872712.890877:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:0.0:1788872712.890885:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1788872712.890888:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327691264:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872712.890898:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872712.890924:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327691264:12345-0@lo:38:kworker.0 Request processed in 34us (309us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872712.890930:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00080000:0.0:1788872712.890952:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.139@tcp: connect to target with instance 0 10000000:01000000:0.0:1788872712.890961:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:0.0:1788872712.890964:0:3643:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0xe4e6e89fb01da0f9 00000100:00080000:0.0:1788872712.896858:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:0.0:1788872712.896889:0:3643:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:1.0:1788872712.899380:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327690240:0@lo:250:kworker.0 00000100:00080000:1.0:1788872712.899422:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872712.899427:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872712.899430:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327690368:0@lo:38:kworker.0 00000100:00080000:1.0:1788872712.899440:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872712.899443:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872712.899447:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327690624:0@lo:38:kworker.0 00000100:00080000:1.0:1788872712.899457:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872712.899461:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872712.899464:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327690880:0@lo:38:kworker.0 00000100:00080000:1.0:1788872712.899474:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872712.899477:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872712.899481:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327691264:0@lo:38:kworker.0 00000100:00080000:3.0:1788872712.899651:0:89002:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:3.0:1788872712.899664:0:89002:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788872712.899708:0:89002:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788872712.899715:0:89002:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788872712.899835:0:89002:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.139@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788872712.899877:0:89002:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.139@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788872712.899882:0:89002:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788872712.899884:0:89002:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788872712.899885:0:89002:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872712.899886:0:89002:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872712.899887:0:89002:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872712.899889:0:89002:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872712.899890:0:89002:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788872712.899892:0:89002:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788872712.899894:0:89002:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872712.899895:0:89002:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788872712.899899:0:89002:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788872712.899901:0:89002:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788872712.899902:0:89002:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788872712.899904:0:89002:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872712.899905:0:89002:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872712.899906:0:89002:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872712.899907:0:89002:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872712.899908:0:89002:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788872712.899909:0:89002:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788872712.899910:0:89002:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872712.899911:0:89002:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788872712.899939:0:89002:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788872712.899954:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2c73f00 going to sleep for 0 seconds 00000100:00100000:3.0:1788872712.899960:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327691392:0@lo:253:mount.lustre.0 00000020:00080000:3.0:1788872712.899973:0:89002:0:(tgt_mount.c:1454:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:3.0:1788872712.899988:0:89002:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a8c37f5000 from lustre-MDT0000 10000000:01000000:3.0:1788872712.900010:0:89002:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788872712.900013:0:89002:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788872712.900023:0:89002:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98a8c37f5000 10000000:01000000:3.0:1788872712.900027:0:89002:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788872712.900031:0:89002:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98a8c37f5000 10000000:01000000:3.0:1788872712.900034:0:89002:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788872712.900036:0:89002:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a8c37f5000 from 1 10000000:01000000:3.0:1788872712.900039:0:89002:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788872712.900068:0:89002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.900078:0:89002:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.900088:0:89002:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872712.900098:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2c73300 going to sleep for 0 seconds 00000100:00100000:3.0:1788872712.900102:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327691520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872712.900111:0:89002:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.900119:0:89002:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.900126:0:89002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.900134:0:89002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.900148:0:89002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.900155:0:89002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872712.900159:0:89002:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.900167:0:89002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872712.900174:0:89002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872712.900180:0:89002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872712.900183:0:89002:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872712.900191:0:89002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.900198:0:89002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872712.900229:0:89002:0:(mgc_request.c:1816:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:3.0:1788872712.900232:0:89002:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:0.0:1788872712.900646:0:89011:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.204.139@tcp to MGS@0@lo 00000100:00100000:0.0:1788872712.900650:0:89011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788872712.900653:0:89011:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:0.0:1788872712.900669:0:89011:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:0.0:1788872712.900673:0:89011:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from RECOVER to FULL 10000000:01000000:0.0:1788872712.900675:0:89011:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788872712.900700:0:89011:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:0.0:1788872712.900704:0:89011:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) MGC192.168.204.139@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:1.0:1788872712.901393:0:86506:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.139@tcp 10000000:01000000:1.0:1788872712.901415:0:86506:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1788872712.901418:0:86506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788872712.901419:0:86506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788872712.901421:0:86506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872712.901422:0:86506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872712.901424:0:86506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872712.901425:0:86506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872712.901426:0:86506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788872712.901428:0:86506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872712.901429:0:86506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788872712.901444:0:86506:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788872712.901450:0:86506:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1788872712.901452:0:86506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788872712.901453:0:86506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788872712.901454:0:86506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872712.901455:0:86506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872712.901456:0:86506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872712.901457:0:86506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872712.901459:0:86506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788872712.901460:0:86506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872712.901461:0:86506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788872712.901479:0:86506:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788872712.901483:0:86506:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1788872712.901485:0:86506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788872712.901486:0:86506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788872712.901487:0:86506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872712.901488:0:86506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872712.901489:0:86506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872712.901490:0:86506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872712.901491:0:86506:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788872712.901492:0:86506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872712.901493:0:86506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788872712.901502:0:86506:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1788872712.901526:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327691776:0@lo:253:kworker.0 00000100:00100000:1.0:1788872712.901638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872712.901675:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872712.901681:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327691648:0@lo:400:kworker.0 00000100:00100000:1.0:1788872712.901715:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872712.901760:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327692032:0@lo:253:kworker.0 00000100:00100000:1.0:1788872712.901789:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872712.901803:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872712.901808:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327691904:0@lo:253:kworker.0 00000100:00100000:1.0:1788872712.901831:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872712.901867:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327691776 00000100:00100000:1.0:1788872712.901874:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327691776 00000100:00100000:1.0:1788872712.901909:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327691648 00000100:00100000:1.0:1788872712.901912:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327691648 00000100:00100000:1.0:1788872712.901921:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327692032 00000100:00100000:1.0:1788872712.901923:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327692032 00000100:00100000:1.0:1788872712.901931:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327691904 00000100:00100000:1.0:1788872712.901933:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327691904 00000100:00100000:1.0:1788872712.901946:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788872712.901953:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c2469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3647:x1875765327691776:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788872712.901983:0:89008:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:1.0:1788872712.902101:0:89012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788872712.902189:0:89008:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 111 10000000:01000000:3.0:1788872712.903388:0:89002:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a8c37f5000 from 1 10000000:01000000:3.0:1788872712.903395:0:89002:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788872712.903438:0:89002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.903449:0:89002:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.903475:0:89002:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872712.903497:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327692160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788872712.903581:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872712.903609:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2c73300 going to sleep for 11 seconds 00000100:00100000:3.0:1788872712.903635:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327692160 00000100:00100000:3.0:1788872712.903641:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327692160 00000100:00100000:3.0:1788872712.903679:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788872712.903688:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c246bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:3647:x1875765327691648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872712.903743:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c246bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:3647:x1875765327691648:12345-0@lo:400:kworker.0 Request processed in 56us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872712.903750:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788872712.903791:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327691648:0@lo:400:kworker.0 00000100:00100000:3.0:1788872712.903818:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788872712.903826:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c246b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3645:x1875765327692032:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788872712.903850:0:89009:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788872712.915980:0:89013:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788872712.915989:0:89013:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788872712.915992:0:89013:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788872712.915995:0:89013:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788872712.916173:0:89013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788872712.917954:0:89008:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788872712.917986:0:89008:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788872712.920245:0:89009:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788872712.920890:0:89008:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788872712.920908:0:89008:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788872712.921743:0:89012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788872712.921750:0:89012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788872712.921785:0:89012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c52af600/0xe4e6e89fb01da10e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.921804:0:89012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52af600/0xe4e6e89fb01da10e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788872712.921813:0:89012:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063994s 00010000:00010000:1.0:1788872712.921819:0:89012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c52af600/0xe4e6e89fb01da10e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.921855:0:89012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c52af600/0xe4e6e89fb01da10e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.921862:0:89012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c52af600/0xe4e6e89fb01da10e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.921869:0:89012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c52af600/0xe4e6e89fb01da10e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.921875:0:89012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872712.921880:0:89012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c52af600/0xe4e6e89fb01da10e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.921887:0:89012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c52af600/0xe4e6e89fb01da10e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.921901:0:89012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c52af600/0xe4e6e89fb01da10e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.921910:0:89012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c52af600/0xe4e6e89fb01da10e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.921917:0:89012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52af600/0xe4e6e89fb01da10e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788872712.923787:0:89009:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788872712.923803:0:89009:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788872712.923917:0:89012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788872712.923922:0:89012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788872712.923945:0:89012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da115 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.923961:0:89012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da115 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788872712.923985:0:89012:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063994s 00010000:00010000:1.0:1788872712.923989:0:89012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da115 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.923995:0:89012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da115 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.924001:0:89012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da115 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.924007:0:89012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da115 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.924013:0:89012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872712.924016:0:89012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da115 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.924023:0:89012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da115 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.924035:0:89012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da115 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.924041:0:89012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da115 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872712.924047:0:89012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da115 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872712.924521:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c2469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3647:x1875765327691776:12345-0@lo:253:kworker.0 Request processed in 22563us (22878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872712.924569:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788872712.924612:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788872712.924623:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c2469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:3645:x1875765327691904:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788872712.924651:0:89008:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788872712.924663:0:89008:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:3.0:1788872712.924952:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788872712.924956:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788872712.924957:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872712.924959:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872712.924960:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872712.924962:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872712.924963:0:3647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788872712.924965:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872712.924974:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788872712.924978:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327691776:0@lo:253:kworker.0 00000100:00100000:0.0:1788872712.925656:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c246b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:3645:x1875765327692032:12345-0@lo:253:kworker.0 Request processed in 21828us (23862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872712.925666:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788872712.925695:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788872712.925704:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c2469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:89002:x1875765327692160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788872712.925715:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872712.925733:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa98fc00/0xe4e6e89fb01da11c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da107 expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872712.925767:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa98fc00/0xe4e6e89fb01da11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da107 expref: 7 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872712.925777:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa98fc00/0xe4e6e89fb01da11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da107 expref: 7 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872712.925785:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa98fc00, rc 0) 00000100:00100000:0.0:1788872712.925821:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c2469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:89002:x1875765327692160:12345-0@lo:101:mount.lustre.0 Request processed in 120us (22241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872712.925827:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:1.0:1788872712.925927:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788872712.925935:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788872712.925936:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872712.925937:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872712.925939:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872712.925940:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872712.925942:0:3645:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788872712.925943:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872712.925944:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788872712.925948:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327692032:0@lo:253:kworker.0 00000100:00100000:3.0:1788872712.926093:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327692160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872712.926110:0:89002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.926119:0:89002:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872712.926135:0:89002:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788872712.926157:0:89002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.926166:0:89002:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872712.926175:0:89002:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788872712.926180:0:89002:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788872712.926187:0:89002:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98a8c37f5000 10000000:01000000:3.0:1788872712.926190:0:89002:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788872712.926195:0:89002:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788872712.926198:0:89002:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788872712.926597:0:89002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.926607:0:89002:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.926615:0:89002:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872712.926646:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327692288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788872712.926685:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872712.926722:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2c73300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872712.928107:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327692288 00000100:00100000:0.0:1788872712.928122:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327692288 00000100:00100000:0.0:1788872712.928450:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788872712.928462:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c246a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:89002:x1875765327692288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788872712.928477:0:89010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872712.928497:0:89010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa98ee00/0xe4e6e89fb01da12a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da123 expref: -99 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872712.928521:0:89010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa98ee00/0xe4e6e89fb01da12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da123 expref: 8 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872712.928532:0:89010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa98ee00/0xe4e6e89fb01da12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da123 expref: 8 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872712.928725:0:89010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa98ee00, rc 0) 00000100:00100000:0.0:1788872712.928811:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c246a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:89002:x1875765327692288:12345-0@lo:101:mount.lustre.0 Request processed in 352us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872712.928817:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 20000000:01000000:0.0:1788872712.931752:0:89008:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788872712.931773:0:89008:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788872712.932017:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327692288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872712.932043:0:89002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872712.932057:0:89002:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872712.932146:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327692416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788872712.932361:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872712.932398:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2c73300 going to sleep for 11 seconds 20000000:01000000:2.0:1788872712.932711:0:89012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788872712.932717:0:89012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788872712.932744:0:89012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01da131 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872712.932775:0:89012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01da131 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788872712.932786:0:89012:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000069604s 00010000:00010000:2.0:1788872712.932790:0:89012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01da131 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872712.932798:0:89012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01da131 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872712.932805:0:89012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01da131 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872712.932814:0:89012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01da131 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872712.932821:0:89012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872712.932825:0:89012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01da131 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872712.932833:0:89012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01da131 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872712.932847:0:89012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01da131 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872712.932867:0:89012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01da131 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872712.932873:0:89012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01da131 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872712.933406:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327692416 00000100:00100000:0.0:1788872712.933415:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327692416 00000100:00100000:0.0:1788872712.933465:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788872712.933477:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:89002:x1875765327692416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788872712.933814:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:89002:x1875765327692416:12345-0@lo:501:mount.lustre.0 Request processed in 339us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872712.933824:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788872712.934029:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c2469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3645:x1875765327691904:12345-0@lo:253:kworker.0 Request processed in 9407us (32195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872712.934036:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1788872712.934184:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788872712.934187:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788872712.934189:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872712.934190:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872712.934192:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872712.934193:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872712.934195:0:3645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788872712.934197:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872712.934210:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788872712.934214:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327691904:0@lo:253:kworker.0 00000100:00100000:3.0:1788872712.934953:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327692416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788872712.935009:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327692544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788872712.935074:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872712.935107:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2c73300 going to sleep for 11 seconds 00000100:00100000:3.0:1788872712.935130:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327692544 00000100:00100000:3.0:1788872712.935135:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327692544 00000100:00100000:3.0:1788872712.935195:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788872712.935211:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:89002:x1875765327692544:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788872712.945959:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:89002:x1875765327692544:12345-0@lo:503:mount.lustre.0 Request processed in 10743us (10872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872712.945974:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788872712.946965:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327692544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788872712.947891:0:89014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89014:1875765327692672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872712.947969:0:89014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872712.948016:0:89014:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2c739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872712.948069:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327692672 00000100:00100000:2.0:1788872712.948076:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327692672 00000100:00100000:2.0:1788872712.948125:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788872712.948134:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df55bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:89014:x1875765327692672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872712.949121:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df55bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:89014:x1875765327692672:12345-0@lo:502:llog_process_th.0 Request processed in 982us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872712.949132:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788872712.949346:0:89014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89014:1875765327692672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788872712.949381:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872712.949392:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872712.949395:0:89014:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788872712.949400:0:89014:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788872712.949403:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788872712.949417:0:89014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98a9efa78000) 00000020:00000080:3.0:1788872712.949438:0:89014:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1788872712.949443:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788872712.949522:0:89014:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788872712.949529:0:89014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da13f 00000020:00000080:3.0:1788872712.949789:0:89014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788872712.949794:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872712.949797:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872712.949799:0:89014:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788872712.949802:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872712.949805:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872712.949807:0:89014:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788872712.949810:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788872712.949816:0:89014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98a9efa7b380) 00000020:00000080:3.0:1788872712.949828:0:89014:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1788872712.949833:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788872712.949834:0:89014:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788872712.949837:0:89014:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788872712.949843:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788872712.949891:0:89014:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a8c37f5000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788872712.949903:0:89014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98a9efa799c0) 00000020:00000080:3.0:1788872712.949913:0:89014:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1788872712.949973:0:89014:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788872712.949979:0:89014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da154 00000020:00000080:3.0:1788872712.950075:0:89014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788872712.950082:0:89014:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788872712.950087:0:89014:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe4e6e89fb01da15b 00080000:01000000:3.0:1788872712.950091:0:89014:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788872712.950095:0:89014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da162 00010000:00010000:0.0:1788872713.055992:0:89014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1788872713.056299:0:89014:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 idx: 0 lr: 103079215113 srv lr: 107374182400 lx: 0 gen 23 00000001:00080000:0.0:1788872713.056415:0:89014:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 22 00000001:00000004:0.0:1788872713.056444:0:89014:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:0.0:1788872713.056661:0:89014:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1788872713.056795:0:89014:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff98a9ef3d6e40: xid 1875765311152896, transno 107374182405, client gen 23, slot idx 0 00000001:00080000:0.0:1788872713.056807:0:89014:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff98a9ef3d6840: xid 1875765311153152, transno 107374182406, client gen 23, slot idx 1 00000020:00000080:0.0:1788872713.058477:0:89014:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98a8c72ecd40) 00000020:00000080:0.0:1788872713.058518:0:89014:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1788872713.058771:0:89014:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788872713.058783:0:89014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da17e 00000020:00000080:2.0:1788872713.060970:0:89014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788872713.067356:0:89014:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe4e6e89fb01da185 00000020:00000080:2.0:1788872713.069075:0:89014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788872713.069092:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872713.069100:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872713.069102:0:89014:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788872713.069106:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788872713.069109:0:89014:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788872713.069111:0:89014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788872713.069113:0:89014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788872713.069115:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788872713.069117:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872713.069119:0:89014:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788872713.069122:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872713.069195:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872713.069198:0:89014:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788872713.069205:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788872713.069274:0:89014:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788872713.069296:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872713.069299:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872713.069310:0:89014:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788872713.069314:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872713.069317:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872713.069318:0:89014:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788872713.069321:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788872713.069327:0:89014:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:00000080:2.0:1788872713.069361:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788872713.069380:0:89014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98a9fa7919c0) 00000020:00000080:2.0:1788872713.069404:0:89014:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788872713.069411:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788872713.069472:0:89014:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788872713.069478:0:89014:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788872713.069484:0:89014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da193 00010000:00080000:2.0:1788872713.069517:0:89014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9dfe95000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:2.0:1788872713.073518:0:89014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1788872713.076200:0:89014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872713.076222:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788872713.076269:0:89014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788872713.076301:0:89014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da19a 00000100:00080000:3.0:1788872713.076313:0:89014:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788872713.076320:0:89014:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98a9dfe95000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872713.076363:0:89014:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff7f1500 x1875765327692800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872713.076447:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327692800:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788872713.076531:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872713.076684:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327692800 00000100:00100000:2.0:1788872713.076691:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327692800 00000100:00100000:2.0:1788872713.076728:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:2.0:1788872713.076737:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327692800:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788872713.076762:0:30614:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3650 last 0 00000020:00000080:2.0:1788872713.076796:0:30614:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da1a1 00000004:00100000:2.0:1788872713.076811:0:30614:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788872713.076934:0:30614:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d5000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788872713.077373:0:89014:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788872713.077461:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872713.077466:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872713.077468:0:89014:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788872713.077471:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788872713.077475:0:89014:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788872713.077476:0:89014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788872713.077478:0:89014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788872713.077479:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788872713.077481:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872713.077483:0:89014:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788872713.077485:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788872713.077490:0:89014:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788872713.077494:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872713.077495:0:89014:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788872713.077498:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788872713.077516:0:89014:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:3.0:1788872713.077566:0:89014:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788872713.077570:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788872713.077585:0:89014:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98a8c340b380) 00000020:00000080:3.0:1788872713.077606:0:89014:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788872713.077611:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788872713.077691:0:89014:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788872713.077698:0:89014:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788872713.077703:0:89014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da1af 00010000:00080000:3.0:1788872713.077742:0:89014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9ef253800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:3.0:1788872713.078072:0:89014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1788872713.078745:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327692800:12345-0@lo:38:llog_process_th.0 Request processed in 2002us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872713.078757:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00000100:00100000:1.0:1788872713.079356:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788872713.079369:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:1.0:1788872713.079378:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788872713.079385:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788872713.079389:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe95000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000040:01000000:3.0:1788872713.079504:0:89014:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788872713.079527:0:89014:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788872713.079652:0:89014:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000100:00100000:1.0:1788872713.080117:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327692800:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788872713.080497:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327692928:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788872713.080687:0:89014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788872713.080716:0:89014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000100:00100000:1.0:1788872713.080752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872713.081095:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327692928 00000100:00100000:2.0:1788872713.081104:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327692928 00000100:00100000:2.0:1788872713.081253:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:2.0:1788872713.081264:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327692928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872713.081315:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872713.081378:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327692928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872713.081386:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:1.0:1788872713.081460:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327692928:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788872713.095254:0:89014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:3.0:1788872713.097919:0:89020:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:3.0:1788872713.097928:0:89020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788872713.098120:0:89020:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:3.0:1788872713.098143:0:89020:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788872713.098288:0:89020:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:3.0:1788872713.098292:0:89020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788872713.099909:0:89014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872713.099923:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788872713.099966:0:89014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788872713.099990:0:89014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da1b6 00000100:00080000:3.0:1788872713.100001:0:89014:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788872713.100007:0:89014:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98a9ef253800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872713.100044:0:89014:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff7f1500 x1875765327693056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872713.100083:0:89014:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788872713.100158:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872713.100163:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872713.100165:0:89014:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788872713.100168:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788872713.100171:0:89014:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788872713.100172:0:89014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788872713.100174:0:89014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788872713.100175:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788872713.100178:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872713.100179:0:89014:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788872713.100182:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788872713.100186:0:89014:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788872713.100189:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872713.100191:0:89014:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788872713.100194:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788872713.100198:0:89014:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000100:00100000:1.0:1788872713.100245:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327693056:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788872713.100325:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788872713.100570:0:89014:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788872713.100573:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788872713.100586:0:89014:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98a8c3408000) 00000020:00000080:3.0:1788872713.100609:0:89014:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788872713.100615:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788872713.100688:0:89014:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788872713.100694:0:89014:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788872713.100699:0:89014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da1c4 00010000:00080000:3.0:1788872713.100729:0:89014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9e99a9000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:3.0:1788872713.100927:0:89014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1788872713.100999:0:89014:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788872713.101014:0:89014:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788872713.102453:0:89014:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1788872713.103670:0:89014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788872713.103714:0:89014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:3.0:1788872713.106100:0:89014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000040:00080000:0.0:1788872713.107052:0:89022:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:0.0:1788872713.107058:0:89022:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788872713.107244:0:89022:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:0.0:1788872713.107266:0:89022:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788872713.107418:0:89022:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:0.0:1788872713.107422:0:89022:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1788872713.108323:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327693056 00000100:00100000:1.0:1788872713.108336:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327693056 00000100:00100000:1.0:1788872713.108434:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5956 00000100:00100000:1.0:1788872713.108443:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3643:x1875765327693056:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788872713.108479:0:26183:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3650 last 0 00000020:00000080:1.0:1788872713.108517:0:26183:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da1cb 00002000:00100000:1.0:1788872713.108569:0:26183:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98a8c1f5c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788872713.108574:0:26183:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788872713.108578:0:26183:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788872713.108657:0:26183:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788872713.108699:0:26183:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872713.108794:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327693056:12345-0@lo:8:llog_process_th.0 Request processed in 350us (8468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872713.108802:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5956 00000100:00100000:3.0:1788872713.108895:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788872713.108905:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788872713.108912:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788872713.108917:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788872713.108920:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ef253800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788872713.108939:0:3643:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:3.0:1788872713.108944:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327693056:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788872713.108976:0:89020:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788872713.109028:0:89020:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3650235478424ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788872713.109035:0:89020:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788872713.112112:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327693184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872713.112266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788872713.113057:0:89014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872713.113073:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788872713.113140:0:89014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788872713.113168:0:89014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da1d2 00000100:00080000:1.0:1788872713.113177:0:89014:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788872713.113183:0:89014:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98a9e99a9000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872713.113220:0:89014:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f85c6d80 x1875765327693312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872713.113259:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327693312:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788872713.113307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788872713.113350:0:89014:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788872713.113428:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872713.113432:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872713.113434:0:89014:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788872713.113438:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788872713.113441:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872713.113443:0:89014:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788872713.113446:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788872713.113448:0:89014:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788872713.113450:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872713.113461:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872713.113462:0:89014:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788872713.113465:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788872713.113468:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872713.113470:0:89014:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788872713.113474:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788872713.113504:0:89014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89014:1875765327693440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872713.113576:0:89014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.113597:0:89014:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872713.113974:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327693184 00000100:00100000:2.0:1788872713.113981:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327693184 00000100:00080000:1.0:1788872713.114094:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872713.114144:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:2.0:1788872713.114154:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327693184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872713.114188:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872713.114258:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327693184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872713.114266:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:00100000:1.0:1788872713.114352:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327693184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872713.114633:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327693312 00000100:00100000:0.0:1788872713.114639:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327693312 00000100:00100000:0.0:1788872713.114682:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5957 00000100:00100000:0.0:1788872713.114688:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875765327693312:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788872713.114714:0:8438:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3650 last 0 00000020:00000080:0.0:1788872713.114758:0:8438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da1d9 00002000:00100000:0.0:1788872713.114774:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98a9ef236800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788872713.114779:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788872713.114782:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788872713.115055:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788872713.115083:0:8438:0:(import.c:65:import_set_state_nolock()) ffff98a9ef979800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872713.115166:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327693312:12345-0@lo:8:llog_process_th.0 Request processed in 476us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872713.115172:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5957 00000100:00100000:1.0:1788872713.115302:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788872713.115312:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788872713.115322:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788872713.115328:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788872713.115331:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788872713.115354:0:3643:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:1.0:1788872713.115361:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327693312:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788872713.115652:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872713.115664:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327693568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872713.115977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788872713.116079:0:89022:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788872713.117866:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327693440 00000100:00100000:3.0:1788872713.117884:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327693440 00000100:00100000:3.0:1788872713.117943:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788872713.117953:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df55a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:89014:x1875765327693440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872713.117971:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327693568 00000100:00100000:2.0:1788872713.117976:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327693568 00000100:00100000:2.0:1788872713.118017:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:2.0:1788872713.118023:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327693568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872713.118045:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788872713.118163:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788872713.119415:0:89022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3650245862549ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788872713.119427:0:89022:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788872713.122946:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327693568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4911us (6958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872713.122962:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:0.0:1788872713.123365:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327693568:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788872713.123469:0:89003:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788872713.124507:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df55a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:89014:x1875765327693440:12345-0@lo:502:llog_process_th.0 Request processed in 6550us (10925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872713.124541:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788872713.125781:0:89014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89014:1875765327693440:0@lo:502:llog_process_th.0 00000004:00080000:1.0:1788872713.125797:0:89003:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:01000000:0.0:1788872713.125826:0:89014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872713.125835:0:89014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872713.125837:0:89014:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788872713.125843:0:89014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788872713.126016:0:89002:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788872713.126106:0:89002:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788872713.126134:0:89002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.126304:0:89002:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872713.126401:0:89002:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a8c37f5000 from 1 10000000:01000000:1.0:1788872713.126405:0:89002:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788872713.126447:0:89002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.126456:0:89002:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.126466:0:89002:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872713.126487:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327693696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788872713.126648:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.126770:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788872713.126810:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327693696 00000100:00100000:2.0:1788872713.126817:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327693696 00000100:00100000:2.0:1788872713.126986:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788872713.126997:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:89002:x1875765327693696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872713.127014:0:89008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872713.127029:0:89008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01da1e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da1e0 expref: -99 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872713.127061:0:89008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01da1e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da1e0 expref: 9 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872713.127071:0:89008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01da1e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da1e0 expref: 9 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872713.127080:0:89008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8600, rc 0) 00000100:00100000:2.0:1788872713.127295:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:89002:x1875765327693696:12345-0@lo:101:mount.lustre.0 Request processed in 299us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872713.127302:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788872713.127446:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327693696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872713.127461:0:89002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da1e7 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.127470:0:89002:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da1e7 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872713.128447:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327693824:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788872713.128501:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.128647:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788872713.128983:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327693824 00000100:00100000:3.0:1788872713.128989:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327693824 00000100:00100000:3.0:1788872713.129033:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788872713.129041:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:89002:x1875765327693824:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788872713.129061:0:89010:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788872713.129079:0:89010:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788872713.129083:0:89010:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788872713.129086:0:89010:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788872713.129089:0:89010:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 114 00000100:00100000:3.0:1788872713.129496:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:89002:x1875765327693824:12345-0@lo:256:mount.lustre.0 Request processed in 454us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872713.129503:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788872713.129656:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327693824:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788872713.131002:0:89002:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788872713.131088:0:89002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da1e7 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.131101:0:89002:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da1e7 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872713.131111:0:89002:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a8c37f5000 from 1 10000000:01000000:1.0:1788872713.131113:0:89002:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788872713.131276:0:89002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.131285:0:89002:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.131295:0:89002:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872713.131382:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327693952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788872713.131437:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.131522:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788872713.131606:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327693952 00000100:00100000:2.0:1788872713.131613:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327693952 00000100:00100000:2.0:1788872713.131658:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788872713.131666:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:89002:x1875765327693952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872713.131751:0:89008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872713.131768:0:89008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c9c00/0xe4e6e89fb01da1f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da1ee expref: -99 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872713.131790:0:89008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c9c00/0xe4e6e89fb01da1f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da1ee expref: 10 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872713.131799:0:89008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c9c00/0xe4e6e89fb01da1f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da1ee expref: 10 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872713.131808:0:89008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9c00, rc 0) 00000100:00100000:2.0:1788872713.132027:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:89002:x1875765327693952:12345-0@lo:101:mount.lustre.0 Request processed in 361us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872713.132034:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788872713.132107:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327693952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872713.132121:0:89002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.132280:0:89002:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872713.132406:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327694080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872713.132436:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.132530:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788872713.132793:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327694080 00000100:00100000:3.0:1788872713.132799:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327694080 00000100:00100000:3.0:1788872713.132846:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788872713.132862:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:89002:x1875765327694080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788872713.133020:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:89002:x1875765327694080:12345-0@lo:501:mount.lustre.0 Request processed in 166us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872713.133027:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788872713.133179:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327694080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872713.133216:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327694208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872713.133256:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.133285:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788872713.133375:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327694208 00000100:00100000:0.0:1788872713.133381:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327694208 00000100:00100000:0.0:1788872713.133418:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788872713.133425:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:89002:x1875765327694208:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872713.133529:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:89002:x1875765327694208:12345-0@lo:503:mount.lustre.0 Request processed in 103us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872713.133547:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788872713.133616:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327694208:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872713.134394:0:89024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89024:1875765327694336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872713.134446:0:89024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872713.134546:0:89024:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d26edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872713.134766:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327694336 00000100:00100000:3.0:1788872713.134773:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327694336 00000100:00100000:3.0:1788872713.134866:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788872713.134875:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:89024:x1875765327694336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872713.135782:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:89024:x1875765327694336:12345-0@lo:502:llog_process_th.0 Request processed in 904us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872713.135791:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788872713.135895:0:89024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89024:1875765327694336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788872713.135934:0:89024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872713.135944:0:89024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872713.135946:0:89024:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788872713.135955:0:89024:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a8c37f5000 00000020:00000080:0.0:1788872713.135958:0:89024:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788872713.135976:0:89024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872713.135979:0:89024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872713.135981:0:89024:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788872713.135984:0:89024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872713.135986:0:89024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872713.135987:0:89024:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788872713.135991:0:89024:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a8c37f5000 00000020:00000080:0.0:1788872713.135993:0:89024:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788872713.136075:0:89024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89024:1875765327694464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872713.136115:0:89024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872713.136163:0:89024:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c65859c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872713.136395:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327694464 00000100:00100000:1.0:1788872713.136401:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327694464 00000100:00100000:1.0:1788872713.136440:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788872713.136447:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:89024:x1875765327694464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872713.136578:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:89024:x1875765327694464:12345-0@lo:502:llog_process_th.0 Request processed in 131us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872713.136585:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788872713.136782:0:89024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89024:1875765327694464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788872713.136804:0:89024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872713.136809:0:89024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872713.136811:0:89024:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788872713.136815:0:89024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788872713.136934:0:89002:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788872713.136957:0:89002:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788872713.136972:0:89002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.136984:0:89002:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872713.137032:0:89002:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788872713.137035:0:89002:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98a8c37f5000 10000000:01000000:0.0:1788872713.137038:0:89002:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98a8c37f5000 10000000:01000000:0.0:1788872713.137042:0:89002:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788872713.137047:0:89002:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a8c37f5000 from 1 10000000:01000000:0.0:1788872713.137050:0:89002:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788872713.137075:0:89002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.137083:0:89002:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.137092:0:89002:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872713.137114:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327694592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788872713.137144:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872713.137184:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c6585e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872713.137435:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327694592 00000100:00100000:3.0:1788872713.137440:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327694592 00000100:00100000:3.0:1788872713.143368:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788872713.143388:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:89002:x1875765327694592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872713.143415:0:89010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872713.143438:0:89010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3a00/0xe4e6e89fb01da203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da1fc expref: -99 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872713.143468:0:89010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3a00/0xe4e6e89fb01da203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da1fc expref: 11 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872713.143479:0:89010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d3a00/0xe4e6e89fb01da203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da1fc expref: 11 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872713.143489:0:89010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3a00, rc 0) 00000100:00100000:3.0:1788872713.143593:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89002:x1875765327694592:12345-0@lo:101:mount.lustre.0 Request processed in 213us (6448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872713.143600:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788872713.143855:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327694592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872713.143875:0:89002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.143885:0:89002:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872713.143967:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327694720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872713.144002:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.144039:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872713.144176:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327694720 00000100:00100000:0.0:1788872713.144183:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327694720 00000100:00100000:0.0:1788872713.144237:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788872713.144245:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89002:x1875765327694720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788872713.144399:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89002:x1875765327694720:12345-0@lo:501:mount.lustre.0 Request processed in 155us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872713.144406:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788872713.144590:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327694720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872713.144623:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327694848:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872713.144667:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.144698:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872713.144909:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327694848 00000100:00100000:0.0:1788872713.144914:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327694848 00000100:00100000:0.0:1788872713.144939:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788872713.144946:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89002:x1875765327694848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872713.145039:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89002:x1875765327694848:12345-0@lo:503:mount.lustre.0 Request processed in 93us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872713.145046:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788872713.145138:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327694848:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872713.145706:0:89026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89026:1875765327694976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872713.145749:0:89026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.145780:0:89026:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872713.145856:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327694976 00000100:00100000:0.0:1788872713.145861:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327694976 00000100:00100000:0.0:1788872713.145895:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788872713.145903:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89026:x1875765327694976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872713.146011:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89026:x1875765327694976:12345-0@lo:502:llog_process_th.0 Request processed in 108us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872713.146018:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788872713.146097:0:89026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89026:1875765327694976:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788872713.146154:0:89026:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788872713.146170:0:89026:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98a9f6710000) 00000020:00000080:1.0:1788872713.146195:0:89026:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788872713.146381:0:89026:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a8c37f5000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788872713.146386:0:89026:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a8c37f5000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788872713.146390:0:89026:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a8c37f5000 4 00010000:00080000:1.0:1788872713.146423:0:89026:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9ef0ad800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:1.0:1788872713.148179:0:89026:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1788872713.148292:0:89026:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788872713.148339:0:89026:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788872713.148352:0:89026:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe4e6e89fb01da211 00000100:00080000:1.0:1788872713.148362:0:89026:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788872713.148369:0:89026:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98a9ef0ad800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872713.148407:0:89026:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f85c4a80 x1875765327695104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872713.148441:0:89026:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788872713.150774:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327695104:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788872713.150865:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872713.158606:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327695104 00000100:00100000:3.0:1788872713.158625:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327695104 00000100:00100000:3.0:1788872713.158675:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1788872713.158684:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327695104:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788872713.158806:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327695104:12345-0@lo:38:llog_process_th.0 Request processed in 121us (7940us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788872713.158814:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1788872713.162295:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788872713.162308:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0ad800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872713.162316:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788872713.162320:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327695104:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788872713.162522:0:89026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89026:1875765327695232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872713.162645:0:89026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.162684:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327695232 00000100:00100000:1.0:1788872713.162690:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327695232 00000100:00100000:1.0:1788872713.162746:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788872713.162755:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89026:x1875765327695232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872713.162899:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89026:x1875765327695232:12345-0@lo:502:llog_process_th.0 Request processed in 145us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872713.162907:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788872713.162954:0:89026:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872713.162968:0:89026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89026:1875765327695232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872713.163001:0:89026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89026:1875765327695360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872713.163032:0:89026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.163054:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327695360 00000100:00100000:1.0:1788872713.163058:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327695360 00000100:00100000:1.0:1788872713.163079:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788872713.163085:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89026:x1875765327695360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872713.163145:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89026:x1875765327695360:12345-0@lo:502:llog_process_th.0 Request processed in 59us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872713.163152:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788872713.163181:0:89026:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872713.163193:0:89026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89026:1875765327695360:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788872713.163211:0:89026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788872713.164258:0:89002:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788872713.164288:0:89002:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872713.164313:0:89002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.164327:0:89002:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788872713.164391:0:89002:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788872713.164393:0:89002:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788872713.164395:0:89002:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872713.164396:0:89002:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872713.164397:0:89002:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872713.164398:0:89002:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872713.164399:0:89002:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872713.164401:0:89002:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788872713.164403:0:89002:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872713.164404:0:89002:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788872713.164407:0:89002:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788872713.164410:0:89002:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788872713.164412:0:89002:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788872713.164413:0:89002:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872713.164414:0:89002:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872713.164415:0:89002:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872713.164416:0:89002:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872713.164417:0:89002:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872713.164418:0:89002:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788872713.164420:0:89002:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872713.164421:0:89002:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788872713.164446:0:89002:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788872713.164463:0:89002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327695488:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788872713.164514:0:89002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872713.164598:0:89002:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c6585f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788872713.164763:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327695488 00000100:00100000:2.0:1788872713.164781:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327695488 00000100:00100000:2.0:1788872713.164857:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788872713.164865:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89002:x1875765327695488:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788872713.164893:0:89008:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788872713.164907:0:89008:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788872713.171513:0:89008:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788872713.171545:0:89008:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788872713.172174:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:89002:x1875765327695488:12345-0@lo:253:mount.lustre.0 Request processed in 7305us (7653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872713.172186:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788872713.172258:0:89002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:89002:1875765327695488:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788872713.172272:0:89002:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788872713.172275:0:89002:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788872713.172277:0:89002:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788872713.172278:0:89002:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872713.172280:0:89002:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872713.172281:0:89002:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872713.172282:0:89002:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872713.172284:0:89002:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872713.172285:0:89002:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788872713.172287:0:89002:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872713.172288:0:89002:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788872713.172304:0:89002:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788872713.175070:0:89012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788872713.175077:0:89012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788872713.175101:0:89012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.175120:0:89012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01da1e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da1e0 expref: 10 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.175140:0:89012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.175181:0:89012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01da1e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01da1e0 expref: 10 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.175195:0:89012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01da1e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01da1e0 expref: 10 pid: 89008 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872713.175210:0:89012:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89012:1875765327695616:0@lo:104: 00000100:00100000:1.0:1788872713.175273:0:89012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.176283:0:89012:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872713.176381:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327695616 00000100:00100000:3.0:1788872713.176391:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327695616 00000100:00100000:3.0:1788872713.176476:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788872713.176487:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:89012:x1875765327695616:12345-0@lo:104: 00010000:00010000:3.0:1788872713.176504:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01da1e7 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872713.176604:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788872713.176610:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:89012:x1875765327695616:12345-0@lo:104: Request processed in 126us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872713.176617:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:0.0:1788872713.176688:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872713.176696:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01da1e7 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.176704:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872713.176707:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01da1e7 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.176716:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01da1e7 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872713.176735:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01da1e7 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872713.176740:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872713.176780:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01da1e7 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.176786:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872713.176807:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01da1e7 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.176814:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da1e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01da1e7 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.176828:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872713.176830:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872713.176831:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872713.176845:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327695744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872713.176882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872713.176938:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327695744 00000100:00100000:0.0:1788872713.176942:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327695744 00010000:00010000:0.0:1788872713.176961:0:26198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01da1e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01da1e0 expref: 11 pid: 89008 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872713.176983:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1788872713.176989:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:3645:x1875765327695744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872713.177001:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872713.177006:0:26198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01da1e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01da1e0 expref: 11 pid: 89008 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.177023:0:26198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01da1e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01da1e0 expref: 11 pid: 89008 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.177042:0:26198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.177051:0:26198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788872713.177066:0:26198:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001990163s 00010000:00010000:0.0:1788872713.177071:0:26198:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.177079:0:26198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.177086:0:26198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.177092:0:26198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.177097:0:26198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872713.177101:0:26198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.177110:0:26198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.177119:0:26198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872713.177134:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872713.177167:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:3645:x1875765327695744:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872713.177173:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1788872713.177216:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327695744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872713.181041:0:89012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c8600/0xe4e6e89fb01da1e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01da1e0 expref: 10 pid: 89008 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872713.181064:0:89012:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89012:1875765327695616:0@lo:104: 00010000:00010000:1.0:1788872713.181091:0:89012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.181101:0:89012:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.181108:0:89012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872713.181115:0:89012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01da218 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788872713.185378:0:89002:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411353 00000040:01000000:0.0:1788872713.186507:0:89002:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788872713.186778:0:89032:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411353 00000020:00080000:3.0:1788872713.186784:0:89032:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411353 00000040:01000000:0.0:1788872713.186915:0:89033:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788872713.187067:0:89002:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788872713.187302:0:89033:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788872713.187414:0:89034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89034:1875765327695872:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788872713.187480:0:89034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.187517:0:89034:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872713.187681:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327695872 00000100:00100000:3.0:1788872713.187688:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327695872 00000100:00100000:3.0:1788872713.187731:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:3.0:1788872713.187739:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89034:x1875765327695872:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788872713.187828:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89034:x1875765327695872:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 89us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872713.187836:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000040:01000000:2.0:1788872713.188185:0:89002:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788872713.188224:0:89002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788872713.188769:0:89002:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788872713.188779:0:89002:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788872713.188813:0:89002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788872713.190727:0:89034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89034:1875765327695872:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788872713.190781:0:89034:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788872713.190831:0:89034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89034:1875765327696000:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788872713.190898:0:89034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.190925:0:89034:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872713.191682:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327696000 00000100:00100000:3.0:1788872713.191691:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327696000 00000100:00100000:3.0:1788872713.191742:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:3.0:1788872713.191751:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89034:x1875765327696000:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788872713.191918:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89034:x1875765327696000:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 168us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872713.191925:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:1.0:1788872713.192006:0:89034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89034:1875765327696000:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788872713.192080:0:89034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89034:1875765327696128:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788872713.192104:0:89034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872713.192126:0:89034:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872713.192250:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327696128 00000100:00100000:3.0:1788872713.192255:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327696128 00000100:00100000:3.0:1788872713.192282:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:3.0:1788872713.192288:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89034:x1875765327696128:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788872713.192349:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89034:x1875765327696128:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 60us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872713.192369:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00100000:1.0:1788872713.192429:0:89034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89034:1875765327696128:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788872713.192468:0:89034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788872713.194575:0:89033:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788872713.194660:0:89033:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788872713.195595:0:89002:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788872713.196203:0:89002:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788872713.196247:0:89002:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788872713.196392:0:89002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788872713.200439:0:89034:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788872713.200567:0:89034:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788872713.200573:0:89034:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:2.0:1788872713.201913:0:89002:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00010000:00080000:2.0:1788872713.205002:0:89002:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182406 00010000:00080000:0.0:1788872713.210063:0:89035:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 89035 00010000:02000000:0.0:1788872713.210086:0:89035:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1788872713.210091:0:89035:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788872713.210094:0:89035:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1788872713.210335:0:89002:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788872713.210356:0:89002:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788872713.210378:0:89002:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788872713.210409:0:89002:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788872713.211335:0:89002:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788872713.211666:0:89002:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788872713.485433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872713.485491:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872713.485758:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872713.485797:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311161216 00000100:00100000:3.0:1788872713.485807:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311161216 00000100:00100000:3.0:1788872713.485859:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 25 00000100:00100000:3.0:1788872713.485868:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2403:x1875765311161216:12345-192.168.204.39@tcp:250:kworker.0 00010000:00080000:3.0:1788872713.485899:0:89009:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 8a09bb38-f574-4ce9-b65f-ec6facc58f7e@192.168.204.39@tcp t0 exp 0000000000000000 cur 3650 last 0 00000020:00000080:3.0:1788872713.485932:0:89009:0:(genops.c:1406:class_connect()) connect: client 8a09bb38-f574-4ce9-b65f-ec6facc58f7e, cookie 0xe4e6e89fb01da21f 00000100:00080000:3.0:1788872713.486072:0:89009:0:(import.c:65:import_set_state_nolock()) ffff98a9ff63c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872713.486139:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+5:2403:x1875765311161216:12345-192.168.204.39@tcp:250:kworker.0 Request processed in 270us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872713.486148:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 25 00000100:00100000:1.0:1788872713.492818:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311161088 00000100:00100000:1.0:1788872713.492850:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311161088 00000100:00100000:1.0:1788872713.492932:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311160960 00000100:00100000:1.0:1788872713.492936:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311160960 00000100:00100000:1.0:1788872713.492965:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1208 00000100:00100000:1.0:1788872713.492978:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311161088:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872713.493080:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311161088:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 104us (7657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872713.493098:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1208 00000100:00100000:1.0:1788872713.493326:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1199 00000100:00100000:1.0:1788872713.493334:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875765311160960:12345-192.168.204.39@tcp:38:kworker.0 00010000:00080000:1.0:1788872713.493375:0:66192:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '2a005fe2-2a3d-4ca6-8402-a633d5d16eb3' at ffff98a8c5113000, cookie 0xe4e6e89fb01da169 00010000:00080000:1.0:1788872713.493383:0:66192:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp recovering/t107374182407 exp ffff98a8c5113000 cur 3650 last 1788872713 00010000:02000400:1.0:1788872713.493392:0:66192:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1788872713.493398:0:66192:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1788872713.493420:0:66192:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788872713.493589:0:66192:0:(import.c:65:import_set_state_nolock()) ffff98a9ff60e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872713.493630:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311160960:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 294us (8137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872713.493637:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1199 00000100:00080000:1.0:1788872713.493664:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872713.502990:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872713.503084:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311154688 00000100:00100000:0.0:1788872713.503095:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311154688 00000100:00100000:0.0:1788872713.503174:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1200 00000100:00100000:0.0:1788872713.503187:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311154688:12345-192.168.204.39@tcp:36:mcreate.0 00010000:00080000:0.0:1788872713.503209:0:66193:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182407, current: 107374182407, replaying 00000100:00100000:0.0:1788872713.503283:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311154688:12345-192.168.204.39@tcp:36:mcreate.0 Request processed in 99us (303us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788872713.503291:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1200 00010000:00080000:1.0:1788872713.503474:0:89035:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1788872713.528841:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872714.564233:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788872714.745068:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788872714.745078:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a8c37f5000 from 115 10000000:01000000:1.0:1788872714.745084:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788872714.745148:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.745162:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.745174:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.745203:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327696256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.745304:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.745353:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.745517:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327696256 00000100:00100000:0.0:1788872714.745529:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327696256 00000100:00100000:0.0:1788872714.745621:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788872714.745639:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:6517:x1875765327696256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872714.745652:0:89008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872714.745668:0:89008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa98e200/0xe4e6e89fb01da22d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da226 expref: -99 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.745707:0:89008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa98e200/0xe4e6e89fb01da22d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da226 expref: 11 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.745718:0:89008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa98e200/0xe4e6e89fb01da22d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da226 expref: 11 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.745727:0:89008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa98e200, rc 0) 00000100:00100000:0.0:1788872714.745790:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327696256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872714.745797:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788872714.746143:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327696256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872714.746162:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.746172:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.746230:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327696384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.746267:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.746306:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.746997:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327696384 00000100:00100000:0.0:1788872714.747006:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327696384 00000100:00100000:0.0:1788872714.747061:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788872714.747070:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327696384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788872714.747090:0:89010:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788872714.747111:0:89010:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788872714.747114:0:89010:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 115 00000100:00100000:0.0:1788872714.747227:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327696384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872714.747235:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788872714.747704:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327696384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788872714.747789:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788872714.747799:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.747810:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872714.747821:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788872714.747823:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9d0cfb000 from 52 10000000:01000000:1.0:1788872714.747826:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788872714.747858:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.747866:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.747888:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.747910:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327696512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.747951:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.748004:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788872714.748139:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327696512 00000100:00100000:3.0:1788872714.748146:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327696512 00000100:00100000:3.0:1788872714.748185:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788872714.748196:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327696512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872714.748209:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872714.748224:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01da23b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da234 expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.748255:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01da23b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da234 expref: 12 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.748265:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01da23b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da234 expref: 12 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.748275:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3200, rc 0) 00000100:00100000:3.0:1788872714.748327:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327696512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872714.748334:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788872714.748644:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327696512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872714.748658:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da23b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.748668:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da23b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.748746:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327696640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.748880:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.748911:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788872714.748980:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327696640 00000100:00100000:2.0:1788872714.748997:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327696640 00000100:00100000:2.0:1788872714.749046:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788872714.749056:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327696640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872714.749197:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327696640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872714.749205:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788872714.749599:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327696640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.749640:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327696768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.749705:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.749736:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.749855:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327696768 00000100:00100000:0.0:1788872714.749861:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327696768 00000100:00100000:0.0:1788872714.749898:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788872714.749904:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327696768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872714.750041:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327696768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872714.750049:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788872714.750143:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327696768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788872714.751913:0:89096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788872714.754092:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788872714.754136:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788872714.754151:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da23b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.754167:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da23b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872714.754178:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788872714.754182:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9d0cfb000 from 112 10000000:01000000:3.0:1788872714.754184:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788872714.754230:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01da242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.754241:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01da242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.754272:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01da242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872714.757174:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327696896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872714.757254:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872714.757441:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327696896 00000100:00100000:0.0:1788872714.757451:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327696896 00000100:00100000:0.0:1788872714.757522:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788872714.757533:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327696896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872714.757568:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872714.757589:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa98ea00/0xe4e6e89fb01da249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da242 expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.757620:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa98ea00/0xe4e6e89fb01da249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da242 expref: 13 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.757632:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa98ea00/0xe4e6e89fb01da249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da242 expref: 13 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.757641:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa98ea00, rc 0) 00000100:00100000:3.0:1788872714.758246:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c1cb2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.769004:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327696896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 11448us (11724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872714.769019:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788872714.779163:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327696896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872714.779198:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01da242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da249 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.779214:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01da242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da249 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.779328:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.779412:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.779466:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788872714.779636:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327697024 00000100:00100000:2.0:1788872714.779646:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327697024 00000100:00100000:2.0:1788872714.779711:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788872714.779734:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327697024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788872714.779771:0:89008:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788872714.779791:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788872714.779795:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788872714.779799:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788872714.779802:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788872714.779804:0:89008:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 115 00000100:00100000:2.0:1788872714.779897:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327697024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 167us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872714.779905:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788872714.780891:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788872714.780999:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788872714.781010:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01da242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da249 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.781022:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01da242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da249 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872714.781032:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788872714.781034:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1788872714.781037:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788872714.781072:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01da250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.781080:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01da250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.781089:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01da250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.781109:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.781147:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.781184:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.781317:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327697152 00000100:00100000:0.0:1788872714.781324:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327697152 00000100:00100000:0.0:1788872714.781361:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788872714.781369:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327697152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872714.781381:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872714.781403:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa98e000/0xe4e6e89fb01da257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da250 expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.781438:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa98e000/0xe4e6e89fb01da257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da250 expref: 14 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.781450:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa98e000/0xe4e6e89fb01da257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da250 expref: 14 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.781459:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa98e000, rc 0) 00000100:00100000:0.0:1788872714.781522:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327697152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872714.781530:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788872714.781926:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872714.781948:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01da250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.781958:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01da250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.783276:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.783985:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.784171:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788872714.784206:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327697280 00000100:00100000:1.0:1788872714.784216:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327697280 00000100:00100000:1.0:1788872714.784274:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788872714.784294:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327697280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.784476:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327697280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872714.784484:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788872714.784546:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.784613:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.784667:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.784681:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788872714.784706:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327697408 00000100:00100000:1.0:1788872714.784710:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327697408 00000100:00100000:1.0:1788872714.784729:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788872714.784735:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327697408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.789612:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327697408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4866us (4933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872714.789643:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788872714.791147:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872714.792821:0:89098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1788872714.800712:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1788872714.800763:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788872714.800778:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01da250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.800791:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01da250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872714.800804:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788872714.800807:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a9d0cfb000 from 1 10000000:01000000:3.0:1788872714.800810:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788872714.800857:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2e00/0xe4e6e89fb01da25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.800866:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2e00/0xe4e6e89fb01da25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.800877:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2e00/0xe4e6e89fb01da25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872714.800912:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872714.802426:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872714.804715:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c1cb2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.817031:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327697536 00000100:00100000:0.0:1788872714.817052:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327697536 00000100:00100000:0.0:1788872714.817122:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788872714.817133:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327697536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872714.817153:0:89008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872714.817172:0:89008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa98e600/0xe4e6e89fb01da265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da25e expref: -99 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.817205:0:89008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa98e600/0xe4e6e89fb01da265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da25e expref: 15 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.817218:0:89008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa98e600/0xe4e6e89fb01da265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da25e expref: 15 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.817229:0:89008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa98e600, rc 0) 00000100:00100000:0.0:1788872714.817338:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327697536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (14918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872714.817346:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788872714.817706:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872714.817731:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2e00/0xe4e6e89fb01da25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.817743:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2e00/0xe4e6e89fb01da25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872714.817765:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788872714.817770:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2e00/0xe4e6e89fb01da25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.817779:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2e00/0xe4e6e89fb01da25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872714.817790:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788872714.817793:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9d0cfb000 from 7 10000000:01000000:3.0:1788872714.817797:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788872714.817825:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01da26c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.817834:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01da26c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.817842:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01da26c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872714.817864:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872714.817912:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872714.817958:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c1cb2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788872714.817975:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327697664 00000100:00100000:3.0:1788872714.817980:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327697664 00000100:00100000:3.0:1788872714.818024:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788872714.818031:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327697664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872714.818041:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872714.818052:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3600/0xe4e6e89fb01da273 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da26c expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.818069:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3600/0xe4e6e89fb01da273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da26c expref: 16 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.818080:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d3600/0xe4e6e89fb01da273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da26c expref: 16 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.818088:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3600, rc 0) 00000100:00100000:3.0:1788872714.818120:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327697664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872714.818127:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788872714.818152:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872714.818162:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01da26c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.818171:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01da26c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872714.818222:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872714.818254:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872714.818263:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c1cb2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788872714.818280:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327697792 00000100:00100000:3.0:1788872714.818283:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327697792 00000100:00100000:3.0:1788872714.818311:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788872714.818318:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa002bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327697792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872714.818431:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa002bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327697792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872714.818439:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788872714.818459:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872714.818498:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872714.818545:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872714.818585:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c1cb2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788872714.818601:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327697920 00000100:00100000:3.0:1788872714.818605:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327697920 00000100:00100000:3.0:1788872714.818621:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788872714.818627:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa002bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327697920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872714.818702:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa002bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327697920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872714.818708:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788872714.818738:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327697920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872714.823170:0:89099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788872714.823979:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788872714.824086:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788872714.824100:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01da26c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.824115:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01da26c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872714.824127:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788872714.824130:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff5b1000 from 52 10000000:01000000:0.0:1788872714.824134:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788872714.824185:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01da27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.824194:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01da27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.824206:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01da27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872714.824233:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872714.825531:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872714.825606:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2e29780 going to sleep for 11 seconds 00000100:00100000:3.0:1788872714.827344:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327698048 00000100:00100000:3.0:1788872714.827360:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327698048 00000100:00100000:3.0:1788872714.827436:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788872714.827450:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa002bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327698048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872714.827495:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872714.827527:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3000/0xe4e6e89fb01da281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da27a expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.827594:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3000/0xe4e6e89fb01da281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da27a expref: 17 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.827609:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d3000/0xe4e6e89fb01da281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da27a expref: 17 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.827620:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3000, rc 0) 00000100:00100000:3.0:1788872714.827715:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa002bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327698048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 269us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872714.827722:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788872714.828338:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872714.828359:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01da27a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872714.828371:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01da27a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872714.828457:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872714.828521:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872714.828584:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d01f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.828667:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327698176 00000100:00100000:0.0:1788872714.828673:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327698176 00000100:00100000:0.0:1788872714.828705:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788872714.828714:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa002bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327698176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872714.828852:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa002bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327698176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872714.828860:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788872714.830637:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872714.830696:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872714.830759:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872714.830802:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d01f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.830872:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327698304 00000100:00100000:0.0:1788872714.830879:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327698304 00000100:00100000:0.0:1788872714.830934:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788872714.830943:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa002bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327698304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872714.831060:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa002bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327698304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872714.831068:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788872714.831157:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788872714.832063:0:89100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788872714.832251:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788872714.832277:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872714.832299:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01da27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.832311:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01da27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872714.832320:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788872714.832322:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788872714.832326:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788872714.832358:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fe00/0xe4e6e89fb01da288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.832367:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fe00/0xe4e6e89fb01da288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.832377:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fe00/0xe4e6e89fb01da288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872714.832397:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872714.832446:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872714.832498:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2e299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872714.832665:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327698432 00000100:00100000:2.0:1788872714.832672:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327698432 00000100:00100000:2.0:1788872714.834691:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788872714.834713:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa002bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327698432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872714.834730:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872714.834750:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c8400/0xe4e6e89fb01da28f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da288 expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872714.834778:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c8400/0xe4e6e89fb01da28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da288 expref: 18 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872714.834790:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c8400/0xe4e6e89fb01da28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da288 expref: 18 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872714.834799:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8400, rc 0) 00000100:00100000:2.0:1788872714.834877:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa002bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327698432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872714.834884:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788872714.836492:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872714.836529:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fe00/0xe4e6e89fb01da288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.836542:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fe00/0xe4e6e89fb01da288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872714.836643:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872714.836694:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872714.836746:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2e299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872714.836822:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327698560 00000100:00100000:2.0:1788872714.836828:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327698560 00000100:00100000:2.0:1788872714.836885:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788872714.836894:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa002bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327698560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872714.837040:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa002bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327698560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872714.837048:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788872714.837130:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872714.837157:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872714.837199:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872714.837219:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c2e299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872714.837623:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327698688 00000100:00100000:2.0:1788872714.837629:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327698688 00000100:00100000:2.0:1788872714.837695:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788872714.837703:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa002bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327698688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872714.840635:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa002bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327698688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2924us (3426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872714.840651:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788872714.842537:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872714.843303:0:89101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1788872714.843369:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1788872714.843394:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788872714.843407:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fe00/0xe4e6e89fb01da288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.843418:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fe00/0xe4e6e89fb01da288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872714.843428:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788872714.843431:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ff5b1000 from 7 10000000:01000000:1.0:1788872714.843434:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788872714.843471:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01da296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.843481:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01da296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.843490:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01da296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.843524:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.843609:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.843649:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa8c73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.843994:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327698816 00000100:00100000:0.0:1788872714.844002:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327698816 00000100:00100000:0.0:1788872714.844043:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788872714.844051:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa002be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327698816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872714.844065:0:89008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872714.844081:0:89008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa98ec00/0xe4e6e89fb01da29d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da296 expref: -99 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.844107:0:89008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa98ec00/0xe4e6e89fb01da29d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da296 expref: 19 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.844118:0:89008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa98ec00/0xe4e6e89fb01da29d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da296 expref: 19 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.844141:0:89008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa98ec00, rc 0) 00000100:00100000:0.0:1788872714.844209:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa002be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327698816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872714.844216:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788872714.844690:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872714.844715:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01da296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.844725:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01da296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.844790:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.844821:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.844851:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa8c73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.845377:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327698944 00000100:00100000:0.0:1788872714.845384:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327698944 00000100:00100000:0.0:1788872714.845434:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788872714.845442:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa002be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327698944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872714.845653:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa002be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327698944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872714.845660:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788872714.847271:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327698944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.847350:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.847422:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.847459:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa8c73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872714.847480:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327699072 00000100:00100000:1.0:1788872714.847486:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327699072 00000100:00100000:1.0:1788872714.847545:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788872714.847568:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa002bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327699072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.847695:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa002bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327699072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872714.847704:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788872714.847751:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872714.848477:0:89102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788872714.848540:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788872714.848580:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788872714.848591:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01da296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.848609:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01da296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872714.848619:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788872714.848622:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ef97c000 from 52 10000000:01000000:1.0:1788872714.848625:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788872714.848653:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.848661:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.848670:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.848689:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.848731:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.848751:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c6585000 going to sleep for 11 seconds 00000100:00100000:1.0:1788872714.848767:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327699200 00000100:00100000:1.0:1788872714.848772:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327699200 00000100:00100000:1.0:1788872714.848798:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788872714.848804:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98aa002be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327699200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872714.848815:0:89010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872714.848827:0:89010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da2ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da2a4 expref: -99 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.848850:0:89010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da2ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da2a4 expref: 20 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.848870:0:89010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da2ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da2a4 expref: 20 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.848879:0:89010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52afa00, rc 0) 00000100:00100000:1.0:1788872714.848910:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98aa002be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327699200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872714.848917:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788872714.848953:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872714.848966:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da2a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.848975:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da2a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.849020:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.849044:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.849057:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa8c7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788872714.849069:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327699328 00000100:00100000:1.0:1788872714.849072:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327699328 00000100:00100000:1.0:1788872714.849089:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788872714.849094:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c272cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327699328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.849200:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c272cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327699328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872714.849207:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788872714.849235:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.849271:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.849306:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.849319:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa8c7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788872714.849329:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327699456 00000100:00100000:1.0:1788872714.849333:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327699456 00000100:00100000:1.0:1788872714.849349:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788872714.849355:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df45c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327699456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.849429:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df45c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327699456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872714.849436:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788872714.849472:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788872714.850403:0:89103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788872714.850463:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788872714.850481:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872714.850490:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da2a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.850509:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872714.850518:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788872714.850521:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1788872714.850524:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788872714.850580:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f400/0xe4e6e89fb01da2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.850587:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f400/0xe4e6e89fb01da2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.850605:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f400/0xe4e6e89fb01da2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872714.850627:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872714.850668:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872714.850705:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c1cb2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788872714.854132:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327699584 00000100:00100000:1.0:1788872714.854148:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327699584 00000100:00100000:1.0:1788872714.854214:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788872714.854478:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df45c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327699584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872714.854509:0:89010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872714.854532:0:89010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52af000/0xe4e6e89fb01da2b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da2b2 expref: -99 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.854745:0:89010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52af000/0xe4e6e89fb01da2b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da2b2 expref: 21 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.854758:0:89010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52af000/0xe4e6e89fb01da2b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da2b2 expref: 21 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.854767:0:89010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af000, rc 0) 00000100:00100000:1.0:1788872714.854845:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df45c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327699584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 621us (4174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872714.854862:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788872714.855479:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872714.855514:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f400/0xe4e6e89fb01da2b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.855525:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f400/0xe4e6e89fb01da2b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.857785:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.857865:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.859518:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa8c7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.861821:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327699712 00000100:00100000:0.0:1788872714.861839:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327699712 00000100:00100000:0.0:1788872714.861904:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788872714.861914:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df45d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327699712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872714.862136:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df45d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327699712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (4271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872714.862144:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788872714.863965:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.864042:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.864134:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.864182:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa8c7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788872714.865199:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327699840 00000100:00100000:2.0:1788872714.865209:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327699840 00000100:00100000:2.0:1788872714.865290:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788872714.865302:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df45d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327699840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872714.866609:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df45d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327699840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1304us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872714.866621:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788872714.866762:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872714.869087:0:89104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1788872714.869463:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788872714.869491:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788872714.869513:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f400/0xe4e6e89fb01da2b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872714.869526:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f400/0xe4e6e89fb01da2b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872714.869537:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788872714.869540:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ef97c000 from 7 10000000:01000000:2.0:1788872714.869543:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788872714.869602:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01da2c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872714.869610:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01da2c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872714.869622:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01da2c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872714.869671:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872714.869743:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872714.869773:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef209840 going to sleep for 11 seconds 00000100:00100000:2.0:1788872714.869796:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327699968 00000100:00100000:2.0:1788872714.869802:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327699968 00000100:00100000:2.0:1788872714.869851:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788872714.869862:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df45f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327699968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872714.869878:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872714.869895:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c9000/0xe4e6e89fb01da2c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da2c0 expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872714.869919:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c9000/0xe4e6e89fb01da2c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da2c0 expref: 22 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872714.869930:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c9000/0xe4e6e89fb01da2c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da2c0 expref: 22 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872714.869940:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9000, rc 0) 00000100:00100000:2.0:1788872714.869978:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df45f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327699968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872714.869985:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788872714.870039:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327699968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872714.870055:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01da2c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872714.870065:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01da2c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872714.870131:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327700096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872714.870158:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872714.870175:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef209840 going to sleep for 11 seconds 00000100:00100000:2.0:1788872714.870187:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327700096 00000100:00100000:2.0:1788872714.870191:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327700096 00000100:00100000:2.0:1788872714.870215:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788872714.870222:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327700096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872714.870416:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327700096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872714.870423:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788872714.870455:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327700096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872714.870482:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327700224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872714.870529:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872714.870546:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef209840 going to sleep for 11 seconds 00000100:00100000:3.0:1788872714.870565:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327700224 00000100:00100000:3.0:1788872714.870570:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327700224 00000100:00100000:3.0:1788872714.870597:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788872714.870603:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cb889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327700224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872714.870681:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cb889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327700224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872714.870931:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788872714.870974:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327700224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872714.874017:0:89105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788872714.874124:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788872714.874161:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788872714.874172:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01da2c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.874184:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01da2c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872714.874204:0:6517:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788872714.874206:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98a9e9b999c0 from 1 10000000:01000000:3.0:1788872714.874209:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788872714.874250:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3400/0xe4e6e89fb01da2ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.874258:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3400/0xe4e6e89fb01da2ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.874269:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3400/0xe4e6e89fb01da2ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872714.874297:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327700352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872714.874361:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872714.874412:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c493f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.874488:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327700352 00000100:00100000:0.0:1788872714.874495:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327700352 00000100:00100000:0.0:1788872714.874585:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788872714.874595:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cb88a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327700352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872714.874608:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872714.874623:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa98f200/0xe4e6e89fb01da2d5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da2ce expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.874654:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa98f200/0xe4e6e89fb01da2d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da2ce expref: 23 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.874664:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa98f200/0xe4e6e89fb01da2d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da2ce expref: 23 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872714.874674:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa98f200, rc 0) 00000100:00100000:0.0:1788872714.874732:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cb88a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327700352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872714.874739:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788872714.876202:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327700352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872714.876225:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3400/0xe4e6e89fb01da2ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.876236:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3400/0xe4e6e89fb01da2ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da2d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872714.876258:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788872714.876263:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3400/0xe4e6e89fb01da2ce lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.876271:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3400/0xe4e6e89fb01da2ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872714.876377:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788872714.876380:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98a9e9b999c0 from 1 10000000:01000000:1.0:1788872714.876383:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788872714.876420:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52afc00/0xe4e6e89fb01da2dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.876428:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52afc00/0xe4e6e89fb01da2dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.876437:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52afc00/0xe4e6e89fb01da2dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.876459:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327700480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.876518:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.876589:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3771180 going to sleep for 11 seconds 00000100:00100000:3.0:1788872714.878600:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327700480 00000100:00100000:3.0:1788872714.878614:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327700480 00000100:00100000:3.0:1788872714.878687:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788872714.878697:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cb888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327700480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872714.878716:0:89008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872714.878736:0:89008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d2200/0xe4e6e89fb01da2e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da2dc expref: -99 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.878765:0:89008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d2200/0xe4e6e89fb01da2e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da2dc expref: 24 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.878775:0:89008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d2200/0xe4e6e89fb01da2e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da2dc expref: 24 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872714.878798:0:89008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2200, rc 0) 00000100:00100000:3.0:1788872714.878886:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cb888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327700480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872714.878893:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788872714.879668:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327700480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872714.879690:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52afc00/0xe4e6e89fb01da2dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.879701:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52afc00/0xe4e6e89fb01da2dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da2e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872714.879784:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327700608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872714.879824:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872714.879864:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3771180 going to sleep for 11 seconds 00000100:00100000:0.0:1788872714.879911:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327700608 00000100:00100000:0.0:1788872714.879917:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327700608 00000100:00100000:0.0:1788872714.879952:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788872714.879959:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cb889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327700608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872714.880061:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cb889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327700608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (235us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788872714.880069:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788872714.880365:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327700608:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788872714.880396:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788872714.880413:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52afc00/0xe4e6e89fb01da2dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872714.880422:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52afc00/0xe4e6e89fb01da2dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da2e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872715.216928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872715.217455:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311161344 00000100:00100000:1.0:1788872715.217469:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311161344 00000100:00100000:1.0:1788872715.217574:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 61 00000100:00100000:1.0:1788872715.217588:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+5:42482:x1875765311161344:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872715.217607:0:89010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872715.217627:0:89010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52aec00/0xe4e6e89fb01da2ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faee9 expref: -99 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872715.217656:0:89010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52aec00/0xe4e6e89fb01da2ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faee9 expref: 6 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872715.217667:0:89010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52aec00/0xe4e6e89fb01da2ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faee9 expref: 6 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872715.217675:0:89010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52aec00, rc 0) 00000100:00100000:1.0:1788872715.217742:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311161344:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 158us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872715.217749:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 61 00000100:00100000:2.0:1788872715.236673:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872715.236816:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311161472 00000100:00100000:3.0:1788872715.236828:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311161472 00000100:00100000:3.0:1788872715.236893:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:3.0:1788872715.236903:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f68c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311161472:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788872715.236933:0:89008:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788872715.236961:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788872715.236965:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788872715.236968:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788872715.236971:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788872715.236973:0:89008:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 115 00000100:00100000:2.0:1788872715.244210:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f68c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311161472:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 Request processed in 7296us (7535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872715.244224:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:0.0:1788872715.251078:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872715.251176:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311161600 00000100:00100000:2.0:1788872715.251187:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311161600 00000100:00100000:2.0:1788872715.251256:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:2.0:1788872715.251267:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9d0049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311161600:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872715.251285:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872715.251305:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c8000/0xe4e6e89fb01da2f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faef0 expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872715.251363:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c8000/0xe4e6e89fb01da2f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faef0 expref: 7 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872715.251374:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c8000/0xe4e6e89fb01da2f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faef0 expref: 7 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872715.251384:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8000, rc 0) 00000100:00100000:2.0:1788872715.251449:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9d0049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+7:42482:x1875765311161600:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 184us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872715.251456:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:3.0:1788872715.267187:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872715.268114:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311161728 00000100:00100000:2.0:1788872715.268129:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311161728 00000100:00100000:2.0:1788872715.268208:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 64 00000100:00100000:2.0:1788872715.268219:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+7:42482:x1875765311161728:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872715.268385:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311161728:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 167us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872715.268393:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 64 00000100:00100000:1.0:1788872715.285448:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872715.286208:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311161856 00000100:00100000:0.0:1788872715.286219:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311161856 00000100:00100000:0.0:1788872715.286293:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 65 00000100:00100000:0.0:1788872715.286303:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c246bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311161856:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872715.286606:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c246bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311161856:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 304us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872715.286614:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 65 00000100:00100000:0.0:1788872715.322927:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872715.326781:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311161984 00000100:00100000:3.0:1788872715.326800:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311161984 00000100:00100000:3.0:1788872715.327111:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 66 00000100:00100000:3.0:1788872715.327123:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c2469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311161984:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872715.327142:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872715.327166:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01da2f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faef7 expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872715.327196:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01da2f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faef7 expref: 9 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872715.327229:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01da2f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faef7 expref: 9 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872715.327238:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3800, rc 0) 00000100:00100000:3.0:1788872715.327326:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c2469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311161984:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 206us (4405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872715.327332:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 66 00000100:00100000:2.0:1788872715.344104:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872715.346390:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311162112 00000100:00100000:3.0:1788872715.346407:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311162112 00000100:00100000:3.0:1788872715.346506:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 67 00000100:00100000:3.0:1788872715.346518:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c246b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311162112:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872715.346751:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c246b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311162112:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 234us (2659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872715.346759:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 67 00000100:00100000:2.0:1788872715.350440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872715.350962:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311162240 00000100:00100000:3.0:1788872715.350992:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311162240 00000100:00100000:3.0:1788872715.351087:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 68 00000100:00100000:3.0:1788872715.351101:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c2469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311162240:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872715.351445:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c2469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311162240:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 346us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872715.351455:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 68 00000100:00100000:2.0:1788872715.367423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872715.368824:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311162368 00000100:00100000:3.0:1788872715.368849:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311162368 00000100:00100000:3.0:1788872715.368968:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 69 00000100:00100000:3.0:1788872715.368982:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c246a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311162368:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872715.369034:0:89008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872715.369062:0:89008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01da2ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faefe expref: -99 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872715.369105:0:89008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01da2ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faefe expref: 10 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872715.369120:0:89008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01da2ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faefe expref: 10 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872715.369133:0:89008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3c00, rc 0) 00000100:00100000:3.0:1788872715.369217:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c246a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:42482:x1875765311162368:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 238us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872715.369225:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 69 00000100:00100000:2.0:1788872715.376075:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872715.379775:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311162496 00000100:00100000:0.0:1788872715.379799:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311162496 00000100:00100000:0.0:1788872715.380008:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 70 00000100:00100000:0.0:1788872715.380022:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:42482:x1875765311162496:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872715.380225:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:42482:x1875765311162496:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 204us (4164us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788872715.380236:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 70 00010000:00010000:2.0:1788872715.577715:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872715.960942:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872715.960974:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327700736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872715.961050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872715.961109:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327700736 00000100:00100000:2.0:1788872715.961118:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327700736 00000100:00100000:2.0:1788872715.961178:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:2.0:1788872715.961187:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327700736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872715.961215:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872715.961256:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327700736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872715.961496:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872715.961508:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327700864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872715.961539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788872715.961623:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872715.961641:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327700864 00000100:00100000:0.0:1788872715.961645:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327700864 00000100:00100000:0.0:1788872715.961676:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:0.0:1788872715.961683:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327700864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872715.961699:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872715.961737:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327700864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872715.961744:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00080000:0.0:1788872715.961763:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872715.961796:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327700864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872715.961835:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327700736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872715.961946:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00010000:00010000:3.0:1788872716.611584:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872717.625254:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788872718.520932:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872718.520940:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872718.520945:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872718.520956:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3650 00000100:00080000:0.0:1788872718.520969:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872718.520980:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872718.521009:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1eed880 x1875765327701120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872718.521037:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872718.521040:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872718.521042:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872718.521045:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3650 00000100:00080000:0.0:1788872718.521048:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872718.521052:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872718.521063:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1eece00 x1875765327701376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872718.521090:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872718.521094:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872718.521095:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872718.521099:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3650 00000100:00080000:0.0:1788872718.521101:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872718.521105:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872718.521116:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c1eee300 x1875765327701632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872718.521141:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872718.521144:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872718.521146:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872718.521149:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3650 00000100:00080000:0.0:1788872718.521175:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872718.521179:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872718.521193:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f663f800 x1875765327702016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872718.521221:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788872718.521224:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872718.521226:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0ad800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872718.521231:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98a9ef0ad800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872718.521241:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f663f480 x1875765327702528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872718.521309:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327701248:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.521385:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.521458:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327702144:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.521493:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.521526:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788872718.521532:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327700992:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.521586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872718.521616:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327700992 00000100:00100000:2.0:1788872718.521624:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327700992 00000100:00100000:0.0:1788872718.521624:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327701888:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.521655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.521677:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327702656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872718.521685:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788872718.521697:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c2469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327700992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.521705:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.521741:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327701120:0@lo:38:kworker.0 00000100:00100000:2.0:1788872718.521766:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c2469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327700992:12345-0@lo:400:kworker.0 Request processed in 72us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.521775:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872718.521778:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788872718.521805:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327701376:0@lo:38:kworker.0 00000100:00100000:0.0:1788872718.521838:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.521858:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327701632:0@lo:38:kworker.0 00000100:00100000:0.0:1788872718.521878:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.521899:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327702016:0@lo:38:kworker.0 00000100:00100000:0.0:1788872718.521923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.521945:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327702528:0@lo:38:kworker.0 00000100:00100000:0.0:1788872718.521981:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.522019:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327701504:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.522043:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.522066:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327702272:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.522086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.522106:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788872718.522111:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327701760:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.522129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.522145:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327702400:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.522162:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.522189:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327702144 00000100:00100000:0.0:1788872718.522193:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327702144 00000100:00100000:0.0:1788872718.522221:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327702656 00000100:00100000:0.0:1788872718.522224:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327702656 00000100:00100000:0.0:1788872718.522233:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327701632 00000100:00100000:0.0:1788872718.522235:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327701632 00000100:00100000:0.0:1788872718.522243:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:0.0:1788872718.522247:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875765327702144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.522284:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875765327702144:12345-0@lo:400:kworker.0 Request processed in 34us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.522299:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:0.0:1788872718.522313:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:0.0:1788872718.522317:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327702656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788872718.522343:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:0.0:1788872718.522377:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327702656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.522382:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:0.0:1788872718.522394:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:0.0:1788872718.522398:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327701632:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788872718.522421:0:8446:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff98a8c5116800, cookie 0xe4e6e89fb01da170 00010000:00080000:0.0:1788872718.522439:0:8446:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378652 exp ffff98a8c5116800 cur 3655 last 1788872713 00000004:00100000:0.0:1788872718.522461:0:8446:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788872718.522627:0:8446:0:(import.c:65:import_set_state_nolock()) ffff98a9f0834800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872718.522680:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327701632:12345-0@lo:38:kworker.0 Request processed in 280us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.522687:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00100000:0.0:1788872718.522717:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327701248 00000100:00100000:0.0:1788872718.522721:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327701248 00000100:00100000:0.0:1788872718.522760:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327701120 00000100:00100000:0.0:1788872718.522763:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327701120 00000100:00100000:0.0:1788872718.522772:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327701376 00000100:00100000:0.0:1788872718.522774:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327701376 00000100:00100000:0.0:1788872718.522781:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327702016 00000100:00100000:0.0:1788872718.522783:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327702016 00000100:00100000:0.0:1788872718.522790:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327702528 00000100:00100000:0.0:1788872718.522791:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327702528 00000100:00100000:0.0:1788872718.522798:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327701504 00000100:00100000:0.0:1788872718.522807:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327701504 00000100:00100000:0.0:1788872718.522827:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1788872718.522833:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327701248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.522881:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327701248:12345-0@lo:400:kworker.0 Request processed in 47us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.522887:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1788872718.522900:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:0.0:1788872718.522905:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327701504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.522942:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327701504:12345-0@lo:400:kworker.0 Request processed in 37us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.522948:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:0.0:1788872718.522961:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1788872718.522965:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327701120:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788872718.522980:0:66190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3655 last 0 00000020:00000080:0.0:1788872718.523012:0:66190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe4e6e89fb01da306 00000004:00100000:0.0:1788872718.523019:0:66190:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788872718.523035:0:66190:0:(import.c:65:import_set_state_nolock()) ffff98a9f0833800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872718.523063:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875765327701120:12345-0@lo:38:kworker.0 Request processed in 96us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.523068:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1788872718.523078:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1788872718.523081:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327701376:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788872718.523091:0:66190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3655 last 0 00000020:00000080:0.0:1788872718.523115:0:66190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe4e6e89fb01da30d 00000004:00100000:0.0:1788872718.523120:0:66190:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788872718.523139:0:66190:0:(import.c:65:import_set_state_nolock()) ffff98a9f0833000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872718.523169:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875765327701376:12345-0@lo:38:kworker.0 Request processed in 86us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.523176:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1788872718.523190:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1788872718.523195:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327702016:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788872718.523206:0:66190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3655 last 0 00000020:00000080:0.0:1788872718.523228:0:66190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe4e6e89fb01da314 00000004:00100000:0.0:1788872718.523234:0:66190:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788872718.523252:0:66190:0:(import.c:65:import_set_state_nolock()) ffff98a9c8f4a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872718.523283:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875765327702016:12345-0@lo:38:kworker.0 Request processed in 87us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.523289:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1788872718.523302:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1788872718.523305:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327702528:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788872718.523317:0:66190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3655 last 0 00000020:00000080:0.0:1788872718.523337:0:66190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe4e6e89fb01da31b 00000004:00100000:0.0:1788872718.523343:0:66190:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788872718.523356:0:66190:0:(import.c:65:import_set_state_nolock()) ffff98a8c6773000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872718.523386:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875765327702528:12345-0@lo:38:kworker.0 Request processed in 79us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.523392:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1788872718.523439:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327701888 00000100:00100000:0.0:1788872718.523443:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327701888 00000100:00100000:0.0:1788872718.523479:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327702272 00000100:00100000:0.0:1788872718.523483:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327702272 00000100:00100000:0.0:1788872718.523512:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327701760 00000100:00100000:0.0:1788872718.523515:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327701760 00000100:00100000:0.0:1788872718.523530:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327702400 00000100:00100000:0.0:1788872718.523534:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327702400 00000100:00100000:0.0:1788872718.523581:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:0.0:1788872718.523588:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327701888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.523626:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327701888:12345-0@lo:400:kworker.0 Request processed in 38us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.523633:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:0.0:1788872718.523645:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:0.0:1788872718.523651:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327702272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.523682:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327702272:12345-0@lo:400:kworker.0 Request processed in 32us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.523687:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:0.0:1788872718.523697:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:1.0:1788872718.524043:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:1.0:1788872718.524053:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327702400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872718.524092:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327702400:12345-0@lo:400:kworker.0 Request processed in 42us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872718.524105:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00010000:00080000:1.0:1788872718.524137:0:89035:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788872718.524142:0:89035:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 107374182407 00000020:00080000:1.0:1788872718.524146:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872718.524149:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182407, next_transno: 107374182407 00010000:00080000:1.0:1788872718.524154:0:89035:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182407) 00000020:00080000:1.0:1788872718.524156:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872718.524166:0:89035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311154688 t107374182407 from 192.168.204.39@tcp req@ffff98a8c5acdf80 x1875765311154688/t0(107374182407) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:639/0 lens 528/0 e 0 to 0 dl 1788872724 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788872718.524837:0:89035:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 622us 00000100:00080000:2.0:1788872718.529584:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872718.529595:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872718.529598:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872718.535198:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327701760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.538826:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327701760:12345-0@lo:400:kworker.0 Request processed in 15113us (16685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872718.538843:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:0.0:1788872718.538955:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327701760:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.538972:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327702400:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.538984:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327701504:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.538996:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327702272:0@lo:400:kworker.0 00010000:00080000:0.0:1788872718.539050:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a8c1eed880 x1875765327701120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872718.539093:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00080000:0.0:1788872718.540350:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff98a8c1eed880 x1875765327701120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872743 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872718.540362:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788872718.540369:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788872718.540373:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788872718.540379:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327701120:0@lo:38:kworker.0 00010000:00080000:0.0:1788872718.540410:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a8c1eece00 x1875765327701376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872718.546338:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00080000:0.0:1788872718.547256:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff98a8c1eece00 x1875765327701376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872743 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872718.547269:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788872718.547275:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788872718.547279:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788872718.547285:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327701376:0@lo:38:kworker.0 00000100:00080000:0.0:1788872718.547323:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:0.0:1788872718.547333:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1788872718.547337:0:3643:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1788872718.547339:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:0.0:1788872718.547343:0:3643:0:(recover.c:53:ptlrpc_replay_next()) import ffff98a9df8c9800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:0.0:1788872718.547346:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1788872718.547400:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327700992:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.552624:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327701888:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.554095:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327702656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872718.554123:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327701248:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.554134:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327702144:0@lo:400:kworker.0 00000100:00100000:0.0:1788872718.554214:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327701632:0@lo:38:kworker.0 00010000:00080000:0.0:1788872718.554234:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9f663f800 x1875765327702016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872718.554324:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00000100:00080000:0.0:1788872718.559544:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff98a9f663f800 x1875765327702016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872743 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872718.559581:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788872718.559589:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788872718.559596:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788872718.559603:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327702016:0@lo:38:kworker.0 00010000:00080000:0.0:1788872718.559642:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9f663f480 x1875765327702528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872718.559659:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:0.0:1788872718.559668:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788872718.559673:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788872718.559675:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0ad800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788872718.559680:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327702528:0@lo:38:kworker.0 00010000:00080000:0.0:1788872718.559727:0:89234:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1788872718.559740:0:89234:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1788872718.559745:0:89234:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1788872718.560161:0:89234:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1788872718.560211:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327702784:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788872718.560272:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.560353:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327702784 00000100:00100000:0.0:1788872718.560359:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327702784 00000100:00100000:0.0:1788872718.560398:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:0.0:1788872718.560406:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327702784:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788872718.563539:0:8446:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a8c7833b80 x1875765327702784/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:644/0 lens 224/0 e 0 to 0 dl 1788872729 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872718.563580:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327702784:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 3174us (3307us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788872718.563591:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00010000:00010000:1.0:1788872718.571409:0:89035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da322 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.571442:0:89035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da322 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.571456:0:89035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da322 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.571471:0:89035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da329 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.571478:0:89035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da329 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.571485:0:89035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da329 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.571910:0:89035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da322 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.571932:0:89035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da322 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.571938:0:89035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da322 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.571944:0:89035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872718.571949:0:89035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da322 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.571956:0:89035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da322 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.571968:0:89035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4100) 00010000:00010000:1.0:1788872718.571970:0:89035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872718.571974:0:89035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da322 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.571981:0:89035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da322 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872718.572001:0:89035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f68e5c8 reply state 00000000baf93900 transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da329 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.572011:0:89035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da329 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.572018:0:89035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4400) 00010000:00010000:1.0:1788872718.572021:0:89035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872718.572024:0:89035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788872718.572143:0:89035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1788872718.572175:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872718.572179:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000020:00080000:1.0:1788872718.572183:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872718.572185:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000001:00080000:2.0:1788872718.583571:0:89003:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00010000:00010000:1.0:1788872718.584850:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da329 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.584869:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da329 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.584877:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da329 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.584883:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872718.584888:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da329 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.584896:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da329 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.584915:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4400) 00010000:00010000:1.0:1788872718.584918:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872718.584924:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da329 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872718.584930:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da329 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872718.585588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872718.585934:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311155200 00000100:00100000:3.0:1788872718.585944:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311155200 00000100:00100000:3.0:1788872718.586008:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1205 00000100:00100000:3.0:1788872718.586019:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311155200:12345-192.168.204.39@tcp:36:rm.0 00010000:00080000:3.0:1788872718.586041:0:66190:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:3.0:1788872718.586061:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311155200:12345-192.168.204.39@tcp:36:rm.0 Request processed in 45us (478us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872718.586069:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1205 00000020:00080000:2.0:1788872718.586118:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872718.586123:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:2.0:1788872718.586127:0:89035:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:2.0:1788872718.586130:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872718.586140:0:89035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311155200 t107374182408 from 192.168.204.39@tcp req@ffff98a9f85c7800 x1875765311155200/t0(107374182408) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:644/0 lens 512/0 e 0 to 0 dl 1788872729 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788872718.586230:0:89035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da330 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586271:0:89035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da330 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586284:0:89035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da330 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586298:0:89035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8a00/0xe4e6e89fb01da337 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586304:0:89035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8a00/0xe4e6e89fb01da337 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586311:0:89035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8a00/0xe4e6e89fb01da337 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586404:0:89035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01da33e lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586412:0:89035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01da33e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586418:0:89035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01da33e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586714:0:89035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01da33e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586723:0:89035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01da33e lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586729:0:89035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01da33e lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586744:0:89035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872718.586748:0:89035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01da33e lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586755:0:89035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01da33e lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586767:0:89035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff98a9d24aa400) 00010000:00010000:2.0:1788872718.586770:0:89035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788872718.586774:0:89035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01da33e lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586780:0:89035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01da33e lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586802:0:89035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da330 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586807:0:89035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da330 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586813:0:89035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da330 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586817:0:89035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872718.586820:0:89035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da330 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586826:0:89035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da330 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586842:0:89035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d24aaf00) 00010000:00010000:2.0:1788872718.586845:0:89035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872718.586848:0:89035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da330 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586853:0:89035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da330 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872718.586865:0:89035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071e76953 reply state 00000000ab3c89bc transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8a00/0xe4e6e89fb01da337 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586875:0:89035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8a00/0xe4e6e89fb01da337 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.586881:0:89035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9d24aa500) 00010000:00010000:2.0:1788872718.586883:0:89035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872718.586886:0:89035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788872718.586953:0:89035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788872718.586968:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872718.586970:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:2.0:1788872718.586974:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872718.586976:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000100:00100000:0.0:1788872718.592196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872718.592263:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311157248 00000100:00100000:0.0:1788872718.592274:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311157248 00000100:00100000:0.0:1788872718.592331:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1206 00000100:00100000:0.0:1788872718.592342:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2403:x1875765311157248:12345-192.168.204.39@tcp:36:dd.0 00010000:00080000:0.0:1788872718.592365:0:83669:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182410, replaying 00000100:00100000:0.0:1788872718.592381:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2403:x1875765311157248:12345-192.168.204.39@tcp:36:dd.0 Request processed in 41us (194us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788872718.592389:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1206 00000020:00080000:0.0:1788872718.595614:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872718.595624:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182410, next_transno: 107374182409 00010000:00080000:0.0:1788872718.595637:0:89035:0:(ldlm_lib.c:2258:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182409, ql: 1, comp: 1, conn: 2, next: 107374182410, next_update 0 last_committed: 107374182407) 00000020:00080000:0.0:1788872718.595643:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872718.595656:0:89035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311157248 t107374182410 from 192.168.204.39@tcp req@ffff98a8c7831f80 x1875765311157248/t0(107374182410) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:644/0 lens 488/0 e 0 to 0 dl 1788872729 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788872718.595887:0:89035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fa00/0xe4e6e89fb01da345 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.595905:0:89035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fa00/0xe4e6e89fb01da345 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.595919:0:89035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fa00/0xe4e6e89fb01da345 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872718.596032:0:89035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000487befb6 reply state 0000000031f492da transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fa00/0xe4e6e89fb01da345 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.596044:0:89035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fa00/0xe4e6e89fb01da345 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.596052:0:89035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9d14a2700) 00010000:00010000:0.0:1788872718.596055:0:89035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872718.596058:0:89035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788872718.596170:0:89035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788872718.596189:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872718.596192:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000020:00080000:0.0:1788872718.596196:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872718.596198:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000100:00100000:3.0:1788872718.604789:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872718.604884:0:66205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311157504 00000100:00100000:1.0:1788872718.604897:0:66205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311157504 00000100:00100000:1.0:1788872718.604972:0:66205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1 00000100:00100000:1.0:1788872718.604981:0:66205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2403:x1875765311157504:12345-192.168.204.39@tcp:10:dd.0 00010000:00080000:1.0:1788872718.604998:0:66205:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182411, current: 107374182411, replaying 00000100:00100000:1.0:1788872718.605021:0:66205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2403:x1875765311157504:12345-192.168.204.39@tcp:10:dd.0 Request processed in 42us (246us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872718.605028:0:66205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1 00000020:00080000:3.0:1788872718.605070:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872718.605075:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182411, next_transno: 107374182411 00010000:00080000:3.0:1788872718.605086:0:89035:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182411) 00000020:00080000:3.0:1788872718.605089:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872718.605097:0:89035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311157504 t107374182411 from 192.168.204.39@tcp req@ffff98a9ef1b8000 x1875765311157504/t0(107374182411) o10->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:644/0 lens 440/0 e 0 to 0 dl 1788872729 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788872718.605411:0:89035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788872718.605441:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872718.605445:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000020:00080000:3.0:1788872718.605448:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872718.605450:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000100:00100000:3.0:1788872718.606372:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872718.606417:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872718.606500:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311162752 00000100:00100000:1.0:1788872718.606507:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311162752 00000100:00100000:1.0:1788872718.606584:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1211 00000100:00100000:1.0:1788872718.606593:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311162752:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872718.606642:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311162752:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 51us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872718.606649:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1211 00000100:00080000:3.0:1788872718.606809:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872718.607763:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311162624 00000100:00100000:1.0:1788872718.607771:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311162624 00000100:00100000:1.0:1788872718.607817:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 72 00000100:00100000:1.0:1788872718.607825:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311162624:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872718.607876:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311162624:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 52us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872718.607884:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 72 00000100:00100000:1.0:1788872718.609840:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872718.609908:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311162880 00000100:00100000:3.0:1788872718.609926:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311162880 00000100:00100000:3.0:1788872718.609980:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1207 00000100:00100000:3.0:1788872718.609989:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2403:x1875765311162880:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788872718.610015:0:66190:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a8c38b4700 x1875765311162880/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:644/0 lens 328/0 e 0 to 0 dl 1788872729 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872718.610040:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2403:x1875765311162880:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 52us (208us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872718.610047:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1207 00000020:00080000:2.0:1788872718.610138:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872718.610143:0:89035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182412 00010000:00080000:2.0:1788872718.610146:0:89035:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1788872718.610149:0:89035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872718.610156:0:89035:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788872718.610158:0:89035:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788872718.610170:0:89035:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a8c38b4700 x1875765311162880/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:644/0 lens 328/0 e 0 to 0 dl 1788872729 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788872718.610199:0:89035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872718.610234:0:89035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 2/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faedb expref: -99 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.610268:0:89035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 12 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.610285:0:89035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 12 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.610295:0:89035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8800, rc 0) 00010000:00080000:2.0:1788872718.610353:0:89035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788872718.610363:0:89035:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788872718.619818:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872718.620030:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311163008 00000100:00100000:0.0:1788872718.620040:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311163008 00000100:00100000:0.0:1788872718.621945:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1212 00000100:00100000:0.0:1788872718.621964:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2403:x1875765311163008:12345-192.168.204.39@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1788872718.621987:0:83669:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a9ef1bbb80 x1875765311163008/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:644/0 lens 224/0 e 0 to 0 dl 1788872729 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872718.622006:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2403:x1875765311163008:12345-192.168.204.39@tcp:400:ptlrpcd_rcv.0 Request processed in 50us (2201us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788872718.622012:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1212 00010000:00080000:3.0:1788872718.622461:0:89035:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788872718.622623:0:89035:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:3.0:1788872718.627956:0:89003:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00100000:3.0:1788872718.627969:0:89003:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788872718.628005:0:89003:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182411 is committed 00000001:00080000:3.0:1788872718.628051:0:89035:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788872718.628095:0:89035:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788872718.628110:0:89035:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff98a8c7833b80 x1875765327702784/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:644/0 lens 224/0 e 0 to 0 dl 1788872729 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788872718.628243:0:89035:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.39@tcp: req@ffff98a9ef1bbb80 x1875765311163008/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:644/0 lens 224/0 e 0 to 0 dl 1788872729 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872718.628291:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788872718.628299:0:3643:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff98a8c7833480 x1875765327702784/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872734 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872718.628308:0:3643:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff98a8c7833480 x1875765327702784/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872734 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872718.628314:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788872718.628326:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788872718.628330:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327702784:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788872718.628397:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327702912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872718.628441:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872718.628486:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327702912 00000100:00100000:3.0:1788872718.628493:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327702912 00000100:00100000:3.0:1788872718.628534:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:3.0:1788872718.628543:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327702912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872718.628589:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1445109760 avail 1298870272 00000100:00100000:3.0:1788872718.628627:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327702912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872718.628635:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:3.0:1788872718.628680:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327702912:0@lo:41:osp-pre-0-1.0 00010000:02000000:3.0:1788872718.628745:0:89035:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:2.0:1788872718.632064:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8a00/0xe4e6e89fb01da337 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632082:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8a00/0xe4e6e89fb01da337 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632090:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8a00/0xe4e6e89fb01da337 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632097:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872718.632101:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8a00/0xe4e6e89fb01da337 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632109:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8a00/0xe4e6e89fb01da337 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632136:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9d24aa500) 00010000:00010000:2.0:1788872718.632140:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872718.632145:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8a00/0xe4e6e89fb01da337 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632151:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8a00/0xe4e6e89fb01da337 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632178:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fa00/0xe4e6e89fb01da345 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632184:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fa00/0xe4e6e89fb01da345 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632189:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fa00/0xe4e6e89fb01da345 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632193:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98fa00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872718.632202:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fa00/0xe4e6e89fb01da345 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632208:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fa00/0xe4e6e89fb01da345 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632217:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9d14a2700) 00010000:00010000:2.0:1788872718.632219:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872718.632222:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fa00/0xe4e6e89fb01da345 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.632226:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa98fa00/0xe4e6e89fb01da345 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872718.645483:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872718.645525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872718.645572:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311158784 00000100:00100000:2.0:1788872718.645582:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311158784 00000100:00100000:2.0:1788872718.645645:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1208 00000100:00100000:2.0:1788872718.645656:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:0:x1875765311158784:12345-192.168.204.39@tcp:16:kworker.0 00000100:00100000:2.0:1788872718.645786:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:0:x1875765311158784:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 132us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872718.645794:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1208 00000100:00100000:0.0:1788872718.646385:0:66207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311158656 00000100:00100000:0.0:1788872718.646391:0:66207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311158656 00002000:00100000:0.0:1788872718.646422:0:66207:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff98a8c5acf100 x1875765311158656/t0(0) o4->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:644/0 lens 496/0 e 0 to 0 dl 1788872729 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872718.646443:0:66207:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff98a8c5acf100 with x1875765311158656 00002000:00010000:0.0:1788872718.646456:0:66207:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 7 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872718.646490:0:66207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2 00000100:00100000:0.0:1788872718.646500:0:66207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:0:x1875765311158656:12345-192.168.204.39@tcp:4:dd.0 00000100:00100000:0.0:1788872718.653145:0:66207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:0:x1875765311158656:12345-192.168.204.39@tcp:4:dd.0 Request processed in 6636us (7607us total) trans 111669149697 rc 0/0 00000100:00100000:0.0:1788872718.653161:0:66207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2 00002000:00100000:0.0:1788872718.653175:0:66207:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff98a8c5acf100 x1875765311158656/t111669149697(0) o4->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:644/0 lens 496/448 e 0 to 0 dl 1788872729 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872718.653185:0:66207:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff98a8c5acf100 with x1875765311158656 00002000:00010000:0.0:1788872718.653194:0:66207:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 9 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.654306:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1788872718.689176:0:89035:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb002c869fe10 00100000:10000000:3.0:1788872718.689193:0:89035:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1788872718.703739:0:89023:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:0.0:1788872718.703792:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89023:1875765327703040:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788872718.703861:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.703948:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5ea86c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788872718.704184:0:89021:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:2.0:1788872718.704223:0:89021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89021:1875765327703168:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788872718.704272:0:89021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872718.708972:0:89021:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d01f1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788872718.709013:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327703040 00000100:00100000:2.0:1788872718.709022:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327703040 00000100:00100000:0.0:1788872718.715235:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327703168 00000100:00100000:0.0:1788872718.715251:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327703168 00000100:00100000:0.0:1788872718.715315:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5958 00000100:00100000:0.0:1788872718.715327:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6a9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:89023:x1875765327703040:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788872718.715370:0:26194:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -127 00002000:02000040:0.0:1788872718.715375:0:26194:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:801) 00000100:00100000:3.0:1788872718.721631:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5959 00000100:00100000:3.0:1788872718.721659:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:89021:x1875765327703168:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788872718.721698:0:26186:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -625 00002000:02000040:3.0:1788872718.721703:0:26186:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:801) 00002000:00010000:0.0:1788872718.744154:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.744167:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5324eb/0xe4e6e89fb01da353 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744185:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x321:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.744190:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x321:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.744196:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5324eb/0xe4e6e89fb01da353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744226:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5324eb/0xe4e6e89fb01da353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744238:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5324eb/0xe4e6e89fb01da353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744259:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c5324eb/0xe4e6e89fb01da353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744281:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.744299:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.744304:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c5324eb/0xe4e6e89fb01da353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744312:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98fa00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.744317:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5324eb/0xe4e6e89fb01da353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744326:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5324eb/0xe4e6e89fb01da353 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744342:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c5324eb/0xe4e6e89fb01da353 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744350:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5324eb/0xe4e6e89fb01da353 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744372:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.744374:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.744375:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.744885:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.744898:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01da35a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744908:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x320:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.744912:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x320:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.744916:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01da35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744925:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01da35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744932:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01da35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744939:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01da35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744954:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.744963:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.744968:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01da35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744976:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98f600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.744979:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01da35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.744986:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01da35a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.745354:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01da35a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.745361:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033fb9fe6/0xe4e6e89fb01da35a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.745377:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.745379:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.745381:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.746800:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.746811:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f32a5a45/0xe4e6e89fb01da361 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.746826:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31f:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.746831:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.746837:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f32a5a45/0xe4e6e89fb01da361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.746849:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f32a5a45/0xe4e6e89fb01da361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.746859:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f32a5a45/0xe4e6e89fb01da361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.746866:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f32a5a45/0xe4e6e89fb01da361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.746900:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872718.746941:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.746946:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01da368 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.746954:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31e:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.746957:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.746961:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01da368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.746969:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01da368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.746977:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01da368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.746984:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01da368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.751137:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788872718.751169:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872718.751177:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f32a5a45/0xe4e6e89fb01da361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.751193:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98f800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.751232:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f32a5a45/0xe4e6e89fb01da361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.751245:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f32a5a45/0xe4e6e89fb01da361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.751269:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f32a5a45/0xe4e6e89fb01da361 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.751276:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f32a5a45/0xe4e6e89fb01da361 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.751305:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.751310:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01da368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.751316:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98f000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.751320:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01da368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.751328:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01da368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.751338:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01da368 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.751344:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1afcd93/0xe4e6e89fb01da368 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.751366:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.751368:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.751370:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.753121:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.753133:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01da36f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753152:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31d:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.753156:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.753162:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01da36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753174:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01da36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753184:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01da36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753191:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01da36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753218:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.753228:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.753233:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01da36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753257:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.753262:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01da36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753271:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01da36f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753286:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01da36f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753293:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01da36f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753311:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.753312:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.753314:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.753358:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.753363:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01da376 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753370:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31c:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.753372:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.753376:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01da376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753383:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01da376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753396:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01da376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753404:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01da376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753417:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.753435:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.753440:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01da376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753447:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.753450:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01da376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753457:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01da376 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753469:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01da376 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753475:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01da376 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753488:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.753496:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.753497:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.753536:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.753541:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01da37d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753569:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31b:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.753573:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.753577:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01da37d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753586:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01da37d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753594:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01da37d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753600:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01da37d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753613:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.753619:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.753623:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01da37d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.753630:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.753633:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01da37d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760030:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01da37d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760057:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01da37d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760067:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01da37d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760095:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.760097:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.760100:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.760263:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.760270:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01da384 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760284:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31a:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.760288:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.760295:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01da384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760309:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01da384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760318:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01da384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760333:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01da384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760352:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.760362:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.760367:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01da384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760376:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.760381:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01da384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760388:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01da384 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760400:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01da384 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760494:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01da384 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760509:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.760511:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.760512:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.760585:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.760597:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01da38b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760605:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x319:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.760609:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x319:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.760613:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01da38b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760623:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01da38b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760630:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01da38b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760638:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01da38b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760652:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.760661:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.760665:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01da38b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760672:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.760675:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01da38b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760681:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01da38b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760698:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01da38b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760705:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01da38b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760718:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.760720:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.760722:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.760766:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.760772:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01da392 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760779:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x318:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.760782:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x318:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.760786:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01da392 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760794:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01da392 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760802:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01da392 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760808:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01da392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760831:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.760839:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.760843:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01da392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760849:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.760853:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01da392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760860:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01da392 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760871:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01da392 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760878:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01da392 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760889:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.760891:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.760893:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.760932:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.760937:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01da399 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760944:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x317:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.760952:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x317:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.760957:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01da399 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760966:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01da399 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760973:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01da399 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760981:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01da399 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.760992:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.760998:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.761001:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01da399 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761007:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.761011:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01da399 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761019:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01da399 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761028:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01da399 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761044:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01da399 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761057:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.761059:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.761060:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.761098:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.761103:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01da3a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761110:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x316:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.761113:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x316:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.761117:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01da3a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761125:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01da3a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761132:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01da3a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761138:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01da3a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761149:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.761161:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.761165:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01da3a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761172:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.761175:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01da3a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761182:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01da3a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761191:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01da3a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761198:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01da3a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761208:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.761210:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.761211:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.761246:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.761250:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01da3a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761258:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x315:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.761261:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x315:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.761264:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01da3a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761284:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01da3a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761292:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01da3a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761298:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01da3a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761308:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.761315:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.761318:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01da3a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761324:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.761326:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01da3a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761333:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01da3a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761341:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01da3a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761348:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01da3a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.761366:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.761368:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.761369:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.763875:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.763892:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01da3ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.763908:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x314:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.763913:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x314:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.763919:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01da3ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.763934:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01da3ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.763944:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01da3ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.763951:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01da3ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.763973:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.763987:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.764004:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01da3ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.764030:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.764035:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01da3ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.764043:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01da3ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.764061:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01da3ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.764069:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01da3ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.764090:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.764092:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.764094:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.764199:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.768335:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01da3b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768373:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x313:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.768379:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x313:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.768387:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01da3b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768416:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01da3b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768458:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01da3b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768467:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01da3b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768500:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.768521:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.768527:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01da3b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768535:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.768540:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01da3b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768567:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01da3b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768587:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01da3b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768594:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01da3b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768626:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.768634:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.768636:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.768761:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.768768:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd9ce15/0xe4e6e89fb01da3bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768776:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x312:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.768779:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x312:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.768784:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fd9ce15/0xe4e6e89fb01da3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768793:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fd9ce15/0xe4e6e89fb01da3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768800:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd9ce15/0xe4e6e89fb01da3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768807:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fd9ce15/0xe4e6e89fb01da3bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768820:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.768827:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.768831:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fd9ce15/0xe4e6e89fb01da3bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768837:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.768840:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd9ce15/0xe4e6e89fb01da3bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768858:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd9ce15/0xe4e6e89fb01da3bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768868:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fd9ce15/0xe4e6e89fb01da3bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768875:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fd9ce15/0xe4e6e89fb01da3bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768888:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.768889:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.768891:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.768928:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.768933:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01da3c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768940:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x311:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.768943:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x311:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.768947:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01da3c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768954:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01da3c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768961:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01da3c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768973:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01da3c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.768984:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.768991:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.768994:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01da3c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769000:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.769003:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01da3c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769010:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01da3c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769019:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01da3c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769026:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01da3c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769037:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.769039:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.769040:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.769075:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.769085:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84f7c59/0xe4e6e89fb01da3ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769092:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x310:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.769095:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x310:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.769098:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84f7c59/0xe4e6e89fb01da3ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769107:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84f7c59/0xe4e6e89fb01da3ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769114:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84f7c59/0xe4e6e89fb01da3ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769121:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84f7c59/0xe4e6e89fb01da3ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769130:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.769136:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.769139:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84f7c59/0xe4e6e89fb01da3ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769145:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.769148:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84f7c59/0xe4e6e89fb01da3ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769155:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84f7c59/0xe4e6e89fb01da3ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769169:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84f7c59/0xe4e6e89fb01da3ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769176:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84f7c59/0xe4e6e89fb01da3ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.769188:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.769190:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.769191:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.774690:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.774702:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0713fc5/0xe4e6e89fb01da3d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774720:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30f:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.774725:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.774731:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0713fc5/0xe4e6e89fb01da3d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774746:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0713fc5/0xe4e6e89fb01da3d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774759:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0713fc5/0xe4e6e89fb01da3d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774767:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0713fc5/0xe4e6e89fb01da3d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774808:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.774820:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.774827:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0713fc5/0xe4e6e89fb01da3d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774835:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.774839:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0713fc5/0xe4e6e89fb01da3d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774849:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0713fc5/0xe4e6e89fb01da3d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774868:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0713fc5/0xe4e6e89fb01da3d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774875:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0713fc5/0xe4e6e89fb01da3d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774897:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.774899:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.774901:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.774948:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.774953:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000874308b4/0xe4e6e89fb01da3d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774960:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30e:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.774969:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.774973:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000874308b4/0xe4e6e89fb01da3d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774982:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000874308b4/0xe4e6e89fb01da3d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.774989:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000874308b4/0xe4e6e89fb01da3d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.775295:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000874308b4/0xe4e6e89fb01da3d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.775311:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.775320:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.775324:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000874308b4/0xe4e6e89fb01da3d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.775332:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.775336:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000874308b4/0xe4e6e89fb01da3d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.775344:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000874308b4/0xe4e6e89fb01da3d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.775355:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000874308b4/0xe4e6e89fb01da3d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.775374:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000874308b4/0xe4e6e89fb01da3d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.775391:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.775393:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.775394:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.775606:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788872718.776375:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788872718.776524:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.776534:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01da3df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776589:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x321:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.776594:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x321:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.776600:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01da3df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776631:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01da3df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776641:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01da3df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776648:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01da3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776670:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788872718.776736:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.776742:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01da3e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776750:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x320:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.776753:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x320:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.776756:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01da3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776764:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01da3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776771:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01da3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776789:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01da3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776803:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788872718.776843:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.776848:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01da3ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776856:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31f:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.776858:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.776862:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01da3ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776870:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01da3ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776877:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01da3ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776884:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01da3ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776902:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788872718.776942:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.776947:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01da3f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776960:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31e:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.776963:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.776966:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01da3f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776975:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01da3f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776983:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01da3f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.776991:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01da3f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.777138:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788872718.777147:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01da3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.777155:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.777160:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01da3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.777169:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01da3df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.777184:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01da3df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.777191:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01da3df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.778318:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872718.778328:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01da3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.778349:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.778352:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01da3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.778361:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01da3e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.778378:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01da3e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.778385:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01da3e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.778400:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.778403:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01da3ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.779345:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.779350:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01da3ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.779360:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01da3ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.779375:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01da3ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.779390:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01da3ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784164:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.784173:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.784176:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.784191:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.784198:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.784236:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.784250:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f991a2/0xe4e6e89fb01da3fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784274:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30d:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.784279:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.784287:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039f991a2/0xe4e6e89fb01da3fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784305:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039f991a2/0xe4e6e89fb01da3fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784317:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f991a2/0xe4e6e89fb01da3fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784325:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039f991a2/0xe4e6e89fb01da3fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784367:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872718.784592:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.784598:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f6ad194/0xe4e6e89fb01da402 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784606:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30c:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.784609:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.784613:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f6ad194/0xe4e6e89fb01da402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784621:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f6ad194/0xe4e6e89fb01da402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784628:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f6ad194/0xe4e6e89fb01da402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784635:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f6ad194/0xe4e6e89fb01da402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784649:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788872718.784657:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872718.784662:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039f991a2/0xe4e6e89fb01da3fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784670:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.784681:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f991a2/0xe4e6e89fb01da3fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784689:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f991a2/0xe4e6e89fb01da3fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784704:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039f991a2/0xe4e6e89fb01da3fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784710:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039f991a2/0xe4e6e89fb01da3fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784723:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.784726:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f6ad194/0xe4e6e89fb01da402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784731:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.784734:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f6ad194/0xe4e6e89fb01da402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784739:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f6ad194/0xe4e6e89fb01da402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784746:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f6ad194/0xe4e6e89fb01da402 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784752:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f6ad194/0xe4e6e89fb01da402 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784767:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.784768:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.784770:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.784813:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.784818:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0292e32/0xe4e6e89fb01da409 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784825:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30b:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.784828:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.784831:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0292e32/0xe4e6e89fb01da409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784838:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0292e32/0xe4e6e89fb01da409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784845:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0292e32/0xe4e6e89fb01da409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784851:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0292e32/0xe4e6e89fb01da409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784861:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.784867:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.784871:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0292e32/0xe4e6e89fb01da409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784886:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.784890:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0292e32/0xe4e6e89fb01da409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784896:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0292e32/0xe4e6e89fb01da409 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784904:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0292e32/0xe4e6e89fb01da409 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784910:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0292e32/0xe4e6e89fb01da409 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784923:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.784924:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.784925:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.784959:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.784963:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bff7441/0xe4e6e89fb01da410 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784970:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30a:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.784972:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.784975:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bff7441/0xe4e6e89fb01da410 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784982:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bff7441/0xe4e6e89fb01da410 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.784995:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bff7441/0xe4e6e89fb01da410 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785001:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bff7441/0xe4e6e89fb01da410 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785010:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.785016:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.785020:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bff7441/0xe4e6e89fb01da410 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785026:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.785029:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bff7441/0xe4e6e89fb01da410 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785036:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bff7441/0xe4e6e89fb01da410 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785046:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bff7441/0xe4e6e89fb01da410 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785052:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bff7441/0xe4e6e89fb01da410 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785062:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.785068:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.785070:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.785117:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.785122:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da417 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785130:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x309:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.785133:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.785137:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785146:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785153:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785161:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785173:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.785179:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.785182:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785189:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.785192:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785212:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da417 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785222:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da417 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785228:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da417 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785241:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.785242:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.785243:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.785283:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.785287:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2a4904/0xe4e6e89fb01da41e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785296:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x308:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.785299:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x308:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.785302:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2a4904/0xe4e6e89fb01da41e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785310:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc2a4904/0xe4e6e89fb01da41e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785317:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2a4904/0xe4e6e89fb01da41e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785329:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2a4904/0xe4e6e89fb01da41e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785343:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872718.785352:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872718.785355:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc2a4904/0xe4e6e89fb01da41e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785362:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872718.785365:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2a4904/0xe4e6e89fb01da41e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785373:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2a4904/0xe4e6e89fb01da41e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785385:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc2a4904/0xe4e6e89fb01da41e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.785392:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc2a4904/0xe4e6e89fb01da41e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.785677:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788872718.785757:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.785763:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da425 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.785773:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31d:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.785776:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.785780:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.785790:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.785811:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.785817:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.785839:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788872718.785890:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.785895:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da42c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.785902:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31c:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.785905:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.785908:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da42c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.785917:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da42c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.785924:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da42c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.785931:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da42c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.785952:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788872718.785994:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.785999:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da433 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786007:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31b:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.786009:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.786013:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786023:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786029:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786035:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da433 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786044:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788872718.786080:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.786084:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da43a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786091:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31a:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.786099:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.786103:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da43a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786112:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da43a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786120:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da43a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786128:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da43a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786137:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788872718.786174:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.786179:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da441 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786186:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x319:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.786189:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x319:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.786192:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da441 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786214:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da441 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786223:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da441 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786236:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da441 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786246:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788872718.786285:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.786290:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01da448 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786297:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x318:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.786300:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x318:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.786304:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01da448 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786311:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01da448 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786319:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01da448 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786326:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01da448 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786333:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788872718.786367:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.786372:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01da44f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786385:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x317:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.786388:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x317:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.786392:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01da44f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786400:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01da44f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786538:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01da44f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786577:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01da44f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786589:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788872718.786628:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.786633:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01da456 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786641:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x316:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.786645:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x316:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.786649:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01da456 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786658:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01da456 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786676:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01da456 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786683:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01da456 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786691:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1788872718.786728:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.786733:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01da45d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786741:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x315:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.786743:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x315:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.786746:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01da45d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786754:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01da45d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786760:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01da45d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786768:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01da45d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786787:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1788872718.786829:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.786834:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01da464 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786842:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x314:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.786845:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x314:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.786849:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01da464 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786858:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01da464 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786866:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01da464 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786872:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01da464 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786880:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1788872718.786914:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.786919:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01da46b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786927:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x313:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.786935:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x313:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.786940:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01da46b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786948:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01da46b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786957:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01da46b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786964:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01da46b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.786972:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1788872718.787006:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.787011:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01da472 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.787019:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x312:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.787022:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x312:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.787027:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01da472 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.787036:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01da472 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.787044:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01da472 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.787057:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01da472 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.787065:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1788872718.787102:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.787107:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01da479 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.787115:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x311:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.787117:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x311:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.787121:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01da479 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.787130:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01da479 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.787137:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01da479 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.787143:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01da479 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.787151:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1788872718.787186:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.787191:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01da480 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787590:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1788872718.787598:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01da3f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787607:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.787612:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01da3f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787621:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01da3f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787639:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01da3f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787646:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01da3f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787678:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1788872718.787682:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787688:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.787691:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787698:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da425 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787708:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da425 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787716:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da425 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787727:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1788872718.787730:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da42c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787737:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.787740:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da42c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787758:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da42c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787768:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da42c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787775:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da42c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787789:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1788872718.787793:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da433 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787800:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.787803:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da433 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787810:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da433 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787819:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da433 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787825:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da433 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787854:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788872718.787857:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da43a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787863:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.787866:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da43a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787873:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da43a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787882:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da43a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787888:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da43a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787900:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788872718.787904:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da441 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787910:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.787912:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da441 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787929:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da441 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787940:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da441 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787946:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da441 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787959:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788872718.787963:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01da448 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787969:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.787971:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01da448 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787978:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01da448 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787987:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01da448 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.787996:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01da448 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788020:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788872718.788024:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01da44f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788031:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.788035:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01da44f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788043:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01da44f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788053:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01da44f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788061:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01da44f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788074:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788872718.788078:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01da456 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788083:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.788086:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01da456 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788104:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01da456 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788115:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01da456 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788122:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01da456 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788137:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788872718.788141:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01da45d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788147:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.788150:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01da45d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788158:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01da45d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788168:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01da45d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788176:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01da45d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788201:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788872718.788214:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01da464 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788221:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.788225:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01da464 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788233:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01da464 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788243:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01da464 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788251:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01da464 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788264:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788872718.788268:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01da46b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788274:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.788278:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01da46b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788297:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01da46b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788308:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01da46b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788315:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01da46b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788330:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872718.788333:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01da472 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788342:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.788344:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01da472 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788352:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01da472 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788362:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01da472 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788370:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01da472 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788393:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872718.788396:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01da479 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788402:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.788406:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01da479 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788414:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01da479 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788437:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01da479 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788444:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01da479 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.788457:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.788459:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.788461:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.788693:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.788696:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.788699:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.788707:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.788722:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872718.788831:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.788837:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e197806/0xe4e6e89fb01da487 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.788848:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x307:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.788851:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x307:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.788857:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e197806/0xe4e6e89fb01da487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.788867:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e197806/0xe4e6e89fb01da487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.788876:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e197806/0xe4e6e89fb01da487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.788883:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e197806/0xe4e6e89fb01da487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.788902:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872718.788948:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872718.788953:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c74f73a1/0xe4e6e89fb01da48e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.788961:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x306:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788872718.788964:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x306:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872718.788968:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c74f73a1/0xe4e6e89fb01da48e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.788987:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c74f73a1/0xe4e6e89fb01da48e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.788995:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c74f73a1/0xe4e6e89fb01da48e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.789002:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c74f73a1/0xe4e6e89fb01da48e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789066:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x310:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.789070:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x310:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.789075:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01da480 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789085:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01da480 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789092:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01da480 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789100:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01da480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872718.789281:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788872718.789307:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788872718.789364:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.789369:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01da495 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789378:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30f:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.789381:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.789385:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01da495 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789394:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01da495 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789413:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01da495 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789420:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01da495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789445:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788872718.789487:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.789492:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01da49c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789500:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30e:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.789504:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.789508:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01da49c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789516:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01da49c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789523:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01da49c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789530:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01da49c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789564:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788872718.789604:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.789609:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01da4a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789618:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30d:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.789621:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.789625:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01da4a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789633:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01da4a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789640:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01da4a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789649:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01da4a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789658:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788872718.789701:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.789705:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01da4aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789713:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30c:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.789722:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.789726:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01da4aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789735:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01da4aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789743:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01da4aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789751:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01da4aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789760:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788872718.789799:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.789805:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01da4b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789812:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30b:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.789815:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.789819:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01da4b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789827:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01da4b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789835:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01da4b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789849:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01da4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789856:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788872718.789890:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.789895:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01da4b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789902:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30a:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.789905:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.789908:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01da4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789916:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01da4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789923:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01da4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789930:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01da4b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789937:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1788872718.789966:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.789971:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01da4bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789983:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x309:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.789986:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.789990:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01da4bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.789998:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01da4bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.790006:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01da4bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.790013:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01da4bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.790023:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1788872718.790060:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.790065:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01da4c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.790073:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x308:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.790075:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x308:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.790079:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01da4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.790087:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01da4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.790105:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01da4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.790111:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01da4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.790119:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1788872718.790159:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.790163:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b14c590e/0xe4e6e89fb01da4cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.790171:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x307:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.790174:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x307:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.790178:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b14c590e/0xe4e6e89fb01da4cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.790186:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b14c590e/0xe4e6e89fb01da4cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.790194:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b14c590e/0xe4e6e89fb01da4cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.790200:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b14c590e/0xe4e6e89fb01da4cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.793803:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1788872718.793829:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e197806/0xe4e6e89fb01da487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.793845:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.793862:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e197806/0xe4e6e89fb01da487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.793874:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e197806/0xe4e6e89fb01da487 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.793897:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e197806/0xe4e6e89fb01da487 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.793905:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e197806/0xe4e6e89fb01da487 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.793934:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788872718.793938:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c74f73a1/0xe4e6e89fb01da48e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.793945:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.793948:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c74f73a1/0xe4e6e89fb01da48e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.793955:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c74f73a1/0xe4e6e89fb01da48e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.793963:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c74f73a1/0xe4e6e89fb01da48e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.793971:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c74f73a1/0xe4e6e89fb01da48e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.793990:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788872718.793995:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01da480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794002:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.794005:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01da480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794013:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01da480 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794023:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01da480 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794030:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01da480 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794054:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788872718.794058:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01da495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794065:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.794068:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01da495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794087:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01da495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794097:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01da495 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794104:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01da495 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794116:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788872718.794119:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01da49c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794124:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.794127:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01da49c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794134:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01da49c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794141:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01da49c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794147:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01da49c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794170:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788872718.794174:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01da4a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794179:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.794182:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01da4a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794189:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01da4a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794196:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01da4a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794202:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01da4a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794293:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788872718.794297:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01da4aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794304:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.794307:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01da4aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794325:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01da4aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794336:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01da4aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794343:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01da4aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794358:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788872718.794362:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01da4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794368:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.794371:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01da4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794379:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01da4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794387:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01da4b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794394:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01da4b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794418:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788872718.794431:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01da4b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794438:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.794441:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01da4b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794448:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01da4b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794458:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01da4b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794466:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01da4b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794480:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872718.794483:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01da4bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794488:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.794491:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01da4bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794510:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01da4bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794520:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01da4bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794528:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01da4bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794542:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872718.794546:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01da4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794574:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.794577:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01da4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794584:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01da4c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794594:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01da4c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794601:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01da4c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.794626:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.794627:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.794629:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872718.794954:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788872718.795082:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.795090:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000274d6010/0xe4e6e89fb01da4d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.795103:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x306:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.795107:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x306:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.795117:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000274d6010/0xe4e6e89fb01da4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.795128:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000274d6010/0xe4e6e89fb01da4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.795137:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000274d6010/0xe4e6e89fb01da4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.795144:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000274d6010/0xe4e6e89fb01da4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.795153:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788872718.795190:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.795194:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01da4db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.795331:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872718.795337:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b14c590e/0xe4e6e89fb01da4cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.795346:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aee00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.795350:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b14c590e/0xe4e6e89fb01da4cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.795358:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b14c590e/0xe4e6e89fb01da4cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.795371:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b14c590e/0xe4e6e89fb01da4cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.795379:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b14c590e/0xe4e6e89fb01da4cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.795399:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872718.795402:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000274d6010/0xe4e6e89fb01da4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.795409:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.795420:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000274d6010/0xe4e6e89fb01da4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.795437:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000274d6010/0xe4e6e89fb01da4d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.795449:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000274d6010/0xe4e6e89fb01da4d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.795456:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000274d6010/0xe4e6e89fb01da4d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.795469:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.795471:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.795473:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872718.797389:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x305:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.797631:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x305:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.797642:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01da4db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.797662:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01da4db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.797675:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01da4db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.797683:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01da4db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.797715:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788872718.797864:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.797870:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000365a4918/0xe4e6e89fb01da4e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.797882:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x304:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.797885:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x304:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.797889:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000365a4918/0xe4e6e89fb01da4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.797899:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000365a4918/0xe4e6e89fb01da4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.797908:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000365a4918/0xe4e6e89fb01da4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.797924:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000365a4918/0xe4e6e89fb01da4e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.797934:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788872718.797977:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.797982:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000784377c2/0xe4e6e89fb01da4e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.797991:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x303:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.798006:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x303:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.798010:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000784377c2/0xe4e6e89fb01da4e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.798020:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000784377c2/0xe4e6e89fb01da4e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.798028:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000784377c2/0xe4e6e89fb01da4e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.798035:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000784377c2/0xe4e6e89fb01da4e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.798045:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788872718.798083:0:26186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872718.798088:0:26186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601830aa/0xe4e6e89fb01da4f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.798103:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x302:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788872718.798106:0:26186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x302:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872718.798111:0:26186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601830aa/0xe4e6e89fb01da4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.798120:0:26186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601830aa/0xe4e6e89fb01da4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.798128:0:26186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601830aa/0xe4e6e89fb01da4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.798136:0:26186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601830aa/0xe4e6e89fb01da4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872718.798145:0:26186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788872718.798575:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788872718.798584:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01da4db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798593:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aea00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.798598:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01da4db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798609:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01da4db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798627:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01da4db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798642:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01da4db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798677:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788872718.798681:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000365a4918/0xe4e6e89fb01da4e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798689:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.798692:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000365a4918/0xe4e6e89fb01da4e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798700:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000365a4918/0xe4e6e89fb01da4e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798710:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000365a4918/0xe4e6e89fb01da4e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798718:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000365a4918/0xe4e6e89fb01da4e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798731:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872718.798735:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000784377c2/0xe4e6e89fb01da4e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798742:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aec00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.798752:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000784377c2/0xe4e6e89fb01da4e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798760:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000784377c2/0xe4e6e89fb01da4e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798770:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000784377c2/0xe4e6e89fb01da4e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798777:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000784377c2/0xe4e6e89fb01da4e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798791:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872718.798794:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601830aa/0xe4e6e89fb01da4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798801:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58afa00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.798804:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601830aa/0xe4e6e89fb01da4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798812:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601830aa/0xe4e6e89fb01da4f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798821:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601830aa/0xe4e6e89fb01da4f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798829:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601830aa/0xe4e6e89fb01da4f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.798849:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.798850:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.798852:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788872718.798912:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788872718.802123:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872718.802328:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872718.802337:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01da4f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802356:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x305:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788872718.802361:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x305:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872718.802367:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01da4f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802382:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01da4f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802393:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01da4f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802400:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01da4f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802430:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872718.802439:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872718.802444:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01da4f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802459:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.802463:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01da4f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802471:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01da4f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802488:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01da4f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802495:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d42b969d/0xe4e6e89fb01da4f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802513:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.802515:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.802516:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872718.802570:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872718.802575:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01da4fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802583:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x304:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788872718.802585:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x304:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872718.802590:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01da4fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802598:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01da4fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802612:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01da4fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802620:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01da4fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802632:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872718.802639:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872718.802643:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01da4fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802651:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.802655:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01da4fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802663:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01da4fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802674:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01da4fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802680:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01da4fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802691:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.802698:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.802700:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872718.802742:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872718.802747:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01da505 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802754:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x303:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788872718.802757:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x303:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872718.802760:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01da505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802768:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01da505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802775:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01da505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802781:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01da505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802792:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872718.802799:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872718.802803:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01da505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802809:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.802813:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01da505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802831:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01da505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802841:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01da505 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802848:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d002f5/0xe4e6e89fb01da505 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802860:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.802861:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.802863:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872718.802905:0:26194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872718.802911:0:26194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01da50c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802918:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x302:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788872718.802921:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x302:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872718.802925:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01da50c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802934:0:26194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01da50c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802941:0:26194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01da50c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802954:0:26194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01da50c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802966:0:26194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872718.802973:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872718.802977:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01da50c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802984:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872718.802987:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01da50c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.802995:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01da50c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.803005:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01da50c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.803011:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf2d766e/0xe4e6e89fb01da50c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872718.803023:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.803025:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872718.803027:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.804488:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872718.804500:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788872718.805055:0:26194:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00000100:00100000:3.0:1788872718.805238:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6a9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:89023:x1875765327703040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 89909us (101371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872718.805250:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5958 00000100:00100000:0.0:1788872718.815620:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89023:1875765327703040:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788872718.815647:0:89023:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x321:0x0] from OST, last_created [0x2c0000401:0x321:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:0.0:1788872718.815729:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7832680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89023:1875765327703424:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788872718.815790:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.815829:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872718.815845:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872718.815858:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327703296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872718.815885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872718.815921:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327703424 00000100:00100000:0.0:1788872718.815927:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327703424 00000100:00100000:0.0:1788872718.815966:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5960 00000100:00100000:0.0:1788872718.815974:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:89023:x1875765327703424:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788872718.816024:0:26196:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 802 00002000:00080000:2.0:1788872718.816866:0:26186:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:2.0:1788872718.816931:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:89021:x1875765327703168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 95282us (112655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872718.816939:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5959 00000100:00100000:2.0:1788872718.816979:0:89021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89021:1875765327703168:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788872718.816993:0:89021:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x321:0x0] from OST, last_created [0x280000401:0x321:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:2.0:1788872718.817048:0:89021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89021:1875765327703680:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788872718.817076:0:89021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872718.817093:0:89021:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c73ec480 going to sleep for 11 seconds 00000100:00100000:2.0:1788872718.817112:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327703680 00000100:00100000:2.0:1788872718.817118:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327703680 00000100:00100000:2.0:1788872718.817160:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5961 00000100:00100000:2.0:1788872718.817167:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:89021:x1875765327703680:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788872718.817200:0:26199:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 802 00000100:00100000:1.0:1788872718.817339:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872718.817350:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327703552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872718.817382:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872718.817417:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327703296 00000100:00100000:1.0:1788872718.817433:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327703296 00000100:00100000:1.0:1788872718.817468:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327703552 00000100:00100000:1.0:1788872718.817471:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327703552 00000100:00100000:1.0:1788872718.817490:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:1.0:1788872718.817496:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327703296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872718.817509:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872718.817542:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327703296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872718.817571:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:1.0:1788872718.817586:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:1.0:1788872718.817592:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327703552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872718.817602:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872718.817630:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327703552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872718.817635:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:1.0:1788872718.817670:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327703552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872718.820995:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327703296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872718.823956:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:89023:x1875765327703424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7973us (8157us total) trans 4294969451 rc 0/0 00000100:00100000:0.0:1788872718.823971:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5960 00000100:00100000:0.0:1788872718.824048:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7832680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89023:1875765327703424:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788872718.824063:0:89023:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x321:0x0]-[0x2c0000401:0x341:0x0] 00000100:00100000:2.0:1788872718.833092:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+6:89021:x1875765327703680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15913us (16002us total) trans 4294969451 rc 0/0 00000100:00100000:2.0:1788872718.833107:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5961 00000100:00100000:0.0:1788872718.845224:0:89021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89021:1875765327703680:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788872718.845244:0:89021:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x321:0x0]-[0x280000401:0x341:0x0] 00000001:00100000:3.0:1788872719.041734:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:1.0:1788872719.507256:0:89289:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788872719.681799:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872720.697269:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788872720.743476:0:89341:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788872720.743830:0:89341:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788872721.085806:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327703808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872721.085878:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872721.086086:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327703808 00000100:00100000:1.0:1788872721.086095:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327703808 00000100:00100000:1.0:1788872721.086167:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:1.0:1788872721.086181:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327703808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872721.086213:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872721.086265:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327703808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872721.086273:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:1.0:1788872721.086346:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327703808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872721.087112:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327703936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872721.087153:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872721.087335:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327703936 00000100:00100000:3.0:1788872721.087340:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327703936 00000100:00100000:3.0:1788872721.087386:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:3.0:1788872721.087394:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327703936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872721.087417:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872721.087455:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327703936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872721.087462:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:3.0:1788872721.087501:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327703936:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788872721.088812:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872721.088819:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788872721.721758:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788872721.775251:0:89392:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788872721.778614:0:89392:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788872722.745887:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872723.640848:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327704064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872723.640940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.641417:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327704320:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.641460:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.641485:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327704832:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.641510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.641525:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327705344:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.641545:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.641586:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788872723.641593:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327704448:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.641616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.641650:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327704960:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.641671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.641688:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327705472:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.641713:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.641750:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327704320 00000100:00100000:3.0:1788872723.641758:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327704320 00000100:00100000:3.0:1788872723.641827:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327704448 00000100:00100000:3.0:1788872723.641831:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327704448 00000100:00100000:3.0:1788872723.641853:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1788872723.641863:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327704320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.641912:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327704320:12345-0@lo:400:kworker.0 Request processed in 50us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872723.641920:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1788872723.641937:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1788872723.641943:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327704448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.641968:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327704448:12345-0@lo:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872723.641974:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1788872723.641993:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327704832 00000100:00100000:3.0:1788872723.641996:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327704832 00000100:00100000:3.0:1788872723.642020:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327705344 00000100:00100000:3.0:1788872723.642022:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327705344 00000100:00100000:3.0:1788872723.642035:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327704960 00000100:00100000:3.0:1788872723.642037:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327704960 00000100:00100000:3.0:1788872723.642051:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327705472 00000100:00100000:3.0:1788872723.642053:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327705472 00000100:00100000:3.0:1788872723.642068:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:3.0:1788872723.642074:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327704832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642119:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327704832:12345-0@lo:400:kworker.0 Request processed in 44us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872723.642125:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:3.0:1788872723.642136:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:3.0:1788872723.642141:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327705344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642165:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327705344:12345-0@lo:400:kworker.0 Request processed in 24us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872723.642170:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:3.0:1788872723.642181:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:3.0:1788872723.642186:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327704960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642209:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327704960:12345-0@lo:400:kworker.0 Request processed in 24us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872723.642215:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00100000:3.0:1788872723.642224:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:3.0:1788872723.642230:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327705472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642254:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327705472:12345-0@lo:400:kworker.0 Request processed in 24us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872723.642258:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:3.0:1788872723.642278:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327704576:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642301:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.642318:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327705088:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.642368:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327705600:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.642414:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788872723.642419:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327704192:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642444:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.642465:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327704704:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642485:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.642496:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327705216:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872723.642542:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327704576 00000100:00100000:3.0:1788872723.642546:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327704576 00000100:00100000:3.0:1788872723.642596:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327705088 00000100:00100000:3.0:1788872723.642599:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327705088 00000100:00100000:3.0:1788872723.642608:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327705600 00000100:00100000:3.0:1788872723.642610:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327705600 00000100:00100000:3.0:1788872723.642618:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327704704 00000100:00100000:3.0:1788872723.642620:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327704704 00000100:00100000:3.0:1788872723.642632:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1788872723.642638:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327704576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642672:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327704576:12345-0@lo:400:kworker.0 Request processed in 34us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872723.642678:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1788872723.642690:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1788872723.642696:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327705088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642719:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327705088:12345-0@lo:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872723.642724:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1788872723.642734:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1788872723.642739:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327705600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642776:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327705600:12345-0@lo:400:kworker.0 Request processed in 37us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872723.642782:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1788872723.642794:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1788872723.642801:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327704704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642827:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327704704:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872723.642832:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1788872723.642873:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327704448:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642885:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327704960:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642896:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327705472:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642906:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327704320:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642913:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327704832:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642921:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327705344:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642957:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327704704:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642967:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327704576:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642976:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327705088:0@lo:400:kworker.0 00000100:00100000:3.0:1788872723.642987:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327705600:0@lo:400:kworker.0 00000100:00080000:0.0:1788872723.643171:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872723.643176:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872723.643179:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872723.643181:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872723.643197:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327704064 00000100:00100000:0.0:1788872723.643201:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327704064 00000100:00100000:0.0:1788872723.643238:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327705216 00000100:00100000:0.0:1788872723.643241:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327705216 00000100:00100000:0.0:1788872723.643262:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:0.0:1788872723.643268:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327704064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872723.643296:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2174976 pending 28672 free 1445105664 avail 1298866176 00000100:00100000:0.0:1788872723.643362:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327704064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (2423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872723.643375:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00100000:0.0:1788872723.643388:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:0.0:1788872723.643393:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327705216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872723.643424:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327705216:12345-0@lo:400:kworker.0 Request processed in 31us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872723.643430:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00100000:0.0:1788872723.643457:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327705216:0@lo:400:kworker.0 00000100:00100000:0.0:1788872723.643472:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327704064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872723.643788:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327705728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872723.643831:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872723.643958:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327705728 00000100:00100000:1.0:1788872723.643962:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327705728 00000100:00100000:1.0:1788872723.643996:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1788872723.644003:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327705728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872723.644021:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872723.644058:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327705728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872723.644064:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1788872723.644093:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327705728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872723.644239:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327704192 00000100:00100000:2.0:1788872723.644243:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327704192 00000100:00100000:2.0:1788872723.644284:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788872723.644291:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df55bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327704192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872723.644324:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df55bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327704192:12345-0@lo:400:kworker.0 Request processed in 34us (1879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872723.644340:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788872723.644511:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327704192:0@lo:400:kworker.0 00000100:00100000:2.0:1788872723.730043:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872723.730099:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872723.730235:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311163136 00000100:00100000:3.0:1788872723.730249:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311163136 00000100:00100000:2.0:1788872723.730413:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872723.730441:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311163392 00000100:00100000:2.0:1788872723.730445:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311163392 00000100:00100000:2.0:1788872723.730492:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311163264 00000100:00100000:2.0:1788872723.730496:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311163264 00000100:00100000:2.0:1788872723.730519:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1219 00000100:00100000:2.0:1788872723.730530:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311163392:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872723.730632:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311163392:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 103us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872723.730656:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1219 00000100:00100000:2.0:1788872723.730678:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1220 00000100:00100000:2.0:1788872723.730684:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:2406:x1875765311163264:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872723.730716:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:2406:x1875765311163264:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872723.730722:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1220 00000100:00080000:2.0:1788872723.730869:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788872723.730873:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872723.733472:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 74 00000100:00100000:3.0:1788872723.733510:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df55a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2406:x1875765311163136:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872723.733619:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df55a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2406:x1875765311163136:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 115us (3588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872723.733628:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 74 00000100:00100000:2.0:1788872723.751977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872723.752090:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311163520 00000100:00100000:0.0:1788872723.752100:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311163520 00000100:00100000:0.0:1788872723.752170:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1209 00000100:00100000:0.0:1788872723.752180:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:68274:x1875765311163520:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:0.0:1788872723.752200:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872723.752227:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6600/0xe4e6e89fb01da513 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf05 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872723.752298:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01da51a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872723.752313:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01da51a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872723.752358:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01da51a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872723.752416:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788872723.752420:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788872723.752462:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01da51a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872723.752492:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6600/0xe4e6e89fb01da513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf05 expref: 11 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872723.752511:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01da51a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf05 expref: 10 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872723.752521:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c1358700) 00010000:00010000:0.0:1788872723.752525:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788872723.752528:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e7600, rc 0) 00000100:00100000:0.0:1788872723.752671:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:68274:x1875765311163520:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 490us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872723.752678:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1209 00000100:00100000:2.0:1788872723.758680:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872723.758780:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311163648 00000100:00100000:0.0:1788872723.758795:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311163648 00000100:00100000:0.0:1788872723.758877:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1210 00000100:00100000:0.0:1788872723.758888:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:68274:x1875765311163648:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:0.0:1788872723.758923:0:83669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2174976 pending 28672 free 1445105664 avail 1298866176 00000100:00100000:0.0:1788872723.759009:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:68274:x1875765311163648:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 122us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872723.759033:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1210 00000100:00100000:1.0:1788872723.763475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872723.763589:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311163776 00000100:00100000:2.0:1788872723.763599:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311163776 00000100:00100000:2.0:1788872723.763661:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1211 00000100:00100000:2.0:1788872723.763671:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:68274:x1875765311163776:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:2.0:1788872723.763702:0:66192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872723.763777:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:68274:x1875765311163776:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 107us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872723.763785:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1211 00010000:00010000:3.0:1788872723.771480:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872723.771658:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872723.771756:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311163904 00000100:00100000:0.0:1788872723.771767:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311163904 00000100:00100000:0.0:1788872723.771827:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5962 00000100:00100000:0.0:1788872723.771837:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2403:x1875765311163904:12345-192.168.204.39@tcp:8:lfs.0 00010000:00080000:0.0:1788872723.771876:0:26192:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp t0 exp 0000000000000000 cur 3660 last 0 00000020:00000080:0.0:1788872723.771912:0:26192:0:(genops.c:1406:class_connect()) connect: client 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3, cookie 0xe4e6e89fb01da521 00002000:00100000:0.0:1788872723.771923:0:26192:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3/ffff98a9c73d2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788872723.771942:0:26192:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788872723.772026:0:26192:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788872723.772057:0:26192:0:(import.c:65:import_set_state_nolock()) ffff98a9c73d7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872723.772282:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311163904:12345-192.168.204.39@tcp:8:lfs.0 Request processed in 444us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872723.772291:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5962 00000100:00100000:3.0:1788872723.774046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872723.774188:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311164032 00000100:00100000:1.0:1788872723.774197:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311164032 00000100:00100000:1.0:1788872723.774269:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2059 00000100:00100000:1.0:1788872723.774280:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:68274:x1875765311164032:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:1.0:1788872723.774304:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872723.774377:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:68274:x1875765311164032:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 100us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872723.774384:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2059 00000100:00080000:0.0:1788872723.775598:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872723.777140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872723.778538:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311164160 00000100:00100000:0.0:1788872723.778565:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311164160 00000100:00100000:0.0:1788872723.778628:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5963 00000100:00100000:0.0:1788872723.778638:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1875765311164160:12345-192.168.204.39@tcp:8:lfs.0 00010000:00080000:0.0:1788872723.778675:0:9961:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp t0 exp 0000000000000000 cur 3660 last 0 00000020:00000080:0.0:1788872723.778713:0:9961:0:(genops.c:1406:class_connect()) connect: client 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3, cookie 0xe4e6e89fb01da528 00002000:00100000:0.0:1788872723.778725:0:9961:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3/ffff98a9c8f56800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788872723.778743:0:9961:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788872723.779197:0:9961:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788872723.779243:0:9961:0:(import.c:65:import_set_state_nolock()) ffff98a9c8f55000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872723.779344:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311164160:12345-192.168.204.39@tcp:8:lfs.0 Request processed in 705us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872723.779353:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5963 00000001:00100000:3.0:1788872723.786531:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00080000:3.0:1788872723.786588:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969451 is committed 00000100:00100000:1.0:1788872723.787388:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872723.787491:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311164288 00000100:00100000:3.0:1788872723.787502:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311164288 00000100:00100000:3.0:1788872723.787610:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2060 00000100:00100000:3.0:1788872723.787621:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:68274:x1875765311164288:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872723.787651:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872723.787724:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:68274:x1875765311164288:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 104us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872723.787732:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2060 00000100:00080000:0.0:1788872723.788208:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872724.154519:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327705984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872724.154627:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872724.154679:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872724.154687:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327705856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872724.154713:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872724.154795:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327705984 00000100:00100000:0.0:1788872724.154814:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327705984 00000100:00100000:0.0:1788872724.154870:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327705856 00000100:00100000:0.0:1788872724.154873:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327705856 00000100:00100000:0.0:1788872724.154896:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:0.0:1788872724.154906:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327705984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872724.154936:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872724.155014:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327705984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872724.155022:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00100000:0.0:1788872724.155041:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:0.0:1788872724.155047:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327705856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872724.155059:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872724.155086:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327705856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872724.155090:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:0.0:1788872724.155147:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327705856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872724.155157:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:0.0:1788872724.155175:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327705984:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788872724.679759:0:89003:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149697 is committed 00000001:00100000:3.0:1788872724.681347:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00080000:3.0:1788872724.681363:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969451 is committed 00010000:00010000:2.0:1788872724.793639:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872725.821883:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872726.201604:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327706112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872726.201680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872726.202903:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327706112 00000100:00100000:1.0:1788872726.202917:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327706112 00000100:00080000:0.0:1788872726.202962:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872726.203038:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:0.0:1788872726.203051:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327706112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872726.203086:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872726.203166:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327706112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872726.203173:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00100000:0.0:1788872726.203236:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327706112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872726.206947:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872726.206975:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327706240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872726.207045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872726.207116:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327706240 00000100:00100000:0.0:1788872726.207125:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327706240 00000100:00100000:0.0:1788872726.207191:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:0.0:1788872726.207203:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327706240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872726.207242:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872726.207310:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327706240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872726.207318:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00080000:0.0:1788872726.207344:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872726.207380:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327706240:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788872726.846189:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872727.866818:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872728.762040:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872728.762103:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327706368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872728.762201:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872728.762287:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327706368 00000100:00100000:0.0:1788872728.762296:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327706368 00000100:00100000:0.0:1788872728.762364:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1788872728.762374:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327706368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788872728.762423:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:0.0:1788872728.762477:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327706368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872728.762484:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1788872728.762526:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327706368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872728.765042:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872728.765092:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327706496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872728.765178:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872728.765788:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327706496 00000100:00100000:3.0:1788872728.765812:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327706496 00000100:00100000:3.0:1788872728.765910:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:3.0:1788872728.765920:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327706496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872728.765970:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445105664 avail 1298866176 00000100:00100000:3.0:1788872728.766067:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327706496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872728.766083:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1788872728.766282:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327706880:0@lo:400:kworker.0 00000100:00100000:2.0:1788872728.766324:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872728.766372:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327706496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872728.766401:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327707392:0@lo:400:kworker.0 00000100:00100000:0.0:1788872728.766422:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327707008:0@lo:400:kworker.0 00000100:00100000:0.0:1788872728.766451:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872728.766452:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872728.766505:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327707520:0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.766544:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327706624:0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.766601:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872728.766644:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327707136:0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.766679:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872728.766713:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327707648:0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.766739:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327706752:0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.766761:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872728.768707:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327707904:0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.773473:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327707264:0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.773615:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872728.773658:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327707776:0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.773697:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872728.773789:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327706624 00000100:00100000:1.0:1788872728.773799:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327706624 00000100:00100000:1.0:1788872728.773863:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788872728.773874:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327706624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.773932:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327706624:12345-0@lo:400:kworker.0 Request processed in 60us (7330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872728.773940:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788872728.773998:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872728.791649:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327707392 00000100:00100000:3.0:1788872728.791666:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327707392 00000100:00100000:3.0:1788872728.791749:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327707264 00000100:00100000:3.0:1788872728.791753:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327707264 00000100:00100000:3.0:1788872728.791774:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327707776 00000100:00100000:3.0:1788872728.791778:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327707776 00000100:00100000:3.0:1788872728.791803:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:3.0:1788872728.791812:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327707392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872728.791918:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327707392:12345-0@lo:400:kworker.0 Request processed in 107us (25465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872728.791926:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000100:00100000:3.0:1788872728.791943:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:3.0:1788872728.791948:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327707264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872728.792002:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327707264:12345-0@lo:400:kworker.0 Request processed in 53us (18387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872728.792008:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:3.0:1788872728.792020:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:3.0:1788872728.792025:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327707776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872728.792051:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327707776:12345-0@lo:400:kworker.0 Request processed in 26us (18354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872728.792056:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00080000:3.0:1788872728.792074:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872728.792078:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872728.794923:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327707264:0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.794945:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327707776:0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.795006:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327707392:0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.795269:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872728.795320:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327706880 00000100:00100000:0.0:1788872728.795328:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327706880 00000100:00100000:0.0:1788872728.795668:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327707008 00000100:00100000:0.0:1788872728.795673:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327707008 00000100:00100000:0.0:1788872728.795695:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327707136 00000100:00100000:0.0:1788872728.795697:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327707136 00000100:00100000:0.0:1788872728.795710:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327706752 00000100:00100000:0.0:1788872728.795713:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327706752 00000100:00100000:0.0:1788872728.795724:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327707904 00000100:00100000:0.0:1788872728.795726:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327707904 00000100:00100000:0.0:1788872728.795742:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1788872728.795751:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327706880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872728.795868:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327706880:12345-0@lo:400:kworker.0 Request processed in 118us (29543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872728.795887:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1788872728.795908:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1788872728.795915:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327707008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872728.795953:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327707008:12345-0@lo:400:kworker.0 Request processed in 39us (29501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872728.795960:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1788872728.795971:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:0.0:1788872728.795977:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327707136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872728.796007:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327707136:12345-0@lo:400:kworker.0 Request processed in 31us (29338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872728.796012:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:0.0:1788872728.796023:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1788872728.796027:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327706752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872728.796062:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327706752:12345-0@lo:400:kworker.0 Request processed in 34us (29299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872728.796068:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1788872728.796080:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:0.0:1788872728.796086:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327707904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872728.796117:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327707904:12345-0@lo:400:kworker.0 Request processed in 31us (22118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872728.796123:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:0.0:1788872728.796157:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327706752:0@lo:400:kworker.0 00000100:00100000:0.0:1788872728.796204:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327707904:0@lo:400:kworker.0 00000100:00100000:0.0:1788872728.796238:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327706880:0@lo:400:kworker.0 00000100:00100000:2.0:1788872728.796250:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872728.796273:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327707648 00000100:00100000:0.0:1788872728.796277:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327707648 00000100:00100000:0.0:1788872728.796305:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:2.0:1788872728.796310:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327706624:0@lo:400:kworker.0 00000100:00100000:0.0:1788872728.796310:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327707648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872728.796322:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327707136:0@lo:400:kworker.0 00000100:00100000:2.0:1788872728.796341:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:0.0:1788872728.796344:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327707648:12345-0@lo:400:kworker.0 Request processed in 34us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872728.796349:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:2.0:1788872728.796351:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327707648:0@lo:400:kworker.0 00000100:00080000:2.0:1788872728.796377:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872728.796382:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788872728.796384:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872728.799766:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327707520 00000100:00100000:0.0:1788872728.799782:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327707520 00000100:00100000:0.0:1788872728.799847:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:0.0:1788872728.799858:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327707520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872728.799949:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327707520:12345-0@lo:400:kworker.0 Request processed in 94us (4680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872728.799957:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:2.0:1788872728.801321:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327707520:0@lo:400:kworker.0 00000100:00100000:2.0:1788872728.801368:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327707008:0@lo:400:kworker.0 00000100:00100000:1.0:1788872728.850351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872728.850402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872728.850437:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872728.850457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872728.850477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872728.850502:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311164416 00000100:00100000:1.0:1788872728.850511:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311164416 00000100:00100000:1.0:1788872728.850583:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 76 00000100:00100000:1.0:1788872728.850593:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2406:x1875765311164416:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872728.850660:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2406:x1875765311164416:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 69us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872728.850667:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 76 00000100:00100000:1.0:1788872728.850702:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311164544 00000100:00100000:1.0:1788872728.850705:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311164544 00000100:00100000:1.0:1788872728.850737:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311164672 00000100:00100000:1.0:1788872728.850739:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311164672 00000100:00100000:1.0:1788872728.850769:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1227 00000100:00100000:1.0:1788872728.850775:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2406:x1875765311164544:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872728.850803:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2406:x1875765311164544:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872728.850808:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1227 00000100:00100000:1.0:1788872728.850835:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1228 00000100:00100000:1.0:1788872728.850840:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311164672:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872728.850865:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311164672:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 24us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872728.850870:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1228 00000100:00080000:1.0:1788872728.851004:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872728.851009:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872728.851100:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311164800 00000100:00100000:0.0:1788872728.851105:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311164800 00000100:00100000:0.0:1788872728.851148:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311164928 00000100:00100000:0.0:1788872728.851152:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311164928 00000100:00100000:0.0:1788872728.851178:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2551 00000100:00100000:0.0:1788872728.851185:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311164800:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872728.851222:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311164800:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 38us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872728.851240:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2551 00000100:00100000:0.0:1788872728.851255:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2552 00000100:00100000:0.0:1788872728.851262:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311164928:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872728.851295:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311164928:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 35us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872728.851301:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2552 00000100:00080000:1.0:1788872728.851829:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872728.851835:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788872728.891233:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872729.272975:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872729.273002:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327708032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872729.273076:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872729.273270:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327708032 00000100:00100000:0.0:1788872729.273279:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327708032 00000100:00100000:1.0:1788872729.273349:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327708160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872729.273395:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:0.0:1788872729.273407:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327708032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872729.273454:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872729.273495:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872729.273576:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327708032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872729.273583:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:3.0:1788872729.273669:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327708032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872729.276363:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327708160 00000100:00100000:0.0:1788872729.276377:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327708160 00000100:00100000:0.0:1788872729.276435:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:0.0:1788872729.276445:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327708160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872729.276478:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872729.276583:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327708160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (3088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872729.276590:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000100:00100000:0.0:1788872729.276657:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327708160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788872729.913167:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872730.936832:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872731.322861:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327708288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872731.322936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872731.323017:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327708288 00000100:00100000:0.0:1788872731.323034:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327708288 00000100:00100000:0.0:1788872731.323093:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:0.0:1788872731.323104:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327708288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872731.323136:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872731.323205:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327708288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872731.323212:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00080000:0.0:1788872731.323235:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872731.323275:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327708288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872731.324744:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327708416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872731.324827:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872731.324978:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327708416 00000100:00100000:3.0:1788872731.324986:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327708416 00000100:00100000:3.0:1788872731.325048:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:3.0:1788872731.325058:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327708416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872731.325099:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872731.325150:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327708416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872731.325157:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00080000:2.0:1788872731.325719:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872731.325779:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327708416:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1788872731.533119:0:89585:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:0.0:1788872731.960956:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872732.994354:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788872733.374842:0:89633:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1788872733.883590:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327708544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872733.883681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872733.883759:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327708544 00000100:00100000:0.0:1788872733.883766:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327708544 00000100:00100000:0.0:1788872733.883812:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:0.0:1788872733.883820:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327708544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872733.883856:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445105664 avail 1298866176 00000100:00100000:0.0:1788872733.883910:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327708544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872733.883917:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00100000:0.0:1788872733.883961:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327708544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872733.884525:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327708928:0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.884600:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872733.884622:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327709440:0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.884647:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872733.884664:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327709952:0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.884684:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872733.884705:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788872733.884711:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327709056:0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.884732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872733.884749:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327709568:0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.884782:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872733.884813:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327710080:0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.884849:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872733.884879:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327708928 00000100:00100000:1.0:1788872733.884883:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327708928 00000100:00100000:1.0:1788872733.885000:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327709056 00000100:00100000:1.0:1788872733.885004:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327709056 00000100:00100000:1.0:1788872733.885022:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327709568 00000100:00100000:1.0:1788872733.885024:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327709568 00000100:00100000:1.0:1788872733.885034:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327710080 00000100:00100000:1.0:1788872733.885036:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327710080 00000100:00100000:1.0:1788872733.885114:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:1.0:1788872733.885122:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327708928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.885177:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327708928:12345-0@lo:400:kworker.0 Request processed in 56us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872733.885184:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:1.0:1788872733.885198:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:1.0:1788872733.885204:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327709056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.885232:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327709056:12345-0@lo:400:kworker.0 Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872733.885238:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:1.0:1788872733.885249:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1788872733.885254:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327709568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.885279:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327709568:12345-0@lo:400:kworker.0 Request processed in 26us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872733.885284:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1788872733.885293:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1788872733.885298:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327710080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.885334:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327710080:12345-0@lo:400:kworker.0 Request processed in 36us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872733.885339:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1788872733.885358:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327709440 00000100:00100000:1.0:1788872733.885361:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327709440 00000100:00100000:1.0:1788872733.885389:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327709952 00000100:00100000:1.0:1788872733.885393:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327709952 00000100:00100000:1.0:1788872733.885411:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:1.0:1788872733.885417:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327709440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.885446:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327709440:12345-0@lo:400:kworker.0 Request processed in 29us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872733.885452:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:1.0:1788872733.885462:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:1.0:1788872733.885468:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327709952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.885492:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327709952:12345-0@lo:400:kworker.0 Request processed in 25us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872733.885511:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00080000:1.0:1788872733.885537:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872733.885542:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872733.885544:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872733.885601:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327709056:0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.885612:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327709568:0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.885620:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327710080:0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.885628:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327708928:0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.885637:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327709440:0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.885655:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327709952:0@lo:400:kworker.0 00000100:00100000:0.0:1788872733.885767:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327708672:0@lo:400:kworker.0 00000100:00100000:0.0:1788872733.885806:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872733.885856:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327709184:0@lo:400:kworker.0 00000100:00100000:0.0:1788872733.885889:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872733.885890:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327708800:0@lo:400:kworker.0 00000100:00100000:0.0:1788872733.885911:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327709696:0@lo:400:kworker.0 00000100:00100000:3.0:1788872733.885929:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872733.885933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872733.885950:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327709312:0@lo:400:kworker.0 00000100:00100000:0.0:1788872733.885960:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327709184 00000100:00100000:0.0:1788872733.885963:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327709184 00000100:00100000:3.0:1788872733.885972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872733.885989:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327709824:0@lo:400:kworker.0 00000100:00100000:0.0:1788872733.885989:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327708800 00000100:00100000:0.0:1788872733.885992:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327708800 00000100:00100000:0.0:1788872733.886005:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:3.0:1788872733.886010:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872733.886010:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327709184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872733.886043:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327709184:12345-0@lo:400:kworker.0 Request processed in 34us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872733.886055:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:3.0:1788872733.886063:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327708800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872733.886100:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327708800:12345-0@lo:400:kworker.0 Request processed in 38us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872733.886106:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1788872733.886140:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:3.0:1788872733.886144:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327709696 00000100:00100000:3.0:1788872733.886148:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327709696 00000100:00080000:0.0:1788872733.886155:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872733.886157:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872733.886175:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:0.0:1788872733.886175:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327709184:0@lo:400:kworker.0 00000100:00100000:3.0:1788872733.886182:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327709696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872733.886210:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327709312 00000100:00100000:3.0:1788872733.886218:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327709696:12345-0@lo:400:kworker.0 Request processed in 36us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872733.886224:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00100000:3.0:1788872733.886244:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327709824 00000100:00100000:3.0:1788872733.886248:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327709824 00000100:00100000:3.0:1788872733.886285:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:3.0:1788872733.886291:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327709824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872733.886320:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327709824:12345-0@lo:400:kworker.0 Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872733.886325:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00080000:3.0:1788872733.886344:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872733.886361:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327708800:0@lo:400:kworker.0 00000100:00100000:2.0:1788872733.886362:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327710208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872733.886371:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327709824:0@lo:400:kworker.0 00000100:00100000:2.0:1788872733.886394:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872733.886417:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327709696:0@lo:400:kworker.0 00000100:00100000:2.0:1788872733.886437:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327710208 00000100:00100000:2.0:1788872733.886450:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327710208 00000100:00100000:2.0:1788872733.886493:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:2.0:1788872733.886500:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327710208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872733.886527:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872733.886582:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327710208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872733.886588:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00100000:2.0:1788872733.886617:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327710208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872733.886719:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327709312 00000100:00100000:0.0:1788872733.886760:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1788872733.886767:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327709312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872733.886811:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327709312:12345-0@lo:400:kworker.0 Request processed in 44us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872733.886816:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1788872733.887793:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327708672 00000100:00100000:1.0:1788872733.887803:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327708672 00000100:00100000:1.0:1788872733.888401:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788872733.888414:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327708672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.888516:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327708672:12345-0@lo:400:kworker.0 Request processed in 107us (2710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872733.888524:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788872733.889843:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872733.889909:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327709312:0@lo:400:kworker.0 00000100:00100000:2.0:1788872733.890123:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327708672:0@lo:400:kworker.0 00000100:00100000:1.0:1788872733.962830:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872733.962893:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872733.962979:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872733.963019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872733.963094:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311165568 00000100:00100000:0.0:1788872733.963108:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311165568 00000100:00100000:2.0:1788872733.963178:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311165056 00000100:00100000:2.0:1788872733.963183:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311165056 00000100:00100000:0.0:1788872733.963204:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2557 00000100:00100000:0.0:1788872733.963227:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311165568:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872733.963229:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 78 00000100:00100000:2.0:1788872733.963236:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2406:x1875765311165056:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872733.963303:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311165568:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 79us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872733.963328:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2557 00000100:00100000:2.0:1788872733.970670:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2406:x1875765311165056:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 7415us (7831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872733.970690:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 78 00000100:00100000:1.0:1788872733.973222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00080000:1.0:1788872733.973279:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872733.973310:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311165440 00000100:00100000:1.0:1788872733.973321:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311165440 00000100:00100000:1.0:1788872733.973392:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2558 00000100:00100000:1.0:1788872733.973403:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311165440:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872733.973481:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2406:x1875765311165440:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 79us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872733.973487:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2558 00000100:00080000:1.0:1788872733.973507:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872733.974607:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311165312 00000100:00100000:3.0:1788872733.974617:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311165312 00000100:00100000:3.0:1788872733.974681:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311165184 00000100:00100000:3.0:1788872733.974685:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311165184 00000100:00100000:3.0:1788872733.974717:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1235 00000100:00100000:3.0:1788872733.974726:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311165312:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872733.974798:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311165312:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 73us (11903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872733.974805:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1235 00000100:00100000:3.0:1788872733.974823:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1236 00000100:00100000:3.0:1788872733.974830:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2406:x1875765311165184:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872733.974875:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2406:x1875765311165184:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 45us (11855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872733.974881:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1236 00000100:00080000:1.0:1788872733.979808:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872733.979820:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788872734.008782:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872734.392884:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872734.392923:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327710336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872734.393006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872734.393270:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327710336 00000100:00100000:1.0:1788872734.393280:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327710336 00000100:00100000:1.0:1788872734.393334:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:1.0:1788872734.393362:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327710336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872734.393412:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872734.393473:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327710336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872734.393481:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:2.0:1788872734.394143:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327710336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872734.395653:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872734.405469:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327710464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872734.405607:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872734.405824:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327710464 00000100:00100000:3.0:1788872734.405853:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327710464 00000100:00100000:3.0:1788872734.406152:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:3.0:1788872734.406164:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327710464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872734.406201:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872734.406447:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327710464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 285us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872734.406456:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:2.0:1788872734.408127:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327710464:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788872735.033502:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872735.296219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872735.296352:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311165696 00000100:00100000:3.0:1788872735.296365:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311165696 00000100:00100000:3.0:1788872735.296448:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1212 00000100:00100000:3.0:1788872735.296460:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:68742:x1875765311165696:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872735.296506:0:83669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445105664 avail 1298866176 00000100:00080000:1.0:1788872735.296592:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872735.303962:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:68742:x1875765311165696:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 7491us (7740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872735.303979:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1212 00000100:00100000:0.0:1788872735.307474:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872735.307626:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311165824 00000100:00100000:3.0:1788872735.307638:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311165824 00000100:00100000:3.0:1788872735.307717:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1213 00000100:00100000:3.0:1788872735.307728:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:68742:x1875765311165824:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872735.307767:0:66192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:3.0:1788872735.307841:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:68742:x1875765311165824:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 115us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872735.307858:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1213 00000100:00080000:1.0:1788872735.309369:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872735.312183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872735.312290:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311165952 00000100:00100000:0.0:1788872735.312300:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311165952 00000100:00100000:0.0:1788872735.312381:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2071 00000100:00100000:0.0:1788872735.312392:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:68742:x1875765311165952:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:0.0:1788872735.312418:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788872735.312735:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872735.312785:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:68742:x1875765311165952:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 394us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872735.312794:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2071 00000100:00100000:0.0:1788872735.322018:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872735.322166:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311166080 00000100:00100000:3.0:1788872735.322178:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311166080 00000100:00100000:3.0:1788872735.322264:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2072 00000100:00100000:3.0:1788872735.322276:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:68742:x1875765311166080:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872735.322320:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872735.322396:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:68742:x1875765311166080:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 122us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872735.322403:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2072 00000100:00080000:1.0:1788872735.322582:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872735.384071:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872735.384256:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311166336 00000100:00100000:0.0:1788872735.384268:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311166336 00000100:00100000:0.0:1788872735.384341:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1214 00000100:00100000:0.0:1788872735.384354:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:68758:x1875765311166336:12345-192.168.204.39@tcp:101:cat.0 00010000:00010000:0.0:1788872735.384378:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872735.384407:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da52f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf0c expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.384537:0:66190:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 9 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.384628:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da536 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.384640:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da536 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.384651:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da536 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.384763:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da536 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.384770:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da536 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.384777:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da536 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.384783:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872735.384788:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da536 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.384796:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da536 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.384809:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9d14a2700) 00010000:00010000:0.0:1788872735.384812:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872735.384817:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da536 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.384824:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da536 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.385345:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da52f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf0c expref: 10 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.385360:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c1358700) 00010000:00010000:0.0:1788872735.385362:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788872735.385366:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da52f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf0c expref: 10 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872735.385378:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e7400, rc 0) 00000100:00100000:0.0:1788872735.385523:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:68758:x1875765311166336:12345-192.168.204.39@tcp:101:cat.0 Request processed in 1171us (1467us total) trans 111669149698 rc 301/301 00000100:00100000:0.0:1788872735.385532:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1214 00000100:00100000:0.0:1788872735.398984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872735.399110:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311166464 00000100:00100000:2.0:1788872735.399120:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311166464 00000100:00100000:2.0:1788872735.399192:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1215 00000100:00100000:2.0:1788872735.399203:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:68758:x1875765311166464:12345-192.168.204.39@tcp:101:cat.0 00010000:00010000:2.0:1788872735.399253:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872735.399276:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da544 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf13 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.399345:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01da54b lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.399361:0:66193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 10 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.399371:0:66193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01da54b lrc: 4/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.399408:0:66193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 10 pid: 89035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.399422:0:66193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 10 pid: 89035 timeout: 3772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872735.399435:0:66193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66193:1875765327710592:192.168.204.39@tcp:104: 00000100:00100000:2.0:1788872735.399531:0:66193:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c6507480 going to sleep for 11 seconds 00000100:00100000:2.0:1788872735.409742:0:66193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66193:1875765327710592:192.168.204.39@tcp:104: 00010000:00010000:2.0:1788872735.409786:0:66193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01da54b lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872735.418710:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872735.418964:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311166592 00000100:00100000:3.0:1788872735.418979:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311166592 00010000:00010000:2.0:1788872735.419627:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 11 pid: 89035 timeout: 3772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872735.419701:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2557 00000100:00100000:2.0:1788872735.419713:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2404:x1875765311166592:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788872735.419730:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:2.0:1788872735.419751:0:6507:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:2.0:1788872735.419755:0:6507:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1788872682 00000004:00010000:2.0:1788872735.419757:0:6507:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1788872670 00000004:00010000:2.0:1788872735.419759:0:6507:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1788872682 00010000:00010000:2.0:1788872735.419765:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 11 pid: 89035 timeout: 3772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.419779:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 11 pid: 89035 timeout: 3772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.419805:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01da34c lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faedb expref: 11 pid: 89035 timeout: 3772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.419824:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9d14a2700) 00010000:00010000:2.0:1788872735.419829:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01da54b lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.419839:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01da54b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.419847:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01da54b lrc: 4/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.419887:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872735.420035:0:66193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01da54b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872735.420045:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01da54b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872735.420108:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788872735.420134:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01da54b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872735.420166:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da544 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf13 expref: 11 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872735.420182:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01da54b lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf13 expref: 10 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872735.420190:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9d14a2700) 00010000:00010000:1.0:1788872735.420193:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788872735.420196:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58af000, rc 0) 00000100:00100000:2.0:1788872735.420242:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2404:x1875765311166592:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 531us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872735.420251:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2557 00000100:00100000:1.0:1788872735.424780:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:68758:x1875765311166464:12345-192.168.204.39@tcp:101:cat.0 Request processed in 25563us (25791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872735.424815:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1215 00000100:00100000:1.0:1788872735.438952:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872735.439178:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311166720 00000100:00100000:3.0:1788872735.439190:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311166720 00000100:00100000:3.0:1788872735.439260:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1216 00000100:00100000:3.0:1788872735.439271:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:68758:x1875765311166720:12345-192.168.204.39@tcp:101:cat.0 00010000:00010000:3.0:1788872735.439293:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872735.439317:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441e00/0xe4e6e89fb01da552 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf1a expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872735.439379:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441e00/0xe4e6e89fb01da552 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf1a expref: 10 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872735.439395:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441e00/0xe4e6e89fb01da552 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf1a expref: 10 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872735.439415:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9d14a2700) 00010000:00010000:3.0:1788872735.439418:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788872735.439422:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5441e00, rc 0) 00000100:00100000:3.0:1788872735.439478:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:68758:x1875765311166720:12345-192.168.204.39@tcp:101:cat.0 Request processed in 209us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872735.439486:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1216 00000100:00100000:0.0:1788872735.455159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872735.455509:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311166848 00000100:00100000:2.0:1788872735.455521:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311166848 00000100:00100000:2.0:1788872735.455643:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1217 00000100:00100000:2.0:1788872735.455658:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2405:x1875765311166848:12345-192.168.204.39@tcp:101:cat.0 00010000:00010000:2.0:1788872735.455680:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872735.455702:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afe00/0xe4e6e89fb01da559 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf21 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.455738:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afe00/0xe4e6e89fb01da559 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf21 expref: 11 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872735.455764:0:68674:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:2.0:1788872735.455767:0:68674:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1788872682 -> 1788872682 00000004:00010000:2.0:1788872735.455769:0:68674:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1788872670 -> 1788872670 00000004:00010000:2.0:1788872735.455771:0:68674:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1788872682 -> 1788872682 00000004:00010000:2.0:1788872735.455774:0:68674:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:2.0:1788872735.455778:0:68674:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:2.0:1788872735.455786:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afe00/0xe4e6e89fb01da559 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf21 expref: 11 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872735.455799:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff98a9d14a2700) 00010000:00010000:2.0:1788872735.455802:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788872735.455806:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58afe00, rc 0) 00000100:00100000:2.0:1788872735.455876:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2405:x1875765311166848:12345-192.168.204.39@tcp:101:cat.0 Request processed in 223us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872735.455907:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1217 00000100:00100000:0.0:1788872735.459514:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872735.460209:0:66205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311166976 00000100:00100000:2.0:1788872735.460223:0:66205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311166976 00002000:00100000:2.0:1788872735.460287:0:66205:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff98a9f663fb80 x1875765311166976/t0(0) o3->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:661/0 lens 488/0 e 0 to 0 dl 1788872746 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788872735.460299:0:66205:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff98a9f663fb80 with x1875765311166976 00000100:00100000:2.0:1788872735.461030:0:66205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 3 00000100:00100000:2.0:1788872735.461047:0:66205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2406:x1875765311166976:12345-192.168.204.39@tcp:3:cat.0 00000100:00100000:2.0:1788872735.461351:0:66205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2406:x1875765311166976:12345-192.168.204.39@tcp:3:cat.0 Request processed in 309us (1851us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788872735.461361:0:66205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 3 00002000:00100000:2.0:1788872735.461370:0:66205:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff98a9f663fb80 x1875765311166976/t0(0) o3->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:661/0 lens 488/4536 e 0 to 0 dl 1788872746 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788872735.461378:0:66205:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff98a9f663fb80 with x1875765311166976 00000100:00100000:3.0:1788872735.466719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872735.467156:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311167232 00000100:00100000:0.0:1788872735.467168:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311167232 00000100:00100000:0.0:1788872735.467222:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 224 00000100:00100000:0.0:1788872735.467232:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:68758:x1875765311167232:12345-192.168.204.39@tcp:35:cat.0 00000100:00100000:0.0:1788872735.467519:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:68758:x1875765311167232:12345-192.168.204.39@tcp:35:cat.0 Request processed in 289us (808us total) trans 111669149699 rc 0/0 00000100:00100000:0.0:1788872735.467527:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 224 00010000:00010000:0.0:1788872736.059281:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872736.441319:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872736.441344:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327710720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872736.441422:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872736.441481:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327710720 00000100:00100000:0.0:1788872736.441490:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327710720 00000100:00100000:0.0:1788872736.441580:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:0.0:1788872736.441589:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327710720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872736.441623:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872736.441673:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327710720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872736.441680:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00080000:0.0:1788872736.441700:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872736.441732:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327710720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872736.442421:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327710848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872736.442458:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872736.443334:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327710848 00000100:00100000:3.0:1788872736.443343:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327710848 00000100:00100000:3.0:1788872736.443413:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:3.0:1788872736.443422:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327710848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872736.443449:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872736.443582:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327710848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872736.443589:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00080000:3.0:1788872736.443610:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872736.443651:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327710848:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788872737.081212:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872738.105239:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872739.002995:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327710976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872739.003089:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872739.003344:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327711104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872739.003377:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872739.003392:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327710976 00000100:00100000:2.0:1788872739.003401:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327710976 00000100:00100000:3.0:1788872739.003417:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327711104 00000100:00100000:3.0:1788872739.003423:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327711104 00000100:00100000:2.0:1788872739.003466:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:2.0:1788872739.003477:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327710976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872739.003517:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445105664 avail 1298866176 00000100:00100000:2.0:1788872739.003582:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327710976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872739.003602:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00100000:2.0:1788872739.003622:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:2.0:1788872739.003629:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327711104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872739.003647:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872739.003726:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327711104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872739.003732:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000100:00100000:1.0:1788872739.003771:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327711232:0@lo:400:kworker.0 00000100:00100000:1.0:1788872739.003809:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872739.003837:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327711744:0@lo:400:kworker.0 00000100:00100000:1.0:1788872739.003864:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872739.003890:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef9e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327712256:0@lo:400:kworker.0 00000100:00100000:1.0:1788872739.003917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872739.003938:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788872739.003945:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327711616:0@lo:400:kworker.0 00000100:00100000:1.0:1788872739.003966:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872739.003991:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327712128:0@lo:400:kworker.0 00000100:00100000:1.0:1788872739.004012:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872739.004053:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327711232 00000100:00100000:1.0:1788872739.004057:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327711232 00000100:00100000:1.0:1788872739.004084:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788872739.004090:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327711232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872739.004125:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327711232:12345-0@lo:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872739.004131:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788872739.004208:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327711744 00000100:00100000:1.0:1788872739.004212:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327711744 00000100:00100000:1.0:1788872739.004251:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327711616 00000100:00100000:1.0:1788872739.004254:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327711616 00000100:00100000:1.0:1788872739.004272:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327712128 00000100:00100000:1.0:1788872739.004281:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327712128 00000100:00100000:1.0:1788872739.004306:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1788872739.004312:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327711744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872739.004346:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327711744:12345-0@lo:400:kworker.0 Request processed in 34us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872739.004351:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1788872739.004362:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1788872739.004368:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327711616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872739.004395:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327711616:12345-0@lo:400:kworker.0 Request processed in 27us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872739.004400:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1788872739.004412:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1788872739.004417:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327712128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872739.004443:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327712128:12345-0@lo:400:kworker.0 Request processed in 25us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872739.004449:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00080000:1.0:1788872739.004469:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872739.004474:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872739.004512:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327711104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872739.004542:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327711616:0@lo:400:kworker.0 00000100:00100000:1.0:1788872739.004572:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327712128:0@lo:400:kworker.0 00000100:00100000:1.0:1788872739.004582:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327711232:0@lo:400:kworker.0 00000100:00100000:1.0:1788872739.004591:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327711744:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.006365:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327712256 00000100:00100000:2.0:1788872739.006380:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327712256 00000100:00100000:2.0:1788872739.006457:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:2.0:1788872739.006473:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327712256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.006580:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327712256:12345-0@lo:400:kworker.0 Request processed in 116us (2663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872739.006587:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:2.0:1788872739.006630:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327711360:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.006667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872739.006693:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327711872:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.006717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872739.006735:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327712384:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.006753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872739.006774:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788872739.006793:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327711488:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.006814:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872739.006830:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327712000:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.006863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872739.006878:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef9e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327712512:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.006907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872739.006933:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327711872 00000100:00100000:2.0:1788872739.006936:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327711872 00000100:00100000:2.0:1788872739.006960:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327712384 00000100:00100000:2.0:1788872739.006962:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327712384 00000100:00100000:2.0:1788872739.006977:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327712000 00000100:00100000:2.0:1788872739.006979:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327712000 00000100:00100000:2.0:1788872739.006996:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:2.0:1788872739.007001:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327711872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.007044:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327711872:12345-0@lo:400:kworker.0 Request processed in 43us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872739.007050:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:2.0:1788872739.007060:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:2.0:1788872739.007066:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327712384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.007090:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327712384:12345-0@lo:400:kworker.0 Request processed in 25us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872739.007095:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:2.0:1788872739.007104:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:2.0:1788872739.007109:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327712000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.007600:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327712000:12345-0@lo:400:kworker.0 Request processed in 489us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872739.007606:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:2.0:1788872739.007642:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327711360 00000100:00100000:2.0:1788872739.007646:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327711360 00000100:00100000:2.0:1788872739.007675:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327711488 00000100:00100000:2.0:1788872739.007686:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327711488 00000100:00100000:2.0:1788872739.007709:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327712512 00000100:00100000:2.0:1788872739.007712:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327712512 00000100:00100000:2.0:1788872739.007727:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:2.0:1788872739.007733:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327711360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.007771:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327711360:12345-0@lo:400:kworker.0 Request processed in 39us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872739.007777:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:2.0:1788872739.007788:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1788872739.007793:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327711488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.007817:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327711488:12345-0@lo:400:kworker.0 Request processed in 24us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872739.007822:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1788872739.007832:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1788872739.007838:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327712512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.007862:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327712512:12345-0@lo:400:kworker.0 Request processed in 25us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872739.007867:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1788872739.007913:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327711488:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.007923:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327712000:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.007931:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef9e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327712512:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.007940:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327711360:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.007948:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327711872:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.007959:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327712384:0@lo:400:kworker.0 00000100:00100000:2.0:1788872739.008019:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327710976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872739.008072:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef9e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327712256:0@lo:400:kworker.0 00000100:00080000:1.0:1788872739.009063:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872739.009085:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872739.009089:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872739.009093:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872739.088149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872739.088201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872739.088240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872739.088262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872739.088292:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872739.088318:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311167616 00000100:00100000:3.0:1788872739.088327:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311167616 00000100:00100000:3.0:1788872739.088389:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311167488 00000100:00100000:3.0:1788872739.088392:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311167488 00000100:00100000:3.0:1788872739.088414:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1243 00000100:00100000:3.0:1788872739.088423:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311167616:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872739.088511:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311167616:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 89us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872739.088532:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1243 00000100:00100000:3.0:1788872739.088576:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1244 00000100:00100000:3.0:1788872739.088582:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2404:x1875765311167488:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872739.088614:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:2404:x1875765311167488:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 33us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872739.088621:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1244 00000100:00100000:1.0:1788872739.088922:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311167872 00000100:00100000:1.0:1788872739.088927:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311167872 00000100:00100000:1.0:1788872739.088970:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311167744 00000100:00100000:1.0:1788872739.088973:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311167744 00000100:00100000:1.0:1788872739.089002:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2563 00000100:00100000:1.0:1788872739.089009:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311167872:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872739.089066:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311167872:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 57us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872739.089073:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2563 00000100:00100000:1.0:1788872739.089087:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2564 00000100:00100000:1.0:1788872739.089093:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311167744:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872739.089118:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311167744:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 26us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872739.089123:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2564 00000100:00080000:1.0:1788872739.089143:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872739.089147:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872739.089150:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872739.089152:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872739.089468:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311167360 00000100:00100000:2.0:1788872739.089474:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311167360 00000100:00100000:2.0:1788872739.089517:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 80 00000100:00100000:2.0:1788872739.089525:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311167360:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872739.089583:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311167360:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 58us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872739.089589:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 80 00010000:00010000:2.0:1788872739.131003:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872739.513524:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872739.513578:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327712640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872739.513663:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872739.514056:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872739.514069:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327712768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872739.514104:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872739.514188:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327712640 00000100:00100000:0.0:1788872739.514196:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327712640 00000100:00100000:0.0:1788872739.514251:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327712768 00000100:00100000:0.0:1788872739.514254:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327712768 00000100:00100000:0.0:1788872739.514275:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:0.0:1788872739.514284:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327712640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872739.514318:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872739.514378:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327712640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872739.514386:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00000100:00100000:0.0:1788872739.514403:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:0.0:1788872739.514409:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327712768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872739.514441:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872739.514696:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327712768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 286us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872739.514703:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00100000:1.0:1788872739.514788:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327712768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872739.514935:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327712640:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788872740.158198:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788872741.069678:0:89003:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00010000:00010000:2.0:1788872741.176796:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872741.561151:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327712896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872741.561232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872741.561278:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872741.561286:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327713024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872741.561311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872741.561350:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327712896 00000100:00100000:2.0:1788872741.561358:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327712896 00000100:00100000:2.0:1788872741.561422:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327713024 00000100:00100000:2.0:1788872741.561425:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327713024 00000100:00100000:2.0:1788872741.561449:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:2.0:1788872741.561471:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327712896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872741.561504:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872741.561569:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327712896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872741.561592:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:2.0:1788872741.561611:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:2.0:1788872741.561617:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327713024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872741.561633:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872741.561660:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327713024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872741.561666:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00080000:2.0:1788872741.561685:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872741.561689:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872741.561725:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327713024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872741.561768:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327712896:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788872742.206058:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788872742.596194:0:89828:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00010000:00010000:2.0:1788872743.224894:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872744.123892:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872744.123918:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327713152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872744.124016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872744.124083:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327713152 00000100:00100000:2.0:1788872744.124091:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327713152 00000100:00100000:2.0:1788872744.124163:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:2.0:1788872744.124173:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327713152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872744.124208:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872744.124258:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327713152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872744.124265:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00100000:2.0:1788872744.124317:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327713152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872744.125072:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872744.125096:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327713280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872744.125143:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872744.125184:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327713280 00000100:00100000:2.0:1788872744.125189:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327713280 00000100:00100000:2.0:1788872744.125232:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:2.0:1788872744.125242:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327713280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872744.125267:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445105664 avail 1298866176 00000100:00100000:2.0:1788872744.125305:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327713280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872744.125323:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:2.0:1788872744.125360:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327713280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872744.125731:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327713664:0@lo:400:kworker.0 00000100:00100000:0.0:1788872744.125766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872744.125797:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327714176:0@lo:400:kworker.0 00000100:00100000:0.0:1788872744.125822:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872744.125843:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327714688:0@lo:400:kworker.0 00000100:00100000:0.0:1788872744.125864:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872744.125883:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788872744.125892:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327713792:0@lo:400:kworker.0 00000100:00100000:0.0:1788872744.125917:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872744.126288:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327714304:0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.126465:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327713536:0@lo:400:kworker.0 00000100:00100000:2.0:1788872744.127188:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327713408:0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.136217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872744.136266:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327714048:0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.136318:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872744.136372:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327714560:0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.136399:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872744.136485:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327713664 00000100:00100000:1.0:1788872744.136493:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327713664 00000100:00100000:1.0:1788872744.136576:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327714688 00000100:00100000:1.0:1788872744.136580:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327714688 00000100:00100000:1.0:1788872744.136601:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327713792 00000100:00100000:1.0:1788872744.136603:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327713792 00000100:00100000:1.0:1788872744.136613:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327713536 00000100:00100000:1.0:1788872744.136615:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327713536 00000100:00100000:1.0:1788872744.136628:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1788872744.136635:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327713664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.136682:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327713664:12345-0@lo:400:kworker.0 Request processed in 47us (10915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872744.136688:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1788872744.136703:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1788872744.136707:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327714688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.136729:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327714688:12345-0@lo:400:kworker.0 Request processed in 22us (10865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872744.136735:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1788872744.136743:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1788872744.136747:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327713792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.136778:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327713792:12345-0@lo:400:kworker.0 Request processed in 31us (10861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872744.136784:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1788872744.136793:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1788872744.136798:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327713536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.136821:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327713536:12345-0@lo:400:kworker.0 Request processed in 23us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872744.136826:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1788872744.136842:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327714176 00000100:00100000:1.0:1788872744.136845:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327714176 00000100:00100000:1.0:1788872744.136873:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327714048 00000100:00100000:1.0:1788872744.136875:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327714048 00000100:00100000:1.0:1788872744.136888:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327714560 00000100:00100000:1.0:1788872744.136890:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327714560 00000100:00100000:1.0:1788872744.136904:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:1.0:1788872744.136909:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327714176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.136948:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327714176:12345-0@lo:400:kworker.0 Request processed in 38us (11125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872744.136953:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:1.0:1788872744.136963:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1788872744.136968:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327714048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.136988:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327714048:12345-0@lo:400:kworker.0 Request processed in 21us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872744.136993:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1788872744.137000:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1788872744.137005:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327714560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.137034:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327714560:12345-0@lo:400:kworker.0 Request processed in 29us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872744.137040:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1788872744.137125:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327713536:0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.137135:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327714048:0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.137142:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327714560:0@lo:400:kworker.0 00000100:00080000:1.0:1788872744.137235:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872744.137239:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872744.137241:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872744.137243:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872744.138194:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872744.138268:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327713664:0@lo:400:kworker.0 00000100:00100000:0.0:1788872744.138281:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327714176:0@lo:400:kworker.0 00000100:00100000:0.0:1788872744.138292:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327714688:0@lo:400:kworker.0 00000100:00100000:0.0:1788872744.138330:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327713792:0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.139185:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327714304 00000100:00100000:1.0:1788872744.139195:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327714304 00000100:00100000:1.0:1788872744.139258:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1788872744.139269:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327714304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.139524:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327714304:12345-0@lo:400:kworker.0 Request processed in 256us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872744.139531:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:2.0:1788872744.140457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872744.140515:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327713920:0@lo:400:kworker.0 00000100:00100000:2.0:1788872744.140577:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872744.140611:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327713920 00000100:00100000:2.0:1788872744.140617:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327713920 00000100:00100000:2.0:1788872744.140675:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:2.0:1788872744.140684:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327713920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872744.140726:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327713920:12345-0@lo:400:kworker.0 Request processed in 44us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872744.140733:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00080000:2.0:1788872744.140756:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872744.140780:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327713920:0@lo:400:kworker.0 00000100:00100000:2.0:1788872744.140787:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327714432:0@lo:400:kworker.0 00000100:00100000:2.0:1788872744.140826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872744.140853:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327714432 00000100:00100000:2.0:1788872744.140857:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327714432 00000100:00100000:2.0:1788872744.140895:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1788872744.140902:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327714432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872744.140947:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327714432:12345-0@lo:400:kworker.0 Request processed in 45us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872744.140953:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00080000:2.0:1788872744.140973:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872744.140989:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327714432:0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.141965:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327713408 00000100:00100000:1.0:1788872744.141976:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327713408 00000100:00100000:1.0:1788872744.142016:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788872744.142024:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327713408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872744.142091:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327713408:12345-0@lo:400:kworker.0 Request processed in 67us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872744.142098:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788872744.144616:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327713408:0@lo:400:kworker.0 00000100:00100000:0.0:1788872744.147465:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327714304:0@lo:400:kworker.0 00000100:00100000:3.0:1788872744.203344:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872744.203394:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872744.203874:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872744.203881:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311168384 00000100:00100000:0.0:1788872744.203895:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311168384 00000100:00100000:3.0:1788872744.203922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872744.203967:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872744.203998:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311168512 00000100:00100000:3.0:1788872744.203999:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311168000 00000100:00100000:0.0:1788872744.204003:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311168512 00000100:00100000:3.0:1788872744.204006:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311168000 00000100:00100000:0.0:1788872744.204035:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2569 00000100:00100000:0.0:1788872744.204047:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311168384:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872744.204088:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 82 00000100:00100000:3.0:1788872744.204098:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e7793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311168000:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872744.204129:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311168384:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 82us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872744.204136:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e7793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311168000:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 38us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872744.204143:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2569 00000100:00100000:0.0:1788872744.204161:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2570 00000100:00100000:0.0:1788872744.204167:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311168512:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872744.204191:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311168512:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872744.204196:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2570 00000100:00080000:0.0:1788872744.204212:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872744.204216:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872744.204315:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 82 00000100:00100000:3.0:1788872744.204359:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311168128 00000100:00100000:3.0:1788872744.204364:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311168128 00000100:00100000:1.0:1788872744.204485:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311168256 00000100:00100000:1.0:1788872744.204489:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311168256 00000100:00100000:3.0:1788872744.204633:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1251 00000100:00100000:3.0:1788872744.204641:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2404:x1875765311168128:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872744.204689:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2404:x1875765311168128:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 39us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872744.204696:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1251 00000100:00080000:0.0:1788872744.210078:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872744.210090:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872744.218458:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1252 00000100:00100000:3.0:1788872744.218475:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311168256:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872744.218587:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311168256:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 117us (14665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872744.218596:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1252 00010000:00010000:3.0:1788872744.249797:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872744.633515:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872744.633544:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327714816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872744.633717:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872744.633823:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327714816 00000100:00100000:0.0:1788872744.633833:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327714816 00000100:00100000:0.0:1788872744.633891:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:0.0:1788872744.633902:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327714816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872744.633946:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872744.634008:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327714816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872744.634016:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00100000:0.0:1788872744.634092:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327714816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872744.653641:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327714944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872744.653726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872744.653785:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327714944 00000100:00100000:2.0:1788872744.653792:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327714944 00000100:00100000:2.0:1788872744.653863:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:2.0:1788872744.653873:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327714944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872744.653912:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872744.653973:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327714944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872744.653980:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:2.0:1788872744.654043:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327714944:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788872745.112966:0:89877:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 09:05:43 (1788872743) 00000100:00100000:0.0:1788872745.247700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872745.247780:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311168640 00000100:00100000:1.0:1788872745.247791:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311168640 00000100:00100000:1.0:1788872745.247862:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1218 00000100:00100000:1.0:1788872745.247873:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:69489:x1875765311168640:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:1.0:1788872745.247895:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872745.247929:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da560 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf28 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.247998:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da567 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248012:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da567 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248023:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da567 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248039:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da56e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248047:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da56e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248054:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da56e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248100:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da567 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248107:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da567 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248127:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da567 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248133:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da567 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248139:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872745.248144:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da567 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248151:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da567 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248164:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c1358700) 00010000:00010000:1.0:1788872745.248167:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872745.248171:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da567 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248177:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248192:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da56e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248197:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da56e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248203:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da56e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248208:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872745.248217:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da56e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248223:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da56e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248231:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a9cd26b700) 00010000:00010000:1.0:1788872745.248234:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872745.248237:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da56e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248243:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da56e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248279:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da560 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf28 expref: 11 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248290:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c1358700) 00010000:00010000:1.0:1788872745.248292:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872745.248296:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf28 expref: 11 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872745.248306:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af800, rc 0) 00000100:00100000:1.0:1788872745.248382:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:69489:x1875765311168640:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 511us (693us total) trans 0 rc 301/301 00000100:00100000:1.0:1788872745.248389:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1218 00010000:00010000:3.0:1788872745.275669:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872745.275927:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872745.275998:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311168896 00000100:00100000:3.0:1788872745.276010:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311168896 00000100:00100000:3.0:1788872745.276076:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1219 00000100:00100000:3.0:1788872745.276087:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:69489:x1875765311168896:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872745.276109:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872745.276112:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788872745.276140:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01da51a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf05 expref: 10 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.276159:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c1358700) 00010000:00010000:3.0:1788872745.276170:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872745.276188:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da575 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf2f expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.276330:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da57c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.276344:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da57c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.276354:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da57c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.276367:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01da583 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.276373:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01da583 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.276379:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01da583 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277051:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da58a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277064:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da58a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277073:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da58a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872745.277084:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:3.0:1788872745.277115:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da57c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277135:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da57c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277143:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da57c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277150:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872745.277154:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da57c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277165:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da57c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277176:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1dc7b00) 00010000:00010000:3.0:1788872745.277179:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872745.277182:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da57c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277189:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da57c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872745.277204:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007df889fa reply state 00000000f315733a transno 111669149700 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01da583 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277215:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01da583 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277222:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a9d1dc7000) 00010000:00010000:3.0:1788872745.277224:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872745.277227:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788872745.277260:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da575 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf2f expref: 12 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277293:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da58a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf2f expref: 11 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.277301:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1dc7400) 00010000:00010000:3.0:1788872745.277304:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788872745.277307:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5441800, rc 0) 00000100:00100000:3.0:1788872745.277391:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:69489:x1875765311168896:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 1306us (1469us total) trans 111669149700 rc 0/0 00000100:00100000:3.0:1788872745.277400:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1219 00000100:00100000:2.0:1788872745.291290:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872745.291616:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311169152 00000100:00100000:3.0:1788872745.291627:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311169152 00000100:00100000:3.0:1788872745.291703:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1220 00000100:00100000:3.0:1788872745.291716:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:69489:x1875765311169152:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872745.291752:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872745.291783:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441400/0xe4e6e89fb01da598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf36 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.291900:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.291926:0:66979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da58a lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf2f expref: 13 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.291936:0:66979:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.291970:0:66979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da58a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf2f expref: 13 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872745.291997:0:66979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da58a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf2f expref: 13 pid: 83669 timeout: 3782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872745.292011:0:66979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66979:1875765327715072:192.168.204.39@tcp:104: 00000100:00100000:3.0:1788872745.292099:0:66979:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef8a0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788872745.302849:0:66979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66979:1875765327715072:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788872745.302913:0:66979:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872745.306172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872745.306214:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311169280 00000100:00100000:2.0:1788872745.306231:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311169280 00010000:00010000:2.0:1788872745.306272:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da58a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf2f expref: 14 pid: 83669 timeout: 3782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872745.306310:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2558 00000100:00100000:2.0:1788872745.306320:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+14:2405:x1875765311169280:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788872745.306334:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872745.306341:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da58a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf2f expref: 14 pid: 83669 timeout: 3782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.306355:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da58a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf2f expref: 14 pid: 83669 timeout: 3782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.306378:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da58a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf2f expref: 14 pid: 83669 timeout: 3782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.306392:0:19657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1dc7400) 00010000:00010000:2.0:1788872745.306396:0:19657:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.306405:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.306413:0:19657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.306438:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872745.306488:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:2405:x1875765311169280:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 168us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872745.306504:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2558 00010000:00010000:2.0:1788872745.306618:0:66979:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.306627:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872745.306645:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00000004:00080000:2.0:1788872745.306777:0:66979:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0xb1:0x0], count =625 00000004:00080000:2.0:1788872745.306786:0:66979:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0xb1:0x0]+625 in llog 00000004:00080000:2.0:1788872745.306830:0:66979:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x322:0x0], index 0: 0 00010000:00010000:2.0:1788872745.306958:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.306967:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.306973:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.306980:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872745.306985:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.306993:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.307003:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1dc7400) 00010000:00010000:2.0:1788872745.307005:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788872745.307009:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.307025:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da59f lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.307089:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441400/0xe4e6e89fb01da598 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf36 expref: 13 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.307098:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1dc7800) 00010000:00010000:2.0:1788872745.307100:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788872745.307104:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441400/0xe4e6e89fb01da598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf36 expref: 13 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872745.307115:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5441400, rc 0) 00000100:00100000:2.0:1788872745.307156:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:69489:x1875765311169152:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 15443us (15876us total) trans 111669149701 rc 301/301 00000100:00100000:2.0:1788872745.307164:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1220 00000100:00100000:2.0:1788872745.313768:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872745.313969:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311169536 00000100:00100000:0.0:1788872745.313981:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311169536 00000100:00100000:0.0:1788872745.314050:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 225 00000100:00100000:0.0:1788872745.314061:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:69489:x1875765311169536:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:0.0:1788872745.314437:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:69489:x1875765311169536:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 374us (677us total) trans 111669149702 rc 0/0 00000100:00100000:0.0:1788872745.314461:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 225 00000100:00100000:2.0:1788872745.325703:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872745.326999:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311169792 00000100:00100000:3.0:1788872745.327021:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311169792 00000100:00100000:3.0:1788872745.327122:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 226 00000100:00100000:3.0:1788872745.327138:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:69489:x1875765311169792:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:3.0:1788872745.330428:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+14:69489:x1875765311169792:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 3272us (4716us total) trans 111669149703 rc 0/0 00000100:00100000:3.0:1788872745.330448:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 226 00010000:00010000:1.0:1788872746.300080:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788872746.430339:0:89003:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149703 is committed 00010000:00010000:1.0:1788872746.431215:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01da583 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.431243:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01da583 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.431251:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01da583 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.431259:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872746.431264:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01da583 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.431271:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01da583 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.431288:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a9d1dc7000) 00010000:00010000:1.0:1788872746.431292:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872746.431297:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01da583 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.431304:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441200/0xe4e6e89fb01da583 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872746.552666:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872746.552874:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311169920 00000100:00100000:1.0:1788872746.552894:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311169920 00000100:00100000:1.0:1788872746.553163:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1221 00000100:00100000:1.0:1788872746.553175:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:69499:x1875765311169920:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:1.0:1788872746.553202:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872746.553225:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da5ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf3d expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.553310:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da5b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.553324:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.553337:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872746.553386:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788872746.553390:0:66190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788872746.553411:0:66190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.553436:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da5ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf3d expref: 11 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.553454:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf3d expref: 10 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.553463:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd26b700) 00010000:00010000:1.0:1788872746.553465:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788872746.553468:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af800, rc 0) 00000100:00100000:1.0:1788872746.553534:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:69499:x1875765311169920:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 360us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872746.553541:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1221 00000100:00080000:2.0:1788872746.553749:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872746.574256:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872746.574830:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311170048 00000100:00100000:1.0:1788872746.574841:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311170048 00000100:00100000:1.0:1788872746.574926:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1222 00000100:00100000:1.0:1788872746.574937:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:69499:x1875765311170048:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:0.0:1788872746.575017:0:66193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445105664 avail 1298866176 00000100:00100000:0.0:1788872746.575098:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:69499:x1875765311170048:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 162us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872746.575106:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1222 00000100:00100000:0.0:1788872746.577737:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872746.577790:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311170176 00000100:00100000:1.0:1788872746.577800:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311170176 00000100:00080000:0.0:1788872746.577866:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872746.577873:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1223 00000100:00100000:1.0:1788872746.577894:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:69499:x1875765311170176:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:1.0:1788872746.577932:0:68674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872746.577996:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:69499:x1875765311170176:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 115us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872746.578007:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1223 00000100:00100000:1.0:1788872746.590063:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872746.597318:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311170304 00000100:00100000:3.0:1788872746.597335:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311170304 00000100:00100000:1.0:1788872746.600687:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2081 00000100:00100000:1.0:1788872746.600706:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:69499:x1875765311170304:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:1.0:1788872746.600745:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872746.600836:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:69499:x1875765311170304:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 135us (10779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872746.600843:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2081 00000100:00080000:3.0:1788872746.602078:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872746.607685:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872746.607773:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311170432 00000100:00100000:3.0:1788872746.607784:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311170432 00000100:00100000:3.0:1788872746.607860:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2082 00000100:00100000:3.0:1788872746.607872:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:69499:x1875765311170432:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872746.607918:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872746.607992:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:69499:x1875765311170432:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 122us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872746.608010:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2082 00000100:00080000:2.0:1788872746.608995:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872746.685344:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872746.685371:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327715200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872746.685446:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872746.685493:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327715200 00000100:00100000:1.0:1788872746.685500:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327715200 00000100:00100000:1.0:1788872746.685580:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:1.0:1788872746.685590:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327715200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872746.685619:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872746.685681:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327715200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872746.685688:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00080000:1.0:1788872746.685712:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872746.685746:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327715200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872746.686045:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327715328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872746.686078:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872746.686151:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327715328 00000100:00100000:0.0:1788872746.686157:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327715328 00000100:00100000:0.0:1788872746.686202:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:0.0:1788872746.686211:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327715328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872746.686222:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872746.686278:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327715328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872746.686285:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00080000:1.0:1788872746.686340:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872746.686362:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327715328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872746.695009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872746.695105:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311170688 00000100:00100000:3.0:1788872746.695125:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311170688 00000100:00100000:3.0:1788872746.695191:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1224 00000100:00100000:3.0:1788872746.695201:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:69506:x1875765311170688:12345-192.168.204.39@tcp:36:mcreate.0 00010000:00010000:3.0:1788872746.695260:0:66192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872746.695288:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da5b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf3d expref: 10 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.695309:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd26b700) 00010000:00010000:3.0:1788872746.695321:0:66192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872746.695390:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da5bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.695404:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da5bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.695414:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da5bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.695425:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da5c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.695432:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da5c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.695439:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da5c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.696032:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da5bb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.696042:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da5bb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.696048:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da5bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.696055:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da5bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.696060:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872746.696064:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da5bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.696072:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da5bb lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.696082:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1dc7b00) 00010000:00010000:3.0:1788872746.696084:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872746.696088:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da5bb lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.696094:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da5bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872746.696115:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b6ca9cf0 reply state 00000000633e1eb3 transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da5c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.696126:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da5c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872746.696142:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9d1dc7100) 00010000:00010000:3.0:1788872746.696144:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872746.696147:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788872746.696335:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:69506:x1875765311170688:12345-192.168.204.39@tcp:36:mcreate.0 Request processed in 1134us (1334us total) trans 111669149704 rc 0/0 00000100:00100000:3.0:1788872746.696344:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1224 00000100:00100000:1.0:1788872746.725362:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872746.732075:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311170816 00000100:00100000:0.0:1788872746.732109:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311170816 00000100:00100000:2.0:1788872746.732351:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1225 00000100:00100000:2.0:1788872746.732366:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:69509:x1875765311170816:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:2.0:1788872746.732393:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872746.732418:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01da5c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf44 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.732499:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da5d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.732513:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.732524:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872746.732606:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788872746.732610:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788872746.732628:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.732662:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01da5c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf44 expref: 13 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.732681:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf44 expref: 12 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.732689:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd098100) 00010000:00010000:2.0:1788872746.732693:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788872746.732696:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58af200, rc 0) 00000100:00100000:2.0:1788872746.732768:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:69509:x1875765311170816:12345-192.168.204.39@tcp:101:rm.0 Request processed in 406us (7418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872746.732776:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1225 00000100:00100000:1.0:1788872746.738337:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872746.738460:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311170944 00000100:00100000:2.0:1788872746.738475:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311170944 00000100:00100000:2.0:1788872746.738740:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1226 00000100:00100000:2.0:1788872746.738753:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:69509:x1875765311170944:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:2.0:1788872746.738776:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872746.738797:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01da5d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf4b expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.738888:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01da5de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.738903:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01da5de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.738915:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01da5de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.738927:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01da5e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.738935:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01da5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.738942:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01da5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739029:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da5ec lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739037:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da5ec lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739043:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da5ec lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872746.739097:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0xa:0x0]: returning size 0 00000004:00200000:2.0:1788872746.739102:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788872746.739121:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da5ec lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739134:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da5ec lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739143:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01da5de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739149:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01da5de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739155:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01da5de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739161:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01da5de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739168:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872746.739172:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01da5de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739179:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01da5de lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739190:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd098100) 00010000:00010000:2.0:1788872746.739193:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872746.739197:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01da5de lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739214:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01da5de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739228:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01da5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739234:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01da5e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739240:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01da5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739245:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872746.739248:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01da5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739255:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01da5e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739262:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9d1dc7100) 00010000:00010000:2.0:1788872746.739265:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872746.739268:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01da5e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739274:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01da5e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739300:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01da5d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf4b expref: 14 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739325:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da5ec lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf4b expref: 13 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.739333:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff98a9cd098b00) 00010000:00010000:2.0:1788872746.739335:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872746.739338:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58ae400, rc 0) 00000100:00100000:2.0:1788872746.739452:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:69509:x1875765311170944:12345-192.168.204.39@tcp:101:rm.0 Request processed in 701us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872746.739461:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1226 00000100:00100000:0.0:1788872746.749386:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872746.749533:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311171200 00000100:00100000:1.0:1788872746.749544:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311171200 00000100:00100000:1.0:1788872746.749651:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1227 00000100:00100000:1.0:1788872746.749663:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:69509:x1875765311171200:12345-192.168.204.39@tcp:36:rm.0 00010000:00010000:1.0:1788872746.749727:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788872746.749755:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da5ec lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf4b expref: 13 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.749776:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff98a9cd098b00) 00010000:00010000:1.0:1788872746.749795:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da5d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf44 expref: 12 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.749806:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd098100) 00010000:00010000:1.0:1788872746.749811:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872746.749858:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01da5f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.749871:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01da5f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.749892:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01da5f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.749903:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01da5fa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.749910:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01da5fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.749916:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01da5fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750000:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da601 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750008:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da601 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750015:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da601 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750220:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da608 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750229:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da608 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750236:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da608 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750250:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da608 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750257:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da608 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750262:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da608 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750528:0:66190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872746.750675:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da601 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750683:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da601 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750690:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da601 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750696:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872746.750702:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da601 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750710:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da601 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750719:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff98a9cd26b200) 00010000:00010000:1.0:1788872746.750722:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788872746.750726:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da601 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750742:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da601 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750763:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01da5f3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750768:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01da5f3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750775:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01da5f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750781:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01da5f3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750786:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52aee00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872746.750788:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01da5f3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750794:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01da5f3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750801:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9cd26b500) 00010000:00010000:1.0:1788872746.750803:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872746.750805:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01da5f3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750811:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01da5f3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872746.750824:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021b935ee reply state 00000000dac8582c transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01da5fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750840:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01da5fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872746.750846:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9d1dc7100) 00010000:00010000:1.0:1788872746.750849:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872746.750852:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872746.750944:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:69509:x1875765311171200:12345-192.168.204.39@tcp:36:rm.0 Request processed in 1281us (1579us total) trans 111669149705 rc 0/0 00000100:00100000:1.0:1788872746.750951:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1227 00010000:00010000:2.0:1788872746.751043:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872746.751051:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da608 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.751057:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872746.751061:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da608 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.751068:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da608 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.751078:0:14981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff98a9cd26b200) 00010000:00010000:2.0:1788872746.751080:0:14981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788872746.751083:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da608 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.751089:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01da608 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872746.751103:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872746.751111:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872746.751113:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872747.320994:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872748.347953:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872749.243544:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1c9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327715456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872749.243857:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872749.243916:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327715456 00000100:00100000:2.0:1788872749.243923:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327715456 00000100:00100000:2.0:1788872749.243973:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:2.0:1788872749.243983:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327715456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872749.244020:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872749.244069:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327715456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872749.244076:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:2.0:1788872749.244121:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1c9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327715456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872749.244431:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327715584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872749.244463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872749.244497:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327715584 00000100:00100000:1.0:1788872749.244502:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327715584 00000100:00100000:1.0:1788872749.244530:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:1.0:1788872749.244536:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327715584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788872749.245056:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445105664 avail 1298866176 00010000:00000080:1.0:1788872749.245077:0:8447:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4a15c00 x1875765327715584/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:675/0 lens 224/368 e 0 to 0 dl 1788872760 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872749.245124:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327715584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 587us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872749.245131:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000100:00100000:1.0:1788872749.245176:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327715584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872749.249643:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327715840:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.249725:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872749.249759:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327716352:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.249788:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872749.249809:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327716864:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.249843:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872749.249869:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788872749.249875:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327715968:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.249897:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872749.249916:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327716480:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.249938:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872749.249956:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327716992:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.249977:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872749.250017:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327715840 00000100:00100000:3.0:1788872749.250025:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327715840 00000100:00100000:3.0:1788872749.250083:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327715968 00000100:00100000:3.0:1788872749.250087:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327715968 00000100:00100000:3.0:1788872749.250120:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327716992 00000100:00100000:3.0:1788872749.250123:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327716992 00000100:00100000:3.0:1788872749.250145:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1788872749.250154:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327715840:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872749.250177:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5ace300 x1875765327715840/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:675/0 lens 224/224 e 0 to 0 dl 1788872760 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872749.250217:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327715840:12345-0@lo:400:kworker.0 Request processed in 63us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872749.250224:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1788872749.250241:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1788872749.250246:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327715968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250275:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327715968:12345-0@lo:400:kworker.0 Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872749.250279:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1788872749.250290:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1788872749.250296:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327716992:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872749.250306:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4df1c00 x1875765327716992/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:675/0 lens 224/224 e 0 to 0 dl 1788872760 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872749.250348:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327716992:12345-0@lo:400:kworker.0 Request processed in 52us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872749.250353:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1788872749.250372:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327716352 00000100:00100000:3.0:1788872749.250376:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327716352 00000100:00100000:3.0:1788872749.250401:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327716864 00000100:00100000:3.0:1788872749.250404:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327716864 00000100:00100000:3.0:1788872749.250421:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327716480 00000100:00100000:3.0:1788872749.250423:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327716480 00000100:00100000:3.0:1788872749.250450:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:3.0:1788872749.250456:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327716352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250487:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327716352:12345-0@lo:400:kworker.0 Request processed in 31us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872749.250494:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:3.0:1788872749.250505:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:3.0:1788872749.250510:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327716864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250538:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327716864:12345-0@lo:400:kworker.0 Request processed in 28us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872749.250544:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:3.0:1788872749.250578:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:3.0:1788872749.250584:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327716480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250612:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327716480:12345-0@lo:400:kworker.0 Request processed in 29us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872749.250617:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00080000:3.0:1788872749.250642:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872749.250646:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872749.250649:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872749.250651:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872749.250689:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327715968:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250700:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327716480:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250710:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327716992:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250719:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327715840:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250729:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327716352:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250752:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327716864:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250796:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327715712:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250838:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872749.250872:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327716224:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872749.250911:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327716736:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872749.250953:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788872749.250959:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327716096:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.250979:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872749.250996:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327716608:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.251016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872749.251041:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327715712 00000100:00100000:3.0:1788872749.251045:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327715712 00000100:00100000:3.0:1788872749.251074:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788872749.251080:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327715712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.251111:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327715712:12345-0@lo:400:kworker.0 Request processed in 32us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872749.251117:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788872749.251142:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327716224 00000100:00100000:3.0:1788872749.251145:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327716224 00000100:00100000:3.0:1788872749.251170:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327716096 00000100:00100000:3.0:1788872749.251173:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327716096 00000100:00100000:3.0:1788872749.251188:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327716608 00000100:00100000:3.0:1788872749.251191:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327716608 00000100:00100000:3.0:1788872749.251206:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1788872749.251220:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327716224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.251250:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327716224:12345-0@lo:400:kworker.0 Request processed in 32us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872749.251256:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1788872749.251267:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1788872749.251272:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327716096:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872749.251284:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c7832680 x1875765327716096/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:675/0 lens 224/224 e 0 to 0 dl 1788872760 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872749.251305:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327716096:12345-0@lo:400:kworker.0 Request processed in 34us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872749.251311:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1788872749.251320:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1788872749.251324:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327716608:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872749.251333:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c7831c00 x1875765327716608/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:675/0 lens 224/224 e 0 to 0 dl 1788872760 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872749.251351:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327716608:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872749.251356:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1788872749.251370:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327716736 00000100:00100000:3.0:1788872749.251373:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327716736 00000100:00100000:3.0:1788872749.251394:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:3.0:1788872749.251399:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327716736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.251424:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327716736:12345-0@lo:400:kworker.0 Request processed in 25us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872749.251429:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00080000:3.0:1788872749.251453:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872749.251456:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872749.251457:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872749.251481:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327716096:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.251489:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327716608:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.251496:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327715712:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.251504:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327716224:0@lo:400:kworker.0 00000100:00100000:3.0:1788872749.251510:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327716736:0@lo:400:kworker.0 00000100:00100000:2.0:1788872749.331207:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872749.331260:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872749.331287:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872749.331309:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872749.331352:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872749.331394:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311171328 00000100:00100000:2.0:1788872749.331405:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311171328 00000100:00100000:2.0:1788872749.331462:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 84 00000100:00100000:2.0:1788872749.331472:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311171328:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872749.331582:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311171328:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 80us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872749.331590:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 84 00000100:00100000:2.0:1788872749.331769:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311171584 00000100:00100000:2.0:1788872749.331783:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311171584 00000100:00100000:2.0:1788872749.331837:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311171456 00000100:00100000:2.0:1788872749.331841:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311171456 00000100:00100000:2.0:1788872749.331867:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1259 00000100:00100000:2.0:1788872749.331875:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311171584:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872749.331908:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311171584:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 34us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872749.331915:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1259 00000100:00100000:2.0:1788872749.331928:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1260 00000100:00100000:2.0:1788872749.331936:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:2405:x1875765311171456:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000080:2.0:1788872749.331957:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c3a63b80 x1875765311171456/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:675/0 lens 224/224 e 0 to 0 dl 1788872760 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872749.331979:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:2405:x1875765311171456:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 46us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872749.331986:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1260 00000100:00080000:2.0:1788872749.332931:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788872749.332939:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872749.334521:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311171840 00000100:00100000:1.0:1788872749.334537:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311171840 00000100:00100000:1.0:1788872749.334646:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311171712 00000100:00100000:1.0:1788872749.334651:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311171712 00000100:00100000:1.0:1788872749.334690:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2575 00000100:00100000:1.0:1788872749.334699:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311171840:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872749.334903:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311171840:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 203us (3613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872749.334912:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2575 00000100:00100000:1.0:1788872749.334929:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2576 00000100:00100000:1.0:1788872749.334936:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311171712:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872749.334963:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2405:x1875765311171712:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 27us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872749.334969:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2576 00000100:00080000:3.0:1788872749.337745:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872749.337756:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788872749.369205:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872749.753863:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872749.753884:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327717120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872749.753954:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872749.756686:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327717120 00000100:00100000:0.0:1788872749.756704:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327717120 00000100:00100000:0.0:1788872749.756767:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:0.0:1788872749.756777:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327717120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872749.756813:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872749.756936:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327717120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (2981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872749.756943:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00100000:0.0:1788872749.757001:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327717120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872749.760355:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872749.760391:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327717248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872749.760479:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872749.760910:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327717248 00000100:00100000:1.0:1788872749.760920:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327717248 00000100:00100000:1.0:1788872749.760979:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:1.0:1788872749.760990:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327717248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872749.761023:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872749.761084:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327717248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872749.761092:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00100000:0.0:1788872749.761237:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327717248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788872750.393836:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872751.423659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872751.801318:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327717376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872751.801410:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872751.802062:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327717376 00000100:00100000:0.0:1788872751.802074:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327717376 00000100:00100000:0.0:1788872751.802140:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:0.0:1788872751.802153:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327717376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872751.802185:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872751.802259:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327717376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872751.802279:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00080000:2.0:1788872751.802354:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872751.802442:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327717376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872751.802462:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872751.802469:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327717504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872751.802495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872751.803953:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327717504 00000100:00100000:0.0:1788872751.803963:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327717504 00000100:00100000:0.0:1788872751.804035:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:0.0:1788872751.804047:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327717504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872751.804076:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872751.804159:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327717504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872751.804178:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00100000:0.0:1788872751.804228:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327717504:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788872751.805208:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788872752.443667:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788872753.291758:0:89003:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149705 is committed 00010000:00010000:3.0:1788872753.291894:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da5c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.291906:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da5c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.291915:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da5c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.291921:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872753.291926:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da5c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.291953:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da5c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.291973:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9d1dc7100) 00010000:00010000:3.0:1788872753.291976:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872753.291982:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da5c2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.291989:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440a00/0xe4e6e89fb01da5c2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.292010:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01da5fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.292016:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01da5fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.292022:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01da5fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.292027:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872753.292031:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01da5fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.292037:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01da5fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.292045:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9d1dc7100) 00010000:00010000:3.0:1788872753.292047:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872753.292050:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01da5fa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872753.292062:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01da5fa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872753.474452:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872754.360871:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327717888:0@lo:400:kworker.0 00000100:00100000:0.0:1788872754.360894:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327717632:0@lo:400:kworker.0 00000100:00100000:3.0:1788872754.360965:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872754.360966:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872754.361029:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327717760:0@lo:400:kworker.0 00000100:00100000:2.0:1788872754.361115:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327718016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872754.361115:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327718144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872754.361145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872754.361211:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327718016 00000100:00100000:0.0:1788872754.361220:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327718016 00000100:00100000:2.0:1788872754.361231:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872754.361238:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327718400:0@lo:400:kworker.0 00000100:00100000:2.0:1788872754.361263:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872754.361284:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:0.0:1788872754.361292:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327718016:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872754.361298:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327718528:0@lo:400:kworker.0 00000004:00000024:0.0:1788872754.361334:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445105664 avail 1298866176 00000100:00100000:2.0:1788872754.361341:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:0.0:1788872754.361352:0:30614:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9ef3d0e00 x1875765327718016/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:680/0 lens 224/368 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872754.361396:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327718016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872754.361403:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000100:00100000:2.0:1788872754.361422:0:89010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327717632 00000100:00100000:2.0:1788872754.361426:0:89010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327717632 00000100:00100000:0.0:1788872754.361428:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327719040:0@lo:400:kworker.0 00000100:00100000:0.0:1788872754.361451:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872754.361460:0:89010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788872754.361468:0:89010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327717632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872754.361481:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327718912:0@lo:400:kworker.0 00000100:00100000:0.0:1788872754.361501:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327718016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872754.361502:0:89010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327717632:12345-0@lo:400:kworker.0 Request processed in 35us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872754.361508:0:89010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788872754.361521:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872754.361543:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327717888 00000100:00100000:0.0:1788872754.361570:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872754.361571:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327717888 00000100:00100000:3.0:1788872754.361593:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327718400 00000100:00100000:3.0:1788872754.361599:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327718400 00000100:00100000:0.0:1788872754.361606:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327717632:0@lo:400:kworker.0 00000100:00100000:2.0:1788872754.361618:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1788872754.361626:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327718656:0@lo:400:kworker.0 00000100:00100000:2.0:1788872754.361627:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327717888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872754.361643:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1788872754.361657:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872754.361658:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327718400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872754.361665:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327717888:12345-0@lo:400:kworker.0 Request processed in 40us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872754.361673:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1788872754.361681:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327719168:0@lo:400:kworker.0 00000100:00080000:2.0:1788872754.361695:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872754.361719:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327718400:12345-0@lo:400:kworker.0 Request processed in 67us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872754.361736:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872754.361737:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327718912 00000100:00100000:2.0:1788872754.361742:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327718912 00000100:00100000:3.0:1788872754.361752:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1788872754.361765:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788872754.361768:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327718144 00000100:00100000:2.0:1788872754.361771:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327718144 00000100:00100000:0.0:1788872754.361774:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327718272:0@lo:400:kworker.0 00000100:00100000:2.0:1788872754.361792:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:3.0:1788872754.361795:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327718400:0@lo:400:kworker.0 00000100:00100000:2.0:1788872754.361802:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327718912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872754.361803:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872754.361830:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327718784:0@lo:400:kworker.0 00000100:00100000:3.0:1788872754.361841:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327717888:0@lo:400:kworker.0 00000100:00100000:2.0:1788872754.361843:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327718912:12345-0@lo:400:kworker.0 Request processed in 42us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872754.361853:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872754.361857:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00100000:3.0:1788872754.361868:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327718912:0@lo:400:kworker.0 00000100:00100000:0.0:1788872754.361877:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327719296:0@lo:400:kworker.0 00000100:00100000:0.0:1788872754.361903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872754.362002:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:2.0:1788872754.362015:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327718144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872754.362045:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872754.362081:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327718144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872754.362181:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327718272 00000100:00100000:3.0:1788872754.362186:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327718272 00000100:00100000:3.0:1788872754.362218:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327718784 00000100:00100000:3.0:1788872754.362221:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327718784 00000100:00100000:3.0:1788872754.362238:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327719296 00000100:00100000:3.0:1788872754.362241:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327719296 00000100:00100000:0.0:1788872754.362249:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1788872754.362260:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327718272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872754.362268:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00010000:00000080:0.0:1788872754.362274:0:66192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c3a60380 x1875765327718272/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1788872765 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872754.362280:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327718784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872754.362312:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327718272:12345-0@lo:400:kworker.0 Request processed in 55us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872754.362320:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00010000:00000080:3.0:1788872754.362325:0:66979:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9faa78000 x1875765327718784/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1788872765 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872754.362335:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1788872754.362344:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327719296:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788872754.362356:0:66192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9faa7b800 x1875765327719296/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1788872765 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872754.362369:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327718784:12345-0@lo:400:kworker.0 Request processed in 91us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872754.362377:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1788872754.362394:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327719296:12345-0@lo:400:kworker.0 Request processed in 50us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872754.362401:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1788872754.362410:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327718528 00000100:00100000:3.0:1788872754.362415:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327718528 00000100:00100000:0.0:1788872754.362440:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327718272:0@lo:400:kworker.0 00000100:00100000:3.0:1788872754.362451:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327719040 00000100:00100000:3.0:1788872754.362456:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327719040 00000100:00100000:0.0:1788872754.362456:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327718784:0@lo:400:kworker.0 00000100:00100000:3.0:1788872754.362481:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327718656 00000100:00100000:0.0:1788872754.362481:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327719296:0@lo:400:kworker.0 00000100:00100000:0.0:1788872754.362497:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327718144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872754.362685:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327718656 00000100:00100000:3.0:1788872754.362716:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327719168 00000100:00100000:3.0:1788872754.362719:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327719168 00000100:00100000:3.0:1788872754.362761:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:3.0:1788872754.362768:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327718528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872754.362802:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1788872754.362815:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327719040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872754.362816:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327718528:12345-0@lo:400:kworker.0 Request processed in 45us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872754.362827:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:3.0:1788872754.362843:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:3.0:1788872754.362852:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327718656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872754.362862:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327719040:12345-0@lo:400:kworker.0 Request processed in 52us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872754.362869:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1788872754.362887:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:3.0:1788872754.362899:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327718656:12345-0@lo:400:kworker.0 Request processed in 45us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872754.362899:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327719168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872754.362911:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:0.0:1788872754.362951:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327719168:12345-0@lo:400:kworker.0 Request processed in 57us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872754.362958:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00080000:3.0:1788872754.363013:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872754.363017:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872754.363019:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872754.363045:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327719040:0@lo:400:kworker.0 00000100:00100000:3.0:1788872754.363069:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327718528:0@lo:400:kworker.0 00000100:00100000:3.0:1788872754.363097:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327718656:0@lo:400:kworker.0 00000100:00100000:3.0:1788872754.363107:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327719168:0@lo:400:kworker.0 00000100:00100000:1.0:1788872754.364274:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872754.366677:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327717760 00000100:00100000:3.0:1788872754.366692:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327717760 00000100:00080000:0.0:1788872754.366771:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872754.366788:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1788872754.366799:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327717760:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872754.367045:0:66979:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f0987b80 x1875765327717760/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:680/0 lens 224/224 e 0 to 0 dl 1788872765 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872754.367153:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327717760:12345-0@lo:400:kworker.0 Request processed in 355us (2883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872754.367161:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1788872754.367225:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327717760:0@lo:400:kworker.0 00000100:00100000:2.0:1788872754.367321:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00000100:00100000:3.0:1788872754.444883:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872754.444935:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872754.444964:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872754.444984:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872754.445012:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872754.445042:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311172480 00000100:00100000:3.0:1788872754.445052:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311172480 00000100:00100000:3.0:1788872754.445104:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311172352 00000100:00100000:3.0:1788872754.445107:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311172352 00000100:00100000:3.0:1788872754.445130:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2581 00000100:00100000:3.0:1788872754.445139:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311172480:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872754.445226:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311172480:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 87us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872754.445249:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2581 00000100:00100000:3.0:1788872754.445267:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2582 00000100:00100000:3.0:1788872754.445275:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311172352:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872754.445302:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2404:x1875765311172352:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872754.445308:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2582 00000100:00100000:1.0:1788872754.445395:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311171968 00000100:00100000:1.0:1788872754.445401:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311171968 00000100:00100000:3.0:1788872754.445429:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311172224 00000100:00100000:1.0:1788872754.445431:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 86 00000100:00100000:3.0:1788872754.445432:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311172224 00000100:00100000:1.0:1788872754.445437:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311171968:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872754.445456:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311172096 00000100:00100000:3.0:1788872754.445459:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311172096 00000100:00100000:1.0:1788872754.445469:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311171968:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 32us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872754.445476:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 86 00000100:00100000:3.0:1788872754.445478:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1267 00000100:00100000:3.0:1788872754.445483:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311172224:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872754.445508:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311172224:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872754.445514:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1267 00000100:00100000:3.0:1788872754.445525:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1268 00000100:00100000:3.0:1788872754.445530:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:2404:x1875765311172096:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000080:3.0:1788872754.445544:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c7830380 x1875765311172096/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 224/224 e 0 to 0 dl 1788872765 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872754.445942:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872754.445947:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872754.445949:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872754.445951:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872754.448054:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:2404:x1875765311172096:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 2514us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872754.448069:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1268 00010000:00010000:2.0:1788872754.489819:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788872754.562097:0:90272:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1788872754.666995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872754.667067:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311172608 00000100:00100000:0.0:1788872754.667078:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311172608 00000100:00100000:0.0:1788872754.667140:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1228 00000100:00100000:0.0:1788872754.667150:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:69577:x1875765311172608:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872754.667170:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872754.667193:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6c00/0xe4e6e89fb01da60f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf52 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.667261:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da616 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.667286:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.667312:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872754.667372:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788872754.667377:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788872754.667398:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.667424:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6c00/0xe4e6e89fb01da60f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf52 expref: 11 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.667442:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da616 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf52 expref: 10 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.667449:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1db6800) 00010000:00010000:0.0:1788872754.667452:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788872754.667455:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e7000, rc 0) 00010000:00000080:0.0:1788872754.667463:0:66979:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6c94a80 x1875765311172608/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 576/688 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872754.667528:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:69577:x1875765311172608:12345-192.168.204.39@tcp:101:dd.0 Request processed in 379us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872754.667534:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1228 00000100:00100000:1.0:1788872754.675355:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872754.677707:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311172864 00000100:00100000:0.0:1788872754.677733:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311172864 00000100:00100000:0.0:1788872754.677877:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1229 00000100:00100000:0.0:1788872754.677898:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:69577:x1875765311172864:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872754.677920:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872754.677923:0:66192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788872754.677951:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da616 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf52 expref: 10 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.677973:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1db6800) 00010000:00010000:0.0:1788872754.677984:0:66192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872754.678008:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da61d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf59 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678151:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da624 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678165:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678176:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678190:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6600/0xe4e6e89fb01da62b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678198:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6600/0xe4e6e89fb01da62b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678204:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6600/0xe4e6e89fb01da62b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678274:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7a00/0xe4e6e89fb01da632 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678289:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7a00/0xe4e6e89fb01da632 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678296:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7a00/0xe4e6e89fb01da632 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872754.678308:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:0.0:1788872754.678409:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da624 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678417:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da624 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678424:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da624 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678431:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da624 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678437:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872754.678441:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da624 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678448:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da624 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678457:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1db6900) 00010000:00010000:0.0:1788872754.678460:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872754.678463:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da624 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678469:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678486:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6600/0xe4e6e89fb01da62b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678494:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6600/0xe4e6e89fb01da62b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678501:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6600/0xe4e6e89fb01da62b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678518:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872754.678521:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6600/0xe4e6e89fb01da62b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678527:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6600/0xe4e6e89fb01da62b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678535:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a9d1db6000) 00010000:00010000:0.0:1788872754.678537:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872754.678540:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6600/0xe4e6e89fb01da62b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678545:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6600/0xe4e6e89fb01da62b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678611:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da61d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf59 expref: 12 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678625:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7a00/0xe4e6e89fb01da632 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf59 expref: 11 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.678643:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1db6400) 00010000:00010000:0.0:1788872754.678645:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872754.678648:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e7a00, rc 0) 00010000:00000080:0.0:1788872754.678656:0:66192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9c12af480 x1875765311172864/t111669149706(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 776/848 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872754.678738:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:69577:x1875765311172864:12345-192.168.204.39@tcp:101:dd.0 Request processed in 843us (3399us total) trans 111669149706 rc 0/0 00000100:00100000:0.0:1788872754.678746:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1229 00000100:00100000:0.0:1788872754.690704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872754.690764:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311172992 00000100:00100000:0.0:1788872754.690776:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311172992 00000100:00100000:0.0:1788872754.690843:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1230 00000100:00100000:0.0:1788872754.690853:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:69577:x1875765311172992:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872754.690888:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872754.690912:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01da640 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf60 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.690950:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6a00/0xe4e6e89fb01da647 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.690964:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6a00/0xe4e6e89fb01da647 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.690976:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6a00/0xe4e6e89fb01da647 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.691085:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01da640 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf60 expref: 13 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.691306:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6a00/0xe4e6e89fb01da647 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf60 expref: 12 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.691319:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1db6400) 00010000:00010000:0.0:1788872754.691323:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788872754.691327:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e6a00, rc 0) 00010000:00000080:0.0:1788872754.691336:0:66193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9faa7a300 x1875765311172992/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 568/1344 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872754.691406:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:69577:x1875765311172992:12345-192.168.204.39@tcp:101:dd.0 Request processed in 554us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872754.691414:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1230 00000100:00100000:2.0:1788872754.703600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872754.703979:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311173248 00000100:00100000:0.0:1788872754.703996:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311173248 00000100:00100000:0.0:1788872754.704087:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1231 00000100:00100000:0.0:1788872754.704098:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:69577:x1875765311173248:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:0.0:1788872754.704174:0:66979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872754.704207:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7a00/0xe4e6e89fb01da632 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf59 expref: 12 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.704225:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1db6400) 00010000:00010000:0.0:1788872754.704230:0:66979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872754.704430:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da64e lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.704444:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da64e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.704465:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da64e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788872754.704511:0:66979:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149707 00000004:00010000:0.0:1788872754.704534:0:66979:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001263b7fa reply state 00000000412ec5fb transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da64e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.704566:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da64e lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.704573:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1db6400) 00010000:00010000:0.0:1788872754.704576:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872754.704579:0:66979:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1788872754.704614:0:66979:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6c96680 x1875765311173248/t111669149708(0) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 488/456 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872754.704700:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+14:69577:x1875765311173248:12345-192.168.204.39@tcp:36:dd.0 Request processed in 603us (1111us total) trans 111669149708 rc 0/0 00000100:00100000:0.0:1788872754.704708:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1231 00000020:00080000:0.0:1788872754.704713:0:66979:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788872754.707376:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872754.707454:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311173376 00000100:00100000:3.0:1788872754.707465:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311173376 00000100:00100000:3.0:1788872754.707534:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1232 00000100:00100000:3.0:1788872754.707544:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+14:69577:x1875765311173376:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872754.707596:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872754.707617:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440800/0xe4e6e89fb01da655 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf67 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.707678:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440800/0xe4e6e89fb01da655 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf67 expref: 15 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.707694:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440800/0xe4e6e89fb01da655 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf67 expref: 15 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.707711:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1db6400) 00010000:00010000:3.0:1788872754.707714:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788872754.707717:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5440800, rc 0) 00010000:00000080:3.0:1788872754.707735:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9ee81f100 x1875765311173376/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 376/584 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872754.707805:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+15:69577:x1875765311173376:12345-192.168.204.39@tcp:101:dd.0 Request processed in 263us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872754.707812:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1232 00000100:00100000:0.0:1788872754.710787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872754.711000:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311173632 00000100:00100000:1.0:1788872754.711012:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311173632 00000100:00100000:1.0:1788872754.711083:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1233 00000100:00100000:1.0:1788872754.711095:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+15:69577:x1875765311173632:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872754.711119:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872754.711122:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788872754.711152:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440800/0xe4e6e89fb01da655 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf67 expref: 15 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872754.711169:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1db6400) 00010000:00010000:1.0:1788872754.711173:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872754.711203:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da65c lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf6e expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872754.711257:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da663 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872754.711270:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da663 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872754.711281:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da663 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788872754.711439:0:83669:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x2a3:0x0], count =127 00000004:00080000:1.0:1788872754.711447:0:83669:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x2a3:0x0]+127 in llog 00000004:00080000:1.0:1788872754.711472:0:83669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x322:0x0], index 1: 0 00000004:00080000:1.0:1788872754.711478:0:83669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x323:0x0], index 0: 0 00010000:00010000:1.0:1788872754.711618:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da663 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf6e expref: 17 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872754.711626:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1db6400) 00010000:00010000:1.0:1788872754.711629:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788872754.711638:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01da65c lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf6e expref: 17 pid: 83669 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872754.711653:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da663 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf6e expref: 16 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872754.711682:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1db6400) 00010000:00010000:1.0:1788872754.711684:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788872754.711686:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af800, rc 0) 00010000:00000080:1.0:1788872754.711702:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9faa79880 x1875765311173632/t111669149709(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 376/608 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872754.711789:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+16:69577:x1875765311173632:12345-192.168.204.39@tcp:101:dd.0 Request processed in 696us (1009us total) trans 111669149709 rc 0/0 00000100:00100000:1.0:1788872754.711797:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1233 00000100:00100000:2.0:1788872754.727012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872754.727089:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311173760 00000100:00100000:3.0:1788872754.727105:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311173760 00000100:00100000:3.0:1788872754.727174:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5964 00000100:00100000:3.0:1788872754.727184:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:69577:x1875765311173760:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872754.727204:0:26182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872754.727228:0:26182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01da66a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf75 expref: -99 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872754.727269:0:26182:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872754.727306:0:26182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x322:0x0].0x0 since=3691s v=(0 0) 00010000:00010000:3.0:1788872754.727311:0:26182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872754.727330:0:26182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01da66a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf75 expref: 6 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.727349:0:26182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01da66a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf75 expref: 6 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.727365:0:26182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5440a00, rc 0) 00000100:00100000:3.0:1788872754.727432:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:69577:x1875765311173760:12345-192.168.204.39@tcp:101:dd.0 Request processed in 250us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872754.727440:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5964 00000100:00100000:0.0:1788872754.743445:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872754.743625:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311173888 00000100:00100000:1.0:1788872754.743637:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311173888 00000100:00100000:1.0:1788872754.743696:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5965 00000100:00100000:1.0:1788872754.743705:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:69577:x1875765311173888:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872754.743733:0:26187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872754.743756:0:26187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01da671 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf7c expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872754.743784:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872754.743807:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x322:0x0].0x0 since=3691s v=(0 0) 00010000:00010000:1.0:1788872754.743811:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872754.743821:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01da671 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf7c expref: 6 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872754.743841:0:26187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01da671 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf7c expref: 6 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872754.743855:0:26187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52ae200, rc 0) 00000100:00100000:1.0:1788872754.744011:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:69577:x1875765311173888:12345-192.168.204.39@tcp:101:dd.0 Request processed in 306us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872754.744018:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5965 00000100:00100000:2.0:1788872754.747059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872754.747135:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311174016 00000100:00100000:1.0:1788872754.747145:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311174016 00000100:00100000:1.0:1788872754.747227:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5966 00000100:00100000:1.0:1788872754.747239:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:69577:x1875765311174016:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872754.747260:0:14545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872754.747279:0:14545:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f88eb5a/0xe4e6e89fb01da678 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf83 expref: -99 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872754.747307:0:14545:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872754.747339:0:14545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x323:0x0].0x0 since=3691s v=(0 0) 00010000:00010000:1.0:1788872754.747343:0:14545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x323:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872754.747352:0:14545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f88eb5a/0xe4e6e89fb01da678 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf83 expref: 7 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872754.747370:0:14545:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009f88eb5a/0xe4e6e89fb01da678 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf83 expref: 7 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872754.747384:0:14545:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52ae800, rc 0) 00000100:00100000:1.0:1788872754.747455:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:69577:x1875765311174016:12345-192.168.204.39@tcp:101:dd.0 Request processed in 219us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872754.747462:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5966 00000100:00100000:3.0:1788872754.750245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872754.750305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872754.750480:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311174144 00000100:00100000:1.0:1788872754.750494:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311174144 00002000:00010000:1.0:1788872754.750544:0:24866:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/802 (1048576->18446744073709551615) 00002000:00100000:1.0:1788872754.750580:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9ef3d1f80 with x1875765311174144 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1788872754.750595:0:24866:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98a9ef3d1f80. 00000100:00100000:1.0:1788872754.750618:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311174272 00000100:00100000:1.0:1788872754.750630:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311174272 00002000:00010000:1.0:1788872754.750645:0:24866:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/803 (0->18446744073709551615) 00002000:00100000:1.0:1788872754.750648:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9ef3d2a00 with x1875765311174272 ext(0->18446744073709551615) 00002000:00010000:1.0:1788872754.750655:0:24866:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9ef3d2a00. 00000100:00100000:1.0:1788872754.750672:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1000 00000100:00100000:1.0:1788872754.750682:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311174144:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:1.0:1788872754.750940:0:24866:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x322:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1788872754.750944:0:24866:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x322:0x0] updating lvb mtime from disk: 0 -> 1788872755 00002000:00010000:1.0:1788872754.750946:0:24866:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x322:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788872754.750948:0:24866:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x322:0x0] updating lvb ctime from disk: 0 -> 1788872755 00002000:00010000:1.0:1788872754.750951:0:24866:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x322:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788872754.751009:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2406:x1875765311174144:12345-192.168.204.39@tcp:10:dd.0 Request processed in 327us (774us total) trans 4294969452 rc 0/0 00000100:00100000:1.0:1788872754.751017:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1000 00002000:00010000:1.0:1788872754.751021:0:24866:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/802 (1048576->18446744073709551615) 00002000:00100000:1.0:1788872754.751023:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9ef3d1f80 with x1875765311174144 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1788872754.751028:0:24866:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98a9ef3d1f80. 00000100:00100000:1.0:1788872754.751048:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1001 00000100:00100000:1.0:1788872754.751054:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2406:x1875765311174272:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:1.0:1788872754.751172:0:24866:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x323:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788872754.751175:0:24866:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x323:0x0] updating lvb mtime from disk: 0 -> 1788872755 00002000:00010000:1.0:1788872754.751177:0:24866:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x323:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788872754.751179:0:24866:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x323:0x0] updating lvb ctime from disk: 0 -> 1788872755 00002000:00010000:1.0:1788872754.751181:0:24866:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x323:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788872754.751218:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2406:x1875765311174272:12345-192.168.204.39@tcp:10:dd.0 Request processed in 150us (908us total) trans 4294969452 rc 0/0 00000100:00100000:1.0:1788872754.751236:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1001 00002000:00010000:1.0:1788872754.751239:0:24866:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/803 (0->18446744073709551615) 00002000:00100000:1.0:1788872754.751242:0:24866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9ef3d2a00 with x1875765311174272 ext(0->18446744073709551615) 00002000:00010000:1.0:1788872754.751247:0:24866:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9ef3d2a00. 00000100:00100000:3.0:1788872754.825825:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872754.825891:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311174528 00000100:00100000:0.0:1788872754.825902:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311174528 00000100:00100000:0.0:1788872754.825984:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 227 00000100:00100000:0.0:1788872754.825994:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+16:69577:x1875765311174528:12345-192.168.204.39@tcp:35:dd.0 00010000:00000080:0.0:1788872754.826253:0:66194:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9c77b3b80 x1875765311174528/t111669149710(0) o35->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 392/456 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872754.826395:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+17:69577:x1875765311174528:12345-192.168.204.39@tcp:35:dd.0 Request processed in 402us (580us total) trans 111669149710 rc 0/0 00000100:00100000:0.0:1788872754.826402:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 227 00000100:00100000:2.0:1788872754.850063:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872754.850146:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311174656 00000100:00100000:3.0:1788872754.850156:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311174656 00000100:00100000:3.0:1788872754.850224:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1234 00000100:00100000:3.0:1788872754.850234:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+17:69578:x1875765311174656:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872754.850258:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872754.850280:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da67f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf8a expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.850342:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440600/0xe4e6e89fb01da686 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.850364:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440600/0xe4e6e89fb01da686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.850375:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440600/0xe4e6e89fb01da686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872754.850415:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872754.850418:0:68674:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872754.850435:0:68674:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440600/0xe4e6e89fb01da686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.850456:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da67f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf8a expref: 19 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.850476:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440600/0xe4e6e89fb01da686 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf8a expref: 18 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.850485:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1dc7700) 00010000:00010000:3.0:1788872754.850488:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872754.850492:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5440600, rc 0) 00010000:00000080:3.0:1788872754.850509:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6c94e00 x1875765311174656/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 576/688 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872754.850868:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+18:69578:x1875765311174656:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 377us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872754.850878:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1234 00000100:00100000:2.0:1788872754.855063:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872754.855167:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311174912 00000100:00100000:0.0:1788872754.855179:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311174912 00000100:00100000:0.0:1788872754.855344:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1235 00000100:00100000:0.0:1788872754.855356:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+18:69578:x1875765311174912:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:0.0:1788872754.855379:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872754.855400:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da68d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf91 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855492:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da694 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855520:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da694 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855533:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da694 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855588:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6c00/0xe4e6e89fb01da69b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855596:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6c00/0xe4e6e89fb01da69b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855603:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6c00/0xe4e6e89fb01da69b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855727:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da694 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855737:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da694 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855743:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da694 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855749:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da694 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855755:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872754.855759:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da694 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855767:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da694 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855780:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1dc7700) 00010000:00010000:0.0:1788872754.855783:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872754.855787:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da694 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855793:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7000/0xe4e6e89fb01da694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855808:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6c00/0xe4e6e89fb01da69b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855814:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6c00/0xe4e6e89fb01da69b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855826:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6c00/0xe4e6e89fb01da69b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855832:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872754.855835:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6c00/0xe4e6e89fb01da69b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855841:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6c00/0xe4e6e89fb01da69b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855850:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a9d1db6900) 00010000:00010000:0.0:1788872754.855852:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872754.855855:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6c00/0xe4e6e89fb01da69b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855861:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6c00/0xe4e6e89fb01da69b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855894:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da68d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf91 expref: 19 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855904:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1dc7700) 00010000:00010000:0.0:1788872754.855906:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788872754.855910:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6400/0xe4e6e89fb01da68d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf91 expref: 19 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.855919:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e6400, rc 0) 00010000:00000080:0.0:1788872754.855926:0:66192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6c94700 x1875765311174912/t0(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 800/608 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872754.856056:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+18:69578:x1875765311174912:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 702us (1002us total) trans 0 rc 301/301 00000100:00100000:0.0:1788872754.856065:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1235 00000100:00100000:3.0:1788872754.859019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872754.859420:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311175040 00000100:00100000:0.0:1788872754.859432:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311175040 00000100:00100000:0.0:1788872754.859489:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1236 00000100:00100000:0.0:1788872754.859507:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+18:69578:x1875765311175040:12345-192.168.204.39@tcp:34:lfs.0 00010000:00010000:0.0:1788872754.859610:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7800/0xe4e6e89fb01da6a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859625:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7800/0xe4e6e89fb01da6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859634:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7800/0xe4e6e89fb01da6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859646:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da6a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859652:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859657:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859739:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da6b0 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859748:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da6b0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859768:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da6b0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872754.859810:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:0.0:1788872754.859815:0:83669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788872754.859828:0:83669:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da6b0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859841:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7800/0xe4e6e89fb01da6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859847:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7800/0xe4e6e89fb01da6a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859854:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7800/0xe4e6e89fb01da6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859860:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872754.859864:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7800/0xe4e6e89fb01da6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859871:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7800/0xe4e6e89fb01da6a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859883:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1dc7700) 00010000:00010000:0.0:1788872754.859886:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872754.859890:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7800/0xe4e6e89fb01da6a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859896:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7800/0xe4e6e89fb01da6a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859920:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859927:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da6a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859933:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859939:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872754.859942:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859948:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da6a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859957:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a9d1db6000) 00010000:00010000:0.0:1788872754.859960:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872754.859963:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da6a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859969:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7c00/0xe4e6e89fb01da6a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859984:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da6b0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.859990:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da6b0 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.860153:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da6b0 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.860164:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872754.860167:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da6b0 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.860173:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da6b0 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.860191:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1db6400) 00010000:00010000:0.0:1788872754.860194:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872754.860197:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da6b0 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872754.860209:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01da6b0 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1788872754.860234:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9c77b1c00 x1875765311175040/t0(0) o34->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 472/728 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872754.860407:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+18:69578:x1875765311175040:12345-192.168.204.39@tcp:34:lfs.0 Request processed in 909us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872754.860417:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1236 00000100:00100000:3.0:1788872754.872916:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327719424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872754.873004:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872754.873123:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327719424 00000100:00100000:1.0:1788872754.873131:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327719424 00000100:00100000:1.0:1788872754.873195:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:1.0:1788872754.873215:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327719424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872754.873249:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872754.873297:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327719424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872754.873305:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:3.0:1788872754.873454:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327719424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872754.873631:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788872754.873640:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327719552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872754.873684:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872754.874017:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327719552 00000100:00100000:1.0:1788872754.874022:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327719552 00000100:00100000:1.0:1788872754.874057:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:1.0:1788872754.874063:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327719552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872754.874080:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872754.874132:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327719552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872754.874138:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000100:00100000:0.0:1788872754.874341:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327719552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872754.906253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872754.906724:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311175296 00000100:00100000:0.0:1788872754.906737:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311175296 00000100:00100000:2.0:1788872754.907381:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1237 00000100:00100000:2.0:1788872754.907397:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+18:69580:x1875765311175296:12345-192.168.204.39@tcp:101:md5sum.0 00010000:00010000:2.0:1788872754.907420:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872754.907442:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01da6b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf98 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907531:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da6be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907578:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da6be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907622:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da6be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907641:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da6c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907649:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907656:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907777:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af400/0xe4e6e89fb01da6cc lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907786:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af400/0xe4e6e89fb01da6cc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907793:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af400/0xe4e6e89fb01da6cc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872754.907804:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00010000:00010000:2.0:1788872754.907893:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da6be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907901:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da6be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907907:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da6be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907913:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da6be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907926:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872754.907932:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da6be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907939:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da6be lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907955:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1dc7700) 00010000:00010000:2.0:1788872754.907958:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872754.907964:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da6be lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907970:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01da6be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907985:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.907990:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da6c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.908403:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da6c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.908408:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872754.908411:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da6c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.908418:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da6c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.908438:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a9cd098700) 00010000:00010000:2.0:1788872754.908441:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872754.908443:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da6c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.908449:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01da6c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.908702:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01da6b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf98 expref: 21 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.908728:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af400/0xe4e6e89fb01da6cc lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf98 expref: 20 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872754.908735:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1db6400) 00010000:00010000:2.0:1788872754.908738:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872754.908741:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58af400, rc 0) 00010000:00000080:2.0:1788872754.908749:0:66979:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9ee81d500 x1875765311175296/t111669149711(0) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 800/872 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872754.908830:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+20:69580:x1875765311175296:12345-192.168.204.39@tcp:101:md5sum.0 Request processed in 1439us (2587us total) trans 111669149711 rc 0/0 00000100:00100000:2.0:1788872754.908840:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1237 00000100:00100000:1.0:1788872754.915041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872754.915127:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311175424 00000100:00100000:2.0:1788872754.915140:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311175424 00002000:00100000:2.0:1788872754.915193:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x322:0x0] (0->32767) req@ffff98a9ee81c000 x1875765311175424/t0(0) o3->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 488/0 e 0 to 0 dl 1788872765 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788872754.915216:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9ee81c000 with x1875765311175424 ext(0->32767) 00002000:00010000:2.0:1788872754.915235:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9ee81c000 00000100:00100000:2.0:1788872754.915283:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1002 00000100:00100000:2.0:1788872754.915295:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2406:x1875765311175424:12345-192.168.204.39@tcp:3:md5sum.0 00000100:00100000:2.0:1788872754.918156:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2406:x1875765311175424:12345-192.168.204.39@tcp:3:md5sum.0 Request processed in 2853us (3114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872754.918170:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1002 00002000:00100000:2.0:1788872754.918193:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x322:0x0] (0->32767) req@ffff98a9ee81c000 x1875765311175424/t0(0) o3->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 488/440 e 0 to 0 dl 1788872765 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788872754.918210:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9ee81c000 with x1875765311175424 ext(0->32767) 00002000:00010000:2.0:1788872754.918216:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9ee81c000 00000100:00100000:1.0:1788872754.928139:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872754.929024:0:24868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311175552 00000100:00100000:2.0:1788872754.929036:0:24868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311175552 00002000:00100000:2.0:1788872754.929094:0:24868:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x322:0x0] (32768->1048575) req@ffff98a9ee81ed80 x1875765311175552/t0(0) o3->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 488/0 e 0 to 0 dl 1788872765 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788872754.929106:0:24868:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9ee81ed80 with x1875765311175552 ext(32768->1048575) 00002000:00010000:2.0:1788872754.929111:0:24868:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9ee81ed80 00000100:00100000:2.0:1788872754.929198:0:24868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1003 00000100:00100000:2.0:1788872754.929320:0:24868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2407:x1875765311175552:12345-192.168.204.39@tcp:3:md5sum.0 00000100:00100000:2.0:1788872754.933494:0:24868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2407:x1875765311175552:12345-192.168.204.39@tcp:3:md5sum.0 Request processed in 4164us (5349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872754.933518:0:24868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1003 00002000:00100000:2.0:1788872754.933533:0:24868:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x322:0x0] (32768->1048575) req@ffff98a9ee81ed80 x1875765311175552/t0(0) o3->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 488/440 e 0 to 0 dl 1788872765 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788872754.933545:0:24868:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9ee81ed80 with x1875765311175552 ext(32768->1048575) 00002000:00010000:2.0:1788872754.933602:0:24868:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9ee81ed80 00000100:00100000:1.0:1788872754.948926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872754.949163:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311175808 00000100:00100000:0.0:1788872754.949174:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311175808 00000100:00100000:0.0:1788872754.949283:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 228 00000100:00100000:0.0:1788872754.949294:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0952450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+20:69580:x1875765311175808:12345-192.168.204.39@tcp:35:md5sum.0 00010000:00000080:0.0:1788872754.949635:0:80566:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f0952450 x1875765311175808/t111669149712(0) o35->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 392/456 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872754.949701:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0952450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+21:69580:x1875765311175808:12345-192.168.204.39@tcp:35:md5sum.0 Request processed in 408us (786us total) trans 111669149712 rc 0/0 00000100:00100000:0.0:1788872754.949710:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 228 00000100:00100000:1.0:1788872754.977824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872754.977920:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311175936 00000100:00100000:3.0:1788872754.977933:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311175936 00000100:00100000:3.0:1788872754.978364:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1238 00000100:00100000:3.0:1788872754.978378:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+21:69582:x1875765311175936:12345-192.168.204.39@tcp:34:lfs.0 00010000:00010000:3.0:1788872754.978458:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440200/0xe4e6e89fb01da6da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978475:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440200/0xe4e6e89fb01da6da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978486:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440200/0xe4e6e89fb01da6da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978514:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da6e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978522:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978529:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978658:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440e00/0xe4e6e89fb01da6e8 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978685:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440e00/0xe4e6e89fb01da6e8 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978692:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440e00/0xe4e6e89fb01da6e8 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872754.978755:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:3.0:1788872754.978760:0:66190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872754.978774:0:66190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440e00/0xe4e6e89fb01da6e8 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978788:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440200/0xe4e6e89fb01da6da lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978794:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440200/0xe4e6e89fb01da6da lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978800:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440200/0xe4e6e89fb01da6da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978807:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440200/0xe4e6e89fb01da6da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978813:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872754.978817:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440200/0xe4e6e89fb01da6da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978824:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440200/0xe4e6e89fb01da6da lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978836:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1dc7700) 00010000:00010000:3.0:1788872754.978845:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872754.978850:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440200/0xe4e6e89fb01da6da lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978857:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440200/0xe4e6e89fb01da6da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978872:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978878:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da6e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978883:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da6e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978888:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872754.978891:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da6e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978898:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da6e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978905:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a9d1dc7d00) 00010000:00010000:3.0:1788872754.978907:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872754.978909:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da6e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978915:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440000/0xe4e6e89fb01da6e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978932:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440e00/0xe4e6e89fb01da6e8 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978944:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440e00/0xe4e6e89fb01da6e8 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978950:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440e00/0xe4e6e89fb01da6e8 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978955:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872754.978958:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440e00/0xe4e6e89fb01da6e8 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978964:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440e00/0xe4e6e89fb01da6e8 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.978972:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1db6400) 00010000:00010000:3.0:1788872754.978974:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872754.978977:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440e00/0xe4e6e89fb01da6e8 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872754.979473:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440e00/0xe4e6e89fb01da6e8 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1788872754.979503:0:66190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9ee81ea00 x1875765311175936/t0(0) o34->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:680/0 lens 472/728 e 0 to 0 dl 1788872765 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872754.979619:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+21:69582:x1875765311175936:12345-192.168.204.39@tcp:34:lfs.0 Request processed in 1244us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872754.979628:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1238 00010000:00010000:3.0:1788872755.514535:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872755.986593:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872755.986657:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872755.987020:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311176192 00000100:00100000:1.0:1788872755.987038:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311176192 00000100:00100000:1.0:1788872755.987105:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5967 00000100:00100000:1.0:1788872755.987116:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311176192:12345-192.168.204.39@tcp:16:kworker.0 00000100:00100000:3.0:1788872755.992689:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311176064 00000100:00100000:3.0:1788872755.992715:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311176064 00002000:00100000:3.0:1788872755.992774:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x322:0x0] (1048576->2097151) req@ffff98a8c6c95c00 x1875765311176064/t0(0) o4->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:681/0 lens 488/0 e 0 to 0 dl 1788872766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872755.992786:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c6c95c00 with x1875765311176064 ext(1048576->2097151) 00002000:00010000:3.0:1788872755.992792:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98a8c6c95c00 00000100:00100000:3.0:1788872755.993219:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1004 00000100:00100000:3.0:1788872755.993231:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2405:x1875765311176064:12345-192.168.204.39@tcp:4:md5sum.0 00000001:00080000:2.0:1788872755.998662:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969452 is committed 00000100:00100000:1.0:1788872756.002032:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2405:x1875765311176192:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 14904us (15361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872756.002049:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5967 00000100:00100000:3.0:1788872756.041973:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2405:x1875765311176064:12345-192.168.204.39@tcp:4:md5sum.0 Request processed in 48733us (55377us total) trans 4294969453 rc 0/0 00000100:00100000:3.0:1788872756.041989:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1004 00002000:00100000:3.0:1788872756.042001:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x322:0x0] (1048576->2097151) req@ffff98a8c6c95c00 x1875765311176064/t4294969453(0) o4->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:681/0 lens 488/448 e 0 to 0 dl 1788872766 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872756.042011:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c6c95c00 with x1875765311176064 ext(1048576->2097151) 00002000:00010000:3.0:1788872756.042017:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98a8c6c95c00 00010000:00010000:2.0:1788872756.544468:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788872756.606363:0:90369:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788872756.606424:0:90369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.606440:0:90369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.606447:0:90369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.606455:0:90369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.606520:0:90369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788872756.606525:0:90369:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788872756.606583:0:90369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788872756.606587:0:90369:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788872756.606592:0:90369:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788872756.606617:0:90369:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0ad800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788872756.608386:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327719680:0@lo:39:umount.0 00000100:00100000:0.0:1788872756.608461:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872756.609388:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327719680 00000100:00100000:3.0:1788872756.609397:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327719680 00000100:00100000:3.0:1788872756.609455:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1788872756.609465:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875765327719680:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788872756.609492:0:83669:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da31b 00000100:00080000:3.0:1788872756.609507:0:83669:0:(import.c:65:import_set_state_nolock()) ffff98a8c6773000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788872756.609702:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872756.609711:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.609722:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa98e800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872756.609726:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.609735:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872756.609743:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872756.609750:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788872756.609753:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788872756.609757:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788872756.609791:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.609797:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872756.609824:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.609831:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e800/0xe4e6e89fb01da1fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da203 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.609861:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872756.609863:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872756.609865:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872756.609911:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327719808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872756.609959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872756.610105:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327719808 00000100:00100000:2.0:1788872756.610109:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327719808 00000100:00100000:2.0:1788872756.610151:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1788872756.610160:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327719808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872756.610171:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872756.610185:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3a00/0xe4e6e89fb01da203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da1fc expref: 24 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.610200:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872756.610237:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3646:x1875765327719808:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872756.610244:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1788872756.610412:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327719808:0@lo:103:ldlm_bl.0 00010000:00000080:3.0:1788872756.610742:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9faa7ad80 x1875765327719680/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:682/0 lens 224/224 e 0 to 0 dl 1788872767 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872756.610790:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1875765327719680:12345-0@lo:39:umount.0 Request processed in 1328us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872756.610798:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000020:00000080:3.0:1788872756.610805:0:83669:0:(genops.c:906:class_export_put()) final put ffff98a8c6775000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788872756.610916:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c6775000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788872756.610967:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c6773000 for lustre-MDT0000 00000100:00080000:0.0:1788872756.611039:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0ad800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788872756.611057:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327719680:0@lo:39:umount.0 00000100:00080000:1.0:1788872756.611107:0:90369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788872756.611117:0:90369:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788872756.611122:0:90369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788872756.612143:0:90369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.612157:0:90369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.612165:0:90369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.612172:0:90369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.612700:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872756.612707:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.612715:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872756.612719:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.612727:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872756.612734:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872756.612755:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788872756.612758:0:14981:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788872756.612790:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.612796:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872756.612824:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.612833:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872756.612834:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872756.612836:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872756.612893:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327719936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872756.612949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872756.613147:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327719936 00000100:00100000:2.0:1788872756.613154:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327719936 00000100:00100000:2.0:1788872756.613204:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:2.0:1788872756.613213:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3647:x1875765327719936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872756.613226:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872756.613240:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98ee00/0xe4e6e89fb01da12a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da123 expref: 23 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.613254:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872756.613395:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3647:x1875765327719936:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872756.613402:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1788872756.613459:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327719936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872756.613565:0:90369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788872756.613572:0:90369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2600/0xe4e6e89fb01da123 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da12a expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.613585:0:90369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.613592:0:90369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.613598:0:90369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.613605:0:90369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.613676:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872756.613692:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.613700:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872756.613703:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.613710:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872756.613716:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872756.613721:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788872756.613723:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788872756.613739:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.613745:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788872756.613783:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327720064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872756.613813:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872756.613889:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327720064 00000100:00100000:2.0:1788872756.613894:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327720064 00000100:00100000:2.0:1788872756.613921:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1788872756.613927:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3644:x1875765327720064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872756.613945:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872756.613955:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98e200/0xe4e6e89fb01da22d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da226 expref: 22 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.613964:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872756.614016:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.614025:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872756.614026:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872756.614028:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872756.614141:0:90369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788872756.614152:0:90369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01da226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da22d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872756.614162:0:90369:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788872756.614190:0:90369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614198:0:90369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614206:0:90369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614212:0:90369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614226:0:90369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872756.614231:0:90369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614239:0:90369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614247:0:90369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614251:0:90369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614263:0:90369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788872756.614270:0:90369:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788872756.614273:0:90369:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788872756.614315:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872756.614320:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614327:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872756.614330:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614338:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872756.614345:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872756.614350:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788872756.614353:0:14981:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788872756.614356:0:14981:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788872756.614369:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614375:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872756.614384:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614391:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da1ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da1f5 expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614399:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872756.614402:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614417:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2c00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872756.614420:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614427:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872756.614433:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872756.614437:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788872756.614439:0:14981:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788872756.614441:0:14981:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788872756.614454:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614460:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872756.614473:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614480:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2c00/0xe4e6e89fb01da107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da11c expref: -99 pid: 89002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872756.614488:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872756.614490:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872756.614491:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788872756.614506:0:90369:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788872756.614510:0:90369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1788872756.614515:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788872756.614520:0:90369:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1788872756.615151:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872756.615164:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327720192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872756.615204:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872756.615255:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327720192 00000100:00100000:3.0:1788872756.615260:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327720192 00000100:00100000:3.0:1788872756.615543:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1788872756.615569:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef216a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3645:x1875765327720192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872756.615581:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872756.615595:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c9c00/0xe4e6e89fb01da1f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da1ee expref: 22 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.615608:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872756.615639:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef216a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3645:x1875765327720192:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872756.615647:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1788872756.615680:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327720192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872756.615712:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327720320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872756.615735:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872756.615766:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327720320 00000100:00100000:3.0:1788872756.615769:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327720320 00000100:00100000:3.0:1788872756.615796:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1788872756.615802:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef217480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3646:x1875765327720320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872756.615810:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872756.615819:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98fc00/0xe4e6e89fb01da11c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da107 expref: 21 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.615829:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872756.615855:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef217480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3646:x1875765327720320:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872756.615861:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1788872756.615888:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327720320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872756.616123:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:3644:x1875765327720064:12345-0@lo:103:ldlm_bl.0 Request processed in 2194us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872756.616131:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00010000:00010000:2.0:1788872756.616161:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872756.617412:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327720064:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1788872756.620234:0:90369:0:(mdt_handler.c:8248:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:0.0:1788872756.620856:0:89003:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149712 is committed 00000020:00000080:1.0:1788872756.620966:0:90369:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1788872756.620973:0:90369:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9c9892800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872756.620980:0:90369:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9f0837800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1788872756.621087:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da64e lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.621098:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da64e lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.621106:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da64e lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.621112:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872756.621117:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da64e lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.621124:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da64e lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.621141:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1db6400) 00010000:00010000:2.0:1788872756.621144:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872756.621148:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da64e lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.621155:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01da64e lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788872756.621208:0:90369:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9f0834000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872756.621212:0:90369:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a8c5116800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872756.621219:0:90369:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a8c5113000 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 192.168.204.39@tcp 12 (0 0 7) 0 0 0 0: 0000000000000000 111669149712 stale:0 00000020:00080000:1.0:1788872756.621225:0:90369:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff98a9efa7b380) has exports, disconnecting them 00000020:00080000:1.0:1788872756.621229:0:90369:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9c9892800), last request at 1788872718 00000020:00000080:1.0:1788872756.621235:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da314 00000100:00080000:1.0:1788872756.621241:0:90369:0:(import.c:65:import_set_state_nolock()) ffff98a9c8f4a000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788872756.621538:0:90369:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9c9892800): rc 0 00000020:00000080:1.0:1788872756.621541:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9c9892800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788872756.621576:0:90369:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9f0837800), last request at 1788872754 00000020:00000080:1.0:1788872756.621580:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da30d 00000100:00080000:1.0:1788872756.621591:0:90369:0:(import.c:65:import_set_state_nolock()) ffff98a9f0833000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788872756.621631:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c9892800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788872756.621677:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c8f4a000 for lustre-MDT0000 00010000:00010000:3.0:1788872756.622221:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788872756.622371:0:90369:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9f0837800): rc 0 00000020:00000080:1.0:1788872756.622374:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9f0837800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788872756.622391:0:90369:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9f0834000), last request at 1788872754 00000020:00000080:1.0:1788872756.622395:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da306 00000100:00080000:1.0:1788872756.622402:0:90369:0:(import.c:65:import_set_state_nolock()) ffff98a9f0833800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788872756.622427:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f0837800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788872756.622474:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9f0833000 for lustre-MDT0000 00010000:00010000:2.0:1788872756.622530:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788872756.622757:0:90369:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9f0834000): rc 0 00000020:00000080:1.0:1788872756.622760:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9f0834000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788872756.622765:0:90369:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a8c5116800), last request at 1788872713 00000020:00000080:1.0:1788872756.622773:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da170 00000100:00080000:1.0:1788872756.622783:0:90369:0:(import.c:65:import_set_state_nolock()) ffff98a9f0834800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788872756.622818:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f0834000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788872756.622851:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9f0833800 for lustre-MDT0000 00010000:00010000:3.0:1788872756.622897:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788872756.622971:0:90369:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a8c5116800): rc 0 00000020:00000080:1.0:1788872756.622973:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a8c5116800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:1.0:1788872756.623064:0:90369:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.39@tcp (ffff98a8c5113000), last request at 1788872754 00000020:00000080:1.0:1788872756.623068:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da169 00000020:00010000:1.0:1788872756.623075:0:90369:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a8c5113000: total 1 00000100:00080000:1.0:1788872756.623079:0:90369:0:(import.c:65:import_set_state_nolock()) ffff98a9ff60e800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788872756.623118:0:20230:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a8c5113000: total 1 00010000:00010000:2.0:1788872756.623184:0:20230:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a8c5113000, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1788872756.623222:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01da54b lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf13 expref: 11 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.623245:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afe00/0xe4e6e89fb01da559 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf21 expref: 10 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.623258:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6a00/0xe4e6e89fb01da647 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf60 expref: 9 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.623269:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01da663 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf6e expref: 8 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.623472:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5440600/0xe4e6e89fb01da686 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf8a expref: 7 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.623502:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441e00/0xe4e6e89fb01da552 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf1a expref: 6 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.623528:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af400/0xe4e6e89fb01da6cc lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf98 expref: 5 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872756.623544:0:20230:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a8c5113000, canceled 7 locks, left on hash table 0. 00000020:00000080:3.0:1788872756.625735:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c5116800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00080000:1.0:1788872756.627785:0:90369:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a8c5113000): rc 0 00000004:00000080:1.0:1788872756.627799:0:90369:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb002c1c6fae0 00000100:00080000:1.0:1788872756.627826:0:90369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788872756.627831:0:90369:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788872756.628972:0:90369:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788872756.629831:0:90369:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe95000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788872756.630013:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327720448:0@lo:39:umount.0 00000100:00100000:0.0:1788872756.630097:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872756.630166:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327720448 00000100:00100000:0.0:1788872756.630173:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327720448 00000100:00100000:0.0:1788872756.630217:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:0.0:1788872756.630225:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327720448:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788872756.630251:0:8446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da1a1 00000100:00080000:0.0:1788872756.630259:0:8446:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788872756.630482:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411437 00000100:00100000:0.0:1788872756.630896:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3643:x1875765327720448:12345-0@lo:39:umount.0 Request processed in 670us (798us total) trans 77309411438 rc 0/0 00000100:00100000:0.0:1788872756.630905:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00010000:00010000:0.0:1788872756.630932:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788872756.633044:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe95000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788872756.633058:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327720448:0@lo:39:umount.0 00000100:00080000:1.0:1788872756.633133:0:90369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788872756.633137:0:90369:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:1.0:1788872756.633149:0:90369:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00080000:1.0:1788872756.633219:0:90369:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788872756.633243:0:90369:0:(import.c:65:import_set_state_nolock()) ffff98a9ef253800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788872756.633257:0:90369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788872756.633259:0:90369:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:1.0:1788872756.633267:0:90369:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872756.633528:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327720576:0@lo:9:umount.0 00000100:00100000:1.0:1788872756.633894:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788872756.633961:0:90369:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788872756.633979:0:90369:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a9000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788872756.634004:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327720704:0@lo:9:umount.0 00000100:00100000:1.0:1788872756.634049:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788872756.634135:0:90369:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98a9efa7b380) has no exports 00000100:00100000:0.0:1788872756.634212:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327720576 00000100:00100000:0.0:1788872756.634220:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327720576 00000100:00100000:0.0:1788872756.634707:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327720704 00000100:00100000:0.0:1788872756.634712:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327720704 00000100:00100000:0.0:1788872756.634742:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5968 00000100:00100000:0.0:1788872756.634751:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327720576:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788872756.634775:0:26189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da1cb 00000100:00080000:0.0:1788872756.634783:0:26189:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788872756.634823:0:26189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:0.0:1788872756.634962:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+2:3643:x1875765327720576:12345-0@lo:9:umount.0 Request processed in 212us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872756.634970:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5968 00000100:00100000:0.0:1788872756.634984:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5969 00000100:00100000:0.0:1788872756.634990:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327720704:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788872756.635010:0:26189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da1d9 00000100:00080000:0.0:1788872756.635016:0:26189:0:(import.c:65:import_set_state_nolock()) ffff98a9ef979800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788872756.635038:0:26189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:0.0:1788872756.635112:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+2:3643:x1875765327720704:12345-0@lo:9:umount.0 Request processed in 122us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872756.635118:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5969 00010000:00010000:0.0:1788872756.635135:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788872756.635158:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a9000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788872756.635169:0:3643:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:0.0:1788872756.635171:0:3643:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:0.0:1788872756.635174:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327720704:0@lo:9:umount.0 00000100:00080000:0.0:1788872756.635186:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ef253800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788872756.635194:0:3643:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:0.0:1788872756.635196:0:3643:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:0.0:1788872756.635198:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327720576:0@lo:9:umount.0 00000020:00000080:3.0:1788872756.635624:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9f0834800 for lustre-MDT0000 00010000:00010000:3.0:1788872756.635729:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872756.635735:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788872756.636390:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872756.636396:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1788872756.641590:0:90369:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98a9efa7b380) has no exports 00000020:00000080:2.0:1788872756.687451:0:20230:0:(genops.c:906:class_export_put()) final put ffff98a8c5113000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00010000:00010000:2.0:1788872756.687485:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872756.687506:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872756.687509:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788872756.689566:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c5113000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-MDT0000 00000020:00000080:3.0:1788872756.689669:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ff60e800 for lustre-MDT0000 00000020:00000080:0.0:1788872756.750712:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da185 00000020:00000080:0.0:1788872756.750729:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9f6655000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788872756.750749:0:90369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788872756.750883:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f6655000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788872756.750977:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872756.750996:0:90369:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788872756.751001:0:90369:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98a8c72ecd40) has no exports 00000020:00000080:1.0:1788872756.751325:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da17e 00000020:00000080:1.0:1788872756.751333:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9dfe92000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788872756.751390:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872756.751399:0:90369:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788872756.751401:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9dfe97000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788872756.751403:0:90369:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9dfe97000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788872756.751410:0:90369:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788872756.751770:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9dfe92000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788872756.751842:0:90369:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a8c65b7120 - data ffff98a9e9143ca8/ffff98aa002cfc00 00000020:01000000:1.0:1788872756.751997:0:90369:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9f54e08a0 - data ffff98a9e9142360/ffff98a9d0048400 00000100:00080000:3.0:1788872756.856309:0:90369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788872756.856319:0:90369:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788872756.856335:0:90369:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98a9ee81ca80 x1875765327720448/t77309411438(77309411438) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872766 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872756.856363:0:90369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788872756.863477:0:90369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788872756.863486:0:90369:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:3.0:1788872756.871423:0:90369:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872756.871431:0:90369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788872756.872000:0:89020:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788872756.872006:0:89020:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:3.0:1788872756.872021:0:89020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:1.0:1788872756.872774:0:90369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788872756.872780:0:90369:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:1.0:1788872756.872795:0:90369:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872756.872797:0:90369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788872756.873350:0:89022:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788872756.873355:0:89022:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:3.0:1788872756.873364:0:89022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:1.0:1788872756.874324:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da13f 00000020:00000080:1.0:1788872756.874334:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9e99ad800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788872756.874766:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ad800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788872756.875205:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da154 00000020:00000080:1.0:1788872756.875214:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a8c6799800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788872756.875737:0:90369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788872756.875743:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872756.875755:0:90369:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788872756.875760:0:90369:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff98a9efa78000) has no exports 00000004:01000000:1.0:1788872756.875953:0:90369:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788872756.875964:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da1d2 00000020:00000080:1.0:1788872756.875968:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9df96f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872756.882579:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c6799800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788872756.887748:0:90369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788872756.887783:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872756.887800:0:90369:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788872756.887805:0:90369:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff98a8c3408000) has no exports 00000020:00000080:1.0:1788872756.887815:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da1c4 00000020:00000080:1.0:1788872756.887826:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9e99a8800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788872756.888277:0:90369:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788872756.888282:0:90369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788872756.888286:0:90369:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:1.0:1788872756.888293:0:90369:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872756.888295:0:90369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788872756.888331:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872756.888340:0:90369:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872756.888347:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da1b6 00000020:00000080:1.0:1788872756.888351:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a8c6798800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788872756.888355:0:90369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788872756.888358:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872756.888363:0:90369:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788872756.888365:0:90369:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff98a8c340b380) has no exports 00000020:00000080:1.0:1788872756.888369:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da1af 00000020:00000080:1.0:1788872756.888372:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9c45ca800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788872756.888718:0:90369:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788872756.888721:0:90369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788872756.888723:0:90369:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:1.0:1788872756.888726:0:90369:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872756.888728:0:90369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788872756.888750:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872756.888756:0:90369:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788872756.888768:0:90369:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788872756.888775:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da19a 00000020:00000080:1.0:1788872756.888781:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9df8c9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788872756.888785:0:90369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788872756.888788:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872756.888802:0:90369:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788872756.888804:0:90369:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff98a9fa7919c0) has no exports 00000020:00000080:1.0:1788872756.888808:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da193 00000020:00000080:1.0:1788872756.888811:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9ff60d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788872756.889754:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9df96f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788872756.889767:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788872756.889773:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e99a9000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788872756.889781:0:86506:0:(genops.c:906:class_export_put()) final put ffff98a8c679f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872756.889784:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c679f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788872756.889790:0:86506:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872756.889875:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c6798800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788872756.889889:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c45ca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788872756.889892:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ef253800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788872756.889896:0:86506:0:(genops.c:906:class_export_put()) final put ffff98a9df8c8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872756.889898:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9df8c8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788872756.889902:0:86506:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872756.889931:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9df8c9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788872756.889936:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff60d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788872756.889965:0:90369:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788872756.889970:0:90369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788872756.889975:0:90369:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788872756.889980:0:90369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788872756.890038:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872756.890049:0:90369:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872756.890076:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872756.890080:0:90369:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872756.890083:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9e99ab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872756.890085:0:90369:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788872756.890090:0:90369:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872756.890143:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da15b 00000020:00000080:0.0:1788872756.890150:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a8c679f000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788872756.890154:0:90369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788872756.890157:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788872756.890162:0:90369:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788872756.890165:0:90369:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff98a9efa799c0) has no exports 00000020:00000080:0.0:1788872756.890188:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872756.890192:0:90369:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788872756.890197:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da162 00000020:00000080:0.0:1788872756.890201:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a8c679a800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788872756.890208:0:90369:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a8c37f5000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788872756.890219:0:90369:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a8c37f5000 3 00000020:01000004:0.0:1788872756.890223:0:90369:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a8c37f5000 from lustre-MDT0000 00000020:00000080:0.0:1788872756.890239:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872756.890243:0:90369:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788872756.890246:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9e99ae000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788872756.890248:0:90369:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ae000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788872756.890260:0:90369:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788872756.890292:0:90369:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788872756.890296:0:90369:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788872756.890299:0:90369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788872756.890302:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788872756.890305:0:90369:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788872756.890317:0:90369:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98a9ff63d000 8a09bb38-f574-4ce9-b65f-ec6facc58f7e 192.168.204.39@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788872756.890323:0:90369:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98a9c9cac800 f2e885a0-f180-4b85-9f87-6a01e20afd1a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788872756.890328:0:90369:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff98a9fa794d40) has exports, disconnecting them 00000020:00080000:0.0:1788872756.890332:0:90369:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.39@tcp (ffff98a9ff63d000), last request at 1788872713 00000020:00000080:0.0:1788872756.890353:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da21f 00000020:00010000:0.0:1788872756.890358:0:90369:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9ff63d000: total 2 00000100:00080000:0.0:1788872756.890361:0:90369:0:(import.c:65:import_set_state_nolock()) ffff98a9ff63c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788872756.890372:0:90369:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a9ff63d000): rc 0 00000020:00080000:0.0:1788872756.890375:0:90369:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98a9c9cac800), last request at 1788872712 00000020:00010000:0.0:1788872756.890416:0:14981:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9ff63d000: total 2 00010000:00010000:0.0:1788872756.890440:0:14981:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9ff63d000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788872756.890472:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01da2ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faefe expref: 5 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872756.890490:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c8000/0xe4e6e89fb01da2f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faef0 expref: 4 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872756.890503:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52aec00/0xe4e6e89fb01da2ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faee9 expref: 3 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872756.890522:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01da2f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faef7 expref: 2 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872756.890531:0:14981:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9ff63d000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788872756.890579:0:14981:0:(genops.c:906:class_export_put()) final put ffff98a9ff63d000/8a09bb38-f574-4ce9-b65f-ec6facc58f7e 00010000:00010000:0.0:1788872756.890585:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872756.890587:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872756.890589:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788872756.890601:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da0f9 00000020:00010000:0.0:1788872756.890605:0:90369:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9c9cac800: total 3 00000100:00080000:0.0:1788872756.890607:0:90369:0:(import.c:65:import_set_state_nolock()) ffff98a9ff609800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788872756.890616:0:90369:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9c9cac800): rc 0 00000020:00080000:0.0:1788872756.890620:0:90369:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff98a9fa794d40) has no exports 00000100:00100000:0.0:1788872756.890699:0:89008:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98a9c8a76c00:89008] 0 exiting: rc = 1 00000100:00100000:0.0:1788872756.890801:0:89010:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98a9ca6c3400:89010] 2 exiting: rc = 0 00000020:00000080:3.0:1788872756.890899:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9dfe95000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788872756.890905:0:86506:0:(genops.c:906:class_export_put()) final put ffff98a9e99ac000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872756.890908:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ac000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788872756.890917:0:86506:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872756.890975:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c679f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788872756.890984:0:86506:0:(genops.c:906:class_export_put()) final put ffff98a9e99ab800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788872756.890987:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ab800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788872756.890990:0:86506:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788872756.891015:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c679a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788872756.891019:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff63d000/8a09bb38-f574-4ce9-b65f-ec6facc58f7e for MGS 00000020:00000080:3.0:1788872756.891048:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ff63c800 for MGS 00000020:00010000:3.0:1788872756.891057:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9c9cac800: total 0 00010000:00010000:3.0:1788872756.891075:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9c9cac800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788872756.891096:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98ec00/0xe4e6e89fb01da29d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da296 expref: 14 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891110:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da2ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da2a4 expref: 13 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891120:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01da23b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da234 expref: 12 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891130:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98ea00/0xe4e6e89fb01da249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da242 expref: 11 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891142:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c9000/0xe4e6e89fb01da2c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da2c0 expref: 10 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891152:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98e000/0xe4e6e89fb01da257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da250 expref: 9 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891162:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52af000/0xe4e6e89fb01da2b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da2b2 expref: 8 pid: 89010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891172:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3600/0xe4e6e89fb01da273 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da26c expref: 7 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891201:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98f200/0xe4e6e89fb01da2d5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da2ce expref: 6 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891212:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa98e600/0xe4e6e89fb01da265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da25e expref: 5 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891224:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d2200/0xe4e6e89fb01da2e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da2dc expref: 4 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891234:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3000/0xe4e6e89fb01da281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da27a expref: 3 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891243:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c8400/0xe4e6e89fb01da28f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da288 expref: 2 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872756.891252:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9c9cac800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788872756.891265:0:6509:0:(genops.c:906:class_export_put()) final put ffff98a9c9cac800/f2e885a0-f180-4b85-9f87-6a01e20afd1a 00010000:00010000:3.0:1788872756.891274:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872756.891275:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872756.891277:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788872756.891282:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c9cac800/f2e885a0-f180-4b85-9f87-6a01e20afd1a for MGS 00000020:00000080:3.0:1788872756.891295:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ff609800 for MGS 00000100:00100000:2.0:1788872756.891427:0:89009:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98a9ca6c3000:89009] 1 exiting: rc = 0 00000100:00100000:0.0:1788872756.891852:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891860:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891867:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891874:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891880:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891886:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891892:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891899:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891905:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891911:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891916:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891922:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891928:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891934:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891940:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891957:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891964:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891973:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891979:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891985:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891991:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.891997:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892003:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892008:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892014:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892020:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892026:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892032:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892038:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892045:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892051:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892057:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892063:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892069:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892076:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892082:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892087:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892093:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892099:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892105:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892110:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892117:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892122:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892128:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892133:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892139:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892146:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892152:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892158:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892165:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892177:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892183:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892189:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892195:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892201:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892206:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892212:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892218:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892224:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892229:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892235:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892240:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892245:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788872756.892251:0:90369:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788872756.903892:0:90369:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9c5d23900 - data ffff98a9c6e05288/ffff98a9f67cd000 00000020:01000000:0.0:1788872756.904102:0:90369:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a8c1e74840 - data ffff98a9c6f97870/ffff98a9f85d3000 00000020:00000080:0.0:1788872756.904601:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da0f2 00000020:00000080:0.0:1788872756.904613:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a8c37f1000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788872756.904631:0:90369:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a8c37f5000 from MGS, refs=2 00000020:01000004:0.0:1788872756.904635:0:90369:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a8c37f5000 2 00000020:01000004:0.0:1788872756.904638:0:90369:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a8c37f5000 from MGS 00000020:00000080:0.0:1788872756.904661:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872756.904669:0:90369:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788872756.904671:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9ef0a8800/MGS 00000020:00000080:0.0:1788872756.904674:0:90369:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef0a8800/MGS for MGS 00000020:01000000:0.0:1788872756.904691:0:90369:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788872756.904788:0:90369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788872756.904793:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788872756.904805:0:90369:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788872756.904813:0:90369:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98a9cb5ed800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788872756.904819:0:90369:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff98a9f6710000) has exports, disconnecting them 00000020:00080000:0.0:1788872756.904825:0:90369:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98a9cb5ed800), last request at 1788872713 00000020:00000080:0.0:1788872756.904829:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da211 00000020:00080000:0.0:1788872756.904861:0:90369:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9cb5ed800): rc 0 00000020:00000080:0.0:1788872756.904866:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9cb5ed800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788872756.905531:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c37f1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788872756.905543:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb5ed800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000100:00100000:3.0:1788872756.935021:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327720832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872756.935110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872756.938407:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327720960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872756.938506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872756.938611:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327720832 00000100:00100000:3.0:1788872756.938619:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327720832 00000100:00100000:3.0:1788872756.938688:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327720960 00000100:00100000:3.0:1788872756.938692:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327720960 00000100:00100000:3.0:1788872756.938716:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1788872756.938726:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327720832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872756.938763:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872756.938808:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327720832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (3699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872756.938816:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1788872756.938832:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:3.0:1788872756.938837:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327720960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872756.938847:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17088320 pending 1073152 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872756.938874:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327720960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872756.938880:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:3.0:1788872756.938928:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327720832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872756.938963:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327720960:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788872756.998802:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872756.998817:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:01000000:3.0:1788872757.050518:0:90369:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788872757.050529:0:90369:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788872757.050533:0:90369:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788872757.050541:0:90369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788872757.050591:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ef0ad800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788872757.050753:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872757.050771:0:90369:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788872757.050790:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9ef251000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788872757.050794:0:90369:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef251000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788872757.050807:0:90369:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788872757.050914:0:90369:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a8c37f5000 1 00000020:00000080:3.0:1788872757.050922:0:90369:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da0e4 00000020:00000080:3.0:1788872757.050929:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a9ef0ab800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788872757.050938:0:90369:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788872757.050946:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef0ab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788872757.050956:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872757.050961:0:90369:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788872757.050966:0:90369:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff98a8c72e8000) has no exports 00000020:00000080:3.0:1788872757.211430:0:90369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872757.211445:0:90369:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788872757.211450:0:90369:0:(genops.c:906:class_export_put()) final put ffff98a8c37f2000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788872757.211455:0:90369:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c37f2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788872757.211467:0:90369:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788872757.211749:0:90369:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98a8c37f7000 00000020:02000400:3.0:1788872757.211824:0:90369:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788872757.562983:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872758.585086:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872759.480997:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872759.481393:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327721344:0@lo:400:kworker.0 00000100:00100000:2.0:1788872759.481470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872759.481508:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872759.481513:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327721216:0@lo:400:kworker.0 00000400:00000100:2.0:1788872759.481531:0:3647:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327721216 offset 0 length 224: 4 00000100:00100000:3.0:1788872759.482212:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327721344 00000100:00100000:3.0:1788872759.482222:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327721344 00000100:00100000:3.0:1788872759.482272:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1788872759.482280:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875765327721344:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788872759.482288:0:68674:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788872759.482339:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875765327721344:12345-0@lo:400:kworker.0 Request processed in 59us (868us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788872759.482346:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00080000:3.0:1788872759.482383:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788872759.482389:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788872759.482392:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788872759.482409:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872759.482413:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3655 00000100:00080000:3.0:1788872759.482420:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872759.482442:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef215f80 x1875765327721600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872759.482462:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327721344:0@lo:400:kworker.0 00000100:00100000:3.0:1788872759.482496:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327721600:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788872759.482520:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872759.482570:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327721600 00000100:00100000:3.0:1788872759.482573:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327721600 00000100:00100000:3.0:1788872759.482592:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1788872759.482596:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327721600:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788872759.482615:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872759.482654:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327721600:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 56us (133us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872759.482660:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00080000:3.0:1788872759.482682:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872759.482686:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872759.482689:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327721600:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788872759.485440:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327721472:0@lo:400:kworker.0 00000100:00100000:1.0:1788872759.485526:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872759.485686:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327721088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872759.485717:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872759.487445:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327721088 00000100:00100000:3.0:1788872759.487464:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327721088 00000100:00100000:3.0:1788872759.487578:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:3.0:1788872759.487588:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1875765327721088:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788872759.487599:0:23717:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788872759.487720:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1875765327721088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (2001us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788872759.487728:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00000100:00100000:1.0:1788872759.488119:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327722112:0@lo:400:kworker.0 00000100:00100000:1.0:1788872759.488166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02020000:1.0:1788872759.488467:0:3644:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788872759.488472:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788872759.488477:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788872759.488481:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788872759.488487:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872759.488491:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3655 00000100:00080000:1.0:1788872759.488499:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872759.488522:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ee81d180 x1875765327722368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872759.488576:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788872759.488582:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327721728:0@lo:400:kworker.0 00000100:00100000:1.0:1788872759.488610:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872759.488661:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327721856:0@lo:400:kworker.0 00000100:00100000:3.0:1788872759.488700:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f660bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327721984:0@lo:400:kworker.0 00000100:00100000:3.0:1788872759.488721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872759.488756:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327722112 00000100:00100000:3.0:1788872759.488761:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327722112 00000100:00100000:3.0:1788872759.488805:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327721984 00000100:00100000:3.0:1788872759.488808:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327721984 00000100:00100000:3.0:1788872759.488828:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:3.0:1788872759.488834:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327722112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872759.488873:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327722112:12345-0@lo:400:kworker.0 Request processed in 40us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872759.488878:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:3.0:1788872759.488890:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:3.0:1788872759.488894:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327721984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872759.488929:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327721984:12345-0@lo:400:kworker.0 Request processed in 34us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872759.488934:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:3.0:1788872759.488969:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f660bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327721984:0@lo:400:kworker.0 00000100:00100000:3.0:1788872759.489017:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327722368:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788872759.489040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872759.489065:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327722368 00000100:00100000:3.0:1788872759.489068:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327722368 00000100:00100000:3.0:1788872759.489084:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:3.0:1788872759.489097:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327722368:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788872759.489126:0:8446:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872759.489158:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327722368:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 60us (116us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872759.489164:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00000100:00080000:3.0:1788872759.489188:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872759.489192:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872759.489195:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327722368:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788872759.490679:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872759.490692:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872759.494696:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327722240:0@lo:400:kworker.0 00000100:00100000:1.0:1788872759.494794:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872759.494964:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327721472 00000100:00100000:2.0:1788872759.494974:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327721472 00000100:00100000:2.0:1788872759.499052:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327721728 00000100:00100000:2.0:1788872759.499067:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327721728 00000100:00100000:2.0:1788872759.499094:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:2.0:1788872759.499109:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327721472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872759.499216:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327721472:12345-0@lo:400:kworker.0 Request processed in 113us (13690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872759.499223:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:2.0:1788872759.499241:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1788872759.499245:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875765327721728:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788872759.499251:0:66193:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788872759.499277:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875765327721728:12345-0@lo:400:kworker.0 Request processed in 31us (10666us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788872759.499282:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00080000:0.0:1788872759.504680:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872759.505931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872759.506091:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327722112:0@lo:400:kworker.0 00000100:00100000:1.0:1788872759.506130:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327721472:0@lo:400:kworker.0 00000100:00080000:1.0:1788872759.506176:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788872759.506181:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788872759.506185:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788872759.506191:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872759.506195:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3655 00000100:00080000:1.0:1788872759.506204:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872759.506238:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ee81c380 x1875765327722496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872759.506271:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327721728:0@lo:400:kworker.0 00000100:00100000:0.0:1788872759.506408:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327722496:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788872759.506466:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872759.506583:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327722240 00000100:00100000:2.0:1788872759.506604:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327722240 00000100:00100000:2.0:1788872759.506652:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327721856 00000100:00100000:2.0:1788872759.506655:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327721856 00000100:00100000:2.0:1788872759.506689:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327722496 00000100:00100000:2.0:1788872759.506691:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327722496 00000100:00100000:2.0:1788872759.506703:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1788872759.506712:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f660a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327721856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872759.506769:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f660a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327721856:12345-0@lo:400:kworker.0 Request processed in 58us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872759.506777:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1788872759.506793:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:2.0:1788872759.506796:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875765327722240:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788872759.506802:0:66190:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788872759.506827:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875765327722240:12345-0@lo:400:kworker.0 Request processed in 29us (12034us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788872759.506833:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:2.0:1788872759.506843:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:2.0:1788872759.506847:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f660b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327722496:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788872759.506864:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872759.506888:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f660b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327722496:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (422us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872759.506894:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00080000:0.0:1788872759.507002:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872759.507090:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327721856:0@lo:400:kworker.0 00000100:00080000:0.0:1788872759.512414:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872759.512427:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872759.512431:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327722496:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788872759.512602:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788872759.512608:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788872759.512612:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788872759.512617:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872759.512623:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3655 00000100:00080000:1.0:1788872759.512639:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872759.512679:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ee81df80 x1875765327722624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872759.512748:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327722624:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788872759.512813:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872759.512928:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327722240:0@lo:400:kworker.0 00000100:00100000:2.0:1788872759.519499:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327722624 00000100:00100000:2.0:1788872759.519517:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327722624 00000100:00100000:2.0:1788872759.519708:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1788872759.519717:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327722624:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788872759.519757:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872759.526758:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327722624:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 7027us (13930us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872759.526775:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00080000:0.0:1788872759.527198:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872759.527206:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872759.527210:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327722624:0@lo:38:ptlrpcd_00_00.0 00000400:00000100:2.0:1788872759.570231:0:3639:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311176320 offset 0 length 224: 4 00000100:00100000:2.0:1788872759.570288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872759.570334:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872759.570359:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872759.570406:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872759.570453:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311176832 00000100:00100000:2.0:1788872759.570463:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311176832 00000100:00100000:2.0:1788872759.570531:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311176704 00000100:00100000:2.0:1788872759.570534:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311176704 00000100:00100000:2.0:1788872759.570598:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2585 00000100:00100000:2.0:1788872759.570611:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2405:x1875765311176832:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872759.570715:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2405:x1875765311176832:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 105us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872759.570723:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2585 00000100:00100000:2.0:1788872759.570743:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2586 00000100:00100000:2.0:1788872759.570749:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2405:x1875765311176704:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872759.570773:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2405:x1875765311176704:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 24us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872759.570779:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2586 00000100:00080000:2.0:1788872759.570903:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872759.570908:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872759.571158:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311176576 00000100:00100000:1.0:1788872759.571169:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311176576 00000100:00100000:1.0:1788872759.571229:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311176448 00000100:00100000:1.0:1788872759.571233:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311176448 00000100:00100000:1.0:1788872759.571250:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1271 00000100:00100000:1.0:1788872759.571257:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311176576:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872759.571296:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311176576:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 40us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872759.571302:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1271 00000100:00100000:1.0:1788872759.571316:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1246 00000100:00100000:1.0:1788872759.571320:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2405:x1875765311176448:12345-192.168.204.39@tcp:400:kworker.0 00000020:00080000:1.0:1788872759.571326:0:66192:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.39@tcp 00000100:00100000:1.0:1788872759.571347:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2405:x1875765311176448:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 26us (988us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788872759.571353:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1246 00000100:00080000:2.0:1788872759.571598:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788872759.608808:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872759.622307:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872759.623171:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311176960 00000100:00100000:3.0:1788872759.623187:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311176960 00000100:00100000:3.0:1788872759.623247:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1247 00000100:00100000:3.0:1788872759.623257:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311176960:12345-192.168.204.39@tcp:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788872759.623288:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872759.623380:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311176960:12345-192.168.204.39@tcp:38:ptlrpcd_00_01.0 Request processed in 123us (1087us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872759.623389:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1247 00010000:00010000:3.0:1788872760.632916:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788872761.024749:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872761.024758:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a8c1f5c000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788872761.024838:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969452 is committed 00000020:00000080:1.0:1788872761.027339:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c1f5c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788872761.027416:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c1f5a000 for lustre-OST0000 00010000:00010000:3.0:1788872761.659624:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872762.041404:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788872762.041427:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327722752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872762.041504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872762.041589:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327722752 00000100:00100000:3.0:1788872762.041616:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327722752 00000100:00100000:3.0:1788872762.041683:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:3.0:1788872762.041693:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef214e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327722752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872762.041727:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17088320 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872762.041775:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef214e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327722752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872762.041781:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00100000:3.0:1788872762.041830:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327722752:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788872762.041954:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872762.041963:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872762.041971:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327722880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872762.042002:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872762.042030:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327722880 00000100:00100000:2.0:1788872762.042033:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327722880 00000100:00100000:2.0:1788872762.042061:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:2.0:1788872762.042067:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327722880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872762.042083:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872762.042124:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327722880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872762.042131:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00080000:2.0:1788872762.042158:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872762.042178:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327722880:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1788872762.045153:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872762.045162:0:9516:0:(genops.c:906:class_export_put()) final put ffff98a9ef236800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788872762.045197:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969453 is committed 00000020:00000080:0.0:1788872762.045240:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef236800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788872762.045298:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ef979800 for lustre-OST0001 00010000:00010000:2.0:1788872762.680921:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788872763.066706:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788872763.066730:0:75620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411438 is committed 00000020:00000080:3.0:1788872763.066736:0:75620:0:(genops.c:906:class_export_put()) final put ffff98a9e98d6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872763.067179:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e98d6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788872763.067275:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e98d5000 for lustre-MDT0001 00010000:00010000:0.0:1788872763.707490:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788872764.602614:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872764.602622:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872764.602625:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872764.602633:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3696 00000100:00080000:0.0:1788872764.602639:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788872764.602646:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872764.602676:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327723008:0@lo:400:kworker.0 00000100:00100000:0.0:1788872764.602683:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f6608700 x1875765327723136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872764.602711:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872764.602715:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872764.602717:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872764.602721:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3696 00000100:00080000:0.0:1788872764.602724:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1788872764.602725:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327723264:0@lo:400:kworker.0 00000100:00080000:0.0:1788872764.602727:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000400:00000100:3.0:1788872764.602736:0:3644:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327723008 offset 0 length 224: 4 00000100:00100000:0.0:1788872764.602740:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f6609c00 x1875765327723392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872764.602766:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872764.602770:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872764.602772:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788872764.602775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788872764.602775:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3696 00000100:00080000:0.0:1788872764.602778:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788872764.602782:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872764.602846:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327723264 00000100:00100000:1.0:1788872764.602855:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327723264 00000100:00100000:1.0:1788872764.602911:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1788872764.602921:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327723264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872764.603153:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327723520:0@lo:400:kworker.0 00000100:00100000:0.0:1788872764.603183:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872764.603208:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327723264:12345-0@lo:400:kworker.0 Request processed in 289us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872764.603226:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:2.0:1788872764.614094:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327723264:0@lo:400:kworker.0 00000100:00100000:1.0:1788872764.618590:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327723520 00000100:00100000:1.0:1788872764.618606:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327723520 00000100:00100000:3.0:1788872764.618738:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1788872764.618751:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f660b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327723520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872764.618866:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f660b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327723520:12345-0@lo:400:kworker.0 Request processed in 118us (15680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872764.618875:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1788872764.619040:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327723136:0@lo:38:kworker.0 00000100:00100000:3.0:1788872764.619083:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872764.619103:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327723392:0@lo:38:kworker.0 00000100:00100000:3.0:1788872764.619126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872764.619146:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327723136 00000100:00100000:3.0:1788872764.619150:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327723136 00000100:00100000:3.0:1788872764.619172:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327723392 00000100:00100000:3.0:1788872764.619190:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327723392 00000100:00100000:3.0:1788872764.619208:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1788872764.619212:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327723136:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872764.619236:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872764.619277:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327723136:12345-0@lo:38:kworker.0 Request processed in 63us (194us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872764.619284:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1788872764.619297:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1788872764.619301:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327723392:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872764.619310:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872764.619335:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327723392:12345-0@lo:38:kworker.0 Request processed in 33us (209us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872764.619342:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00080000:3.0:1788872764.619381:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872764.619387:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872764.619391:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327723392:0@lo:38:kworker.0 00000100:00080000:3.0:1788872764.619418:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872764.619422:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872764.619425:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327723136:0@lo:38:kworker.0 00000100:00080000:3.0:1788872764.619479:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872764.620202:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327723520:0@lo:400:kworker.0 00000100:00100000:2.0:1788872764.620867:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f0988e00 x1875765327723648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872764.621144:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327723776:0@lo:400:kworker.0 00000100:00100000:0.0:1788872764.621205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872764.621303:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327723776 00000100:00100000:1.0:1788872764.621310:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327723776 00000100:00100000:1.0:1788872764.621374:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:1.0:1788872764.621384:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327723776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872764.621435:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327723776:12345-0@lo:400:kworker.0 Request processed in 53us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872764.621442:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00080000:0.0:1788872764.621503:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872764.621538:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327723776:0@lo:400:kworker.0 00000100:00100000:1.0:1788872764.621882:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327723904:0@lo:400:kworker.0 00000100:00100000:1.0:1788872764.621923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872764.621964:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327723904 00000100:00080000:2.0:1788872764.621975:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872764.621979:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872764.621982:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872764.621987:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3696 00000100:00100000:0.0:1788872764.621991:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327723904 00000100:00080000:2.0:1788872764.621996:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788872764.622000:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872764.622025:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:2.0:1788872764.622027:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f5b34e00 x1875765327724032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872764.622043:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327723904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872764.627084:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327723648:0@lo:38:kworker.0 00000100:00100000:3.0:1788872764.627184:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872764.627235:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327723648 00000100:00100000:3.0:1788872764.627244:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327723648 00000100:00100000:3.0:1788872764.627297:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:3.0:1788872764.627306:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327723648:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872764.627357:0:23717:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872764.627406:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327723648:12345-0@lo:38:kworker.0 Request processed in 99us (222us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872764.627414:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000100:00080000:3.0:1788872764.627464:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872764.627470:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872764.627474:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327723648:0@lo:38:kworker.0 00000100:00100000:3.0:1788872764.627482:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327724032:0@lo:38:kworker.0 00000100:00100000:3.0:1788872764.627508:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872764.627544:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327724032 00000100:00100000:3.0:1788872764.627566:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327724032 00000100:00100000:3.0:1788872764.627591:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1788872764.627596:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327724032:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872764.627607:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872764.627635:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327724032:12345-0@lo:38:kworker.0 Request processed in 37us (126us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872764.627642:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00080000:3.0:1788872764.627666:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872764.627670:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872764.627673:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327724032:0@lo:38:kworker.0 00000100:00080000:3.0:1788872764.627727:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872764.630948:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327723904:12345-0@lo:400:kworker.0 Request processed in 8906us (9024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872764.630964:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:1.0:1788872764.637971:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327723904:0@lo:400:kworker.0 00000400:00000100:1.0:1788872764.688817:0:3637:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311177088 offset 0 length 224: 4 00000100:00100000:1.0:1788872764.688862:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872764.689163:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311177472 00000100:00100000:2.0:1788872764.689174:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311177472 00000100:00100000:2.0:1788872764.689261:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2589 00000100:00100000:2.0:1788872764.689271:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311177472:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872764.689692:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872764.689734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872764.689777:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00080000:3.0:1788872764.689785:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872764.689802:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311177344 00000100:00100000:3.0:1788872764.689805:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311177600 00000100:00100000:0.0:1788872764.689807:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311177344 00000100:00100000:3.0:1788872764.689808:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311177600 00000100:00100000:3.0:1788872764.689839:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2590 00000100:00100000:0.0:1788872764.689840:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311177216 00000100:00100000:0.0:1788872764.689843:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311177216 00000100:00100000:0.0:1788872764.689856:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1274 00000100:00100000:3.0:1788872764.689857:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311177600:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872764.689862:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f660a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311177344:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872764.689906:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311177600:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 50us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872764.689913:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2590 00000100:00080000:3.0:1788872764.689932:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872764.689935:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872764.689954:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1251 00000100:00100000:3.0:1788872764.689959:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311177216:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:3.0:1788872764.689988:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872764.695023:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f660a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311177344:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 5144us (5316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872764.695040:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1274 00000100:00100000:2.0:1788872764.695543:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311177472:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 6270us (6678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872764.695574:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2589 00000100:00100000:3.0:1788872764.696618:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311177216:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 6649us (6874us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872764.696630:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1251 00010000:00010000:3.0:1788872764.728980:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872765.752838:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872766.779570:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872767.161544:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327724160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872767.161654:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872767.162693:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327724160 00000100:00100000:3.0:1788872767.162704:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327724160 00000100:00100000:3.0:1788872767.162777:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:3.0:1788872767.162790:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f660ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327724160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872767.162834:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872767.162899:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f660ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327724160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872767.162906:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00080000:2.0:1788872767.162996:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872767.165940:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327724160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872767.166048:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788872767.166063:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f660aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327724288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872767.166130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872767.166228:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327724288 00000100:00100000:0.0:1788872767.166235:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327724288 00000100:00100000:0.0:1788872767.166300:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1788872767.166313:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327724288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872767.166347:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872767.166436:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327724288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872767.166444:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1788872767.166489:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f660aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327724288:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788872767.167892:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788872767.800839:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872768.824805:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788872769.724528:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872769.724536:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872769.724540:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872769.724567:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3701 00000100:00080000:2.0:1788872769.724575:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788872769.724582:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872769.724606:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f663ed80 x1875765327724544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872769.724638:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872769.724642:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872769.724644:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872769.724647:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3701 00000100:00080000:2.0:1788872769.724658:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788872769.724662:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872769.724689:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8caabb100 x1875765327724800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872769.724705:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872769.724708:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872769.724710:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872769.724714:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3701 00000100:00080000:2.0:1788872769.724716:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788872769.724719:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872769.724729:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8caab9500 x1875765327725056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872769.724746:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872769.724749:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872769.724751:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872769.724753:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3701 00000100:00080000:2.0:1788872769.724755:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788872769.724758:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872769.724768:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8caabaa00 x1875765327725440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872769.724796:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327725184:0@lo:400:kworker.0 00000100:00100000:2.0:1788872769.724869:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872769.724905:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788872769.724911:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327724416:0@lo:400:kworker.0 00000400:00000100:2.0:1788872769.724941:0:3646:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327724416 offset 0 length 224: 4 00000100:00100000:2.0:1788872769.725113:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caabad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327725312:0@lo:400:kworker.0 00000100:00100000:2.0:1788872769.725141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872769.725239:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caaba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327724928:0@lo:400:kworker.0 00000100:00100000:0.0:1788872769.725278:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872769.725322:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872769.725327:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327724672:0@lo:400:kworker.0 00000100:00100000:0.0:1788872769.725350:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872769.725383:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327725184 00000100:00100000:0.0:1788872769.725393:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327725184 00000100:00100000:0.0:1788872769.725457:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327725312 00000100:00100000:0.0:1788872769.725460:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327725312 00000100:00100000:0.0:1788872769.725483:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:0.0:1788872769.725491:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327725184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872769.725572:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327725184:12345-0@lo:400:kworker.0 Request processed in 80us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872769.725579:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:0.0:1788872769.725595:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:0.0:1788872769.725602:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6a9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327725312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872769.725630:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6a9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327725312:12345-0@lo:400:kworker.0 Request processed in 28us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872769.725636:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:0.0:1788872769.725834:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caabad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327725312:0@lo:400:kworker.0 00000100:00100000:0.0:1788872769.725846:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327725184:0@lo:400:kworker.0 00000100:00100000:3.0:1788872769.726599:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327724544:0@lo:38:kworker.0 00000100:00100000:3.0:1788872769.726654:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872769.726685:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327724800:0@lo:38:kworker.0 00000100:00100000:3.0:1788872769.726704:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872769.726721:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327725056:0@lo:38:kworker.0 00000100:00100000:3.0:1788872769.726744:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872769.726762:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caabaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327725440:0@lo:38:kworker.0 00000100:00100000:3.0:1788872769.726782:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872769.726817:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327724928 00000100:00100000:3.0:1788872769.726823:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327724928 00000100:00100000:3.0:1788872769.726862:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327724672 00000100:00100000:3.0:1788872769.726865:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327724672 00000100:00100000:3.0:1788872769.726878:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327724544 00000100:00100000:3.0:1788872769.726881:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327724544 00000100:00100000:3.0:1788872769.726891:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327724800 00000100:00100000:3.0:1788872769.726893:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327724800 00000100:00100000:3.0:1788872769.726900:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327725440 00000100:00100000:3.0:1788872769.726902:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327725440 00000100:00100000:3.0:1788872769.726910:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1788872769.726917:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f660aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327724928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872769.726983:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f660aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327724928:12345-0@lo:400:kworker.0 Request processed in 65us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872769.726990:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1788872769.727005:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1788872769.727011:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327724672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872769.727039:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327724672:12345-0@lo:400:kworker.0 Request processed in 29us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872769.727059:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1788872769.727071:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:3.0:1788872769.727075:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327724544:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872769.727094:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872769.727131:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327724544:12345-0@lo:38:kworker.0 Request processed in 54us (477us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872769.727138:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:3.0:1788872769.727149:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1788872769.727152:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327724800:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872769.727162:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872769.727184:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327724800:12345-0@lo:38:kworker.0 Request processed in 30us (478us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872769.727190:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1788872769.727200:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1788872769.727204:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327725440:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872769.727213:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872769.727235:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327725440:12345-0@lo:38:kworker.0 Request processed in 29us (452us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872769.727240:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00080000:3.0:1788872769.727256:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872769.727260:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872769.727262:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872769.727281:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327725056 00000100:00100000:3.0:1788872769.727285:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327725056 00000100:00100000:3.0:1788872769.727305:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:3.0:1788872769.727317:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327725056:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872769.727328:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872769.727353:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327725056:12345-0@lo:38:kworker.0 Request processed in 35us (608us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872769.727359:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00100000:3.0:1788872769.727402:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327724672:0@lo:400:kworker.0 00000100:00100000:3.0:1788872769.727414:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caaba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327724928:0@lo:400:kworker.0 00000100:00080000:3.0:1788872769.727461:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872769.727467:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872769.727470:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327724544:0@lo:38:kworker.0 00000100:00080000:3.0:1788872769.727478:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872769.727482:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872769.727484:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327724800:0@lo:38:kworker.0 00000100:00080000:3.0:1788872769.727492:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872769.727496:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872769.727499:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327725056:0@lo:38:kworker.0 00000100:00080000:3.0:1788872769.727505:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872769.727509:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872769.727512:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caabaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327725440:0@lo:38:kworker.0 00000100:00100000:3.0:1788872769.820145:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872769.820179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000400:00000100:3.0:1788872769.820202:0:3639:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311177728 offset 0 length 224: 4 00000100:00100000:3.0:1788872769.820220:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872769.820259:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872769.820286:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311177984 00000100:00100000:3.0:1788872769.820296:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311177984 00000100:00100000:3.0:1788872769.820354:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311177856 00000100:00100000:3.0:1788872769.820358:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311177856 00000100:00100000:3.0:1788872769.820377:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1277 00000100:00100000:3.0:1788872769.820387:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311177984:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872769.820474:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311177984:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 88us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872769.820482:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1277 00000100:00100000:3.0:1788872769.820500:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1255 00000100:00100000:3.0:1788872769.820504:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311177856:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:3.0:1788872769.820525:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872769.820776:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311177856:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 269us (515us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872769.820784:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1255 00000100:00100000:3.0:1788872769.820804:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311178240 00000100:00100000:3.0:1788872769.820808:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311178240 00000100:00100000:3.0:1788872769.820997:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311178112 00000100:00100000:3.0:1788872769.821001:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311178112 00000100:00100000:3.0:1788872769.821154:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2593 00000100:00100000:3.0:1788872769.821161:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311178240:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872769.821276:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311178240:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 114us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872769.821282:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2593 00000100:00100000:3.0:1788872769.821294:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2594 00000100:00100000:3.0:1788872769.821311:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311178112:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872769.821335:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311178112:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 26us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872769.821340:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2594 00000100:00080000:3.0:1788872769.821360:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872769.821363:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872769.821365:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788872769.855788:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872770.872826:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872771.899261:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872772.281970:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327725568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872772.282064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872772.283190:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788872772.283206:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327725696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872772.283257:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872772.295151:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327725568 00000100:00100000:2.0:1788872772.295169:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327725568 00000100:00100000:2.0:1788872772.295240:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327725696 00000100:00100000:2.0:1788872772.295243:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327725696 00000100:00100000:2.0:1788872772.295270:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:2.0:1788872772.295281:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327725568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872772.295316:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872772.295400:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327725568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (13337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872772.295407:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:2.0:1788872772.295428:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:2.0:1788872772.295435:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327725696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872772.295452:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872772.295480:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327725696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (12223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872772.295487:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00080000:2.0:1788872772.295764:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872772.295768:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872772.297094:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327725696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872772.297128:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327725568:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788872772.920737:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872773.944713:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788872774.842533:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872774.842543:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872774.842563:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872774.842574:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3706 00000100:00080000:1.0:1788872774.842582:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872774.842589:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872774.842617:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ee81f800 x1875765327725952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872774.842669:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872774.842673:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872774.842675:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872774.842679:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3706 00000100:00080000:1.0:1788872774.842682:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872774.842685:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872774.842698:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ee81dc00 x1875765327726208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872774.842726:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872774.842729:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872774.842731:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872774.842735:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3706 00000100:00080000:1.0:1788872774.842738:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872774.842742:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872774.842755:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ee81f480 x1875765327726464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872774.842775:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872774.842778:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872774.842780:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872774.842783:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3706 00000100:00080000:1.0:1788872774.842786:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872774.842789:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872774.842800:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ee81d180 x1875765327726848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872774.842838:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327725952:0@lo:38:kworker.0 00000100:00100000:1.0:1788872774.842909:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872774.842945:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327726208:0@lo:38:kworker.0 00000100:00100000:1.0:1788872774.842970:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872774.842987:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327726464:0@lo:38:kworker.0 00000100:00100000:1.0:1788872774.843012:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872774.843030:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327726848:0@lo:38:kworker.0 00000100:00100000:1.0:1788872774.843051:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872774.843092:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327726336:0@lo:400:kworker.0 00000100:00100000:1.0:1788872774.843136:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872774.843173:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872774.843179:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327726592:0@lo:400:kworker.0 00000100:00100000:1.0:1788872774.843209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872774.843244:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327725952 00000100:00100000:1.0:1788872774.843251:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327725952 00000100:00100000:1.0:1788872774.843283:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327726208 00000100:00100000:1.0:1788872774.843287:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327726208 00000100:00100000:1.0:1788872774.843301:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327726848 00000100:00100000:1.0:1788872774.843304:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327726848 00000100:00100000:1.0:1788872774.843313:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327726336 00000100:00100000:1.0:1788872774.843315:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327726336 00000100:00100000:1.0:1788872774.843365:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1788872774.843375:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327726336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872774.843430:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327726336:12345-0@lo:400:kworker.0 Request processed in 57us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872774.843437:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1788872774.843462:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1788872774.843467:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327725952:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872774.843485:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872774.843520:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327725952:12345-0@lo:38:kworker.0 Request processed in 51us (611us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872774.843526:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1788872774.843539:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1788872774.843542:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327726208:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872774.843574:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872774.843601:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327726208:12345-0@lo:38:kworker.0 Request processed in 57us (631us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872774.843607:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1788872774.843619:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1788872774.843624:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327726848:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872774.843633:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872774.843657:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327726848:12345-0@lo:38:kworker.0 Request processed in 31us (604us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872774.843663:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1788872774.843689:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327726464 00000100:00100000:1.0:1788872774.843693:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327726464 00000100:00100000:1.0:1788872774.843715:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:1.0:1788872774.843720:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327726464:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872774.843730:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872774.843757:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327726464:12345-0@lo:38:kworker.0 Request processed in 36us (744us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872774.843774:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00100000:1.0:1788872774.843801:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327726592 00000100:00100000:1.0:1788872774.843805:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327726592 00000100:00100000:1.0:1788872774.843837:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:1.0:1788872774.843844:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327726592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872774.843876:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327726592:12345-0@lo:400:kworker.0 Request processed in 33us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872774.843883:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00080000:1.0:1788872774.843903:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872774.843908:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872774.843935:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327726592:0@lo:400:kworker.0 00000100:00100000:1.0:1788872774.843947:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327726336:0@lo:400:kworker.0 00000100:00080000:1.0:1788872774.843977:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872774.843981:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872774.843984:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327725952:0@lo:38:kworker.0 00000100:00080000:1.0:1788872774.843991:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872774.843995:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872774.843997:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327726208:0@lo:38:kworker.0 00000100:00080000:1.0:1788872774.844004:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872774.844007:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872774.844009:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327726464:0@lo:38:kworker.0 00000100:00080000:1.0:1788872774.844016:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872774.844019:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872774.844021:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327726848:0@lo:38:kworker.0 00000100:00100000:2.0:1788872774.844054:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327725824:0@lo:400:kworker.0 00000400:00000100:2.0:1788872774.844081:0:3646:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327725824 offset 0 length 224: 4 00000100:00100000:2.0:1788872774.844120:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327726720:0@lo:400:kworker.0 00000100:00100000:2.0:1788872774.844143:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872774.844171:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872774.844177:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327726080:0@lo:400:kworker.0 00000100:00100000:2.0:1788872774.844198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872774.847940:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327726720 00000100:00100000:1.0:1788872774.847956:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327726720 00000100:00100000:1.0:1788872774.848028:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1788872774.848039:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327726720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872774.848164:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327726720:12345-0@lo:400:kworker.0 Request processed in 128us (4019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872774.848171:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1788872774.848196:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327726080 00000100:00100000:1.0:1788872774.848200:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327726080 00000100:00100000:1.0:1788872774.848229:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:1.0:1788872774.848235:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327726080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872774.848268:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327726080:12345-0@lo:400:kworker.0 Request processed in 33us (4068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872774.848274:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:1.0:1788872774.848341:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327726080:0@lo:400:kworker.0 00000100:00100000:1.0:1788872774.848357:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327726720:0@lo:400:kworker.0 00000100:00080000:0.0:1788872774.848699:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872774.848704:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872774.925448:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872774.925499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000400:00000100:3.0:1788872774.925522:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311178368 offset 0 length 224: 4 00000100:00100000:3.0:1788872774.925541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872774.925641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872774.925673:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311178880 00000100:00100000:3.0:1788872774.925682:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311178880 00000100:00100000:3.0:1788872774.925744:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311178752 00000100:00100000:3.0:1788872774.925747:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311178752 00000100:00100000:3.0:1788872774.925769:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2597 00000100:00100000:3.0:1788872774.925779:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311178880:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872774.925872:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311178880:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 94us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872774.925880:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2597 00000100:00100000:3.0:1788872774.925910:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2598 00000100:00100000:3.0:1788872774.925916:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2407:x1875765311178752:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872774.925942:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2407:x1875765311178752:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872774.925948:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2598 00000100:00100000:3.0:1788872774.925970:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311178624 00000100:00100000:3.0:1788872774.925974:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311178624 00000100:00100000:3.0:1788872774.926004:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311178496 00000100:00100000:3.0:1788872774.926007:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311178496 00000100:00100000:3.0:1788872774.926025:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1280 00000100:00100000:3.0:1788872774.926030:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311178624:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872774.926060:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2407:x1875765311178624:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 30us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872774.926067:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1280 00000100:00100000:3.0:1788872774.926079:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1259 00000100:00100000:3.0:1788872774.926084:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311178496:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:3.0:1788872774.926114:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872774.926140:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311178496:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 55us (500us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872774.926147:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1259 00000100:00080000:3.0:1788872774.926162:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872774.926167:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872774.926168:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788872774.973415:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788872775.343078:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788872759/real 1788872759] req@ffff98a9df5aea00 x1875765327721216/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872775 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872775.343188:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff98a9df5aea00 x1875765327721216/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872775 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872775.343198:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788872775.343202:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788872775.343206:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.139@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788872775.343208:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788872775.343212:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9df5aea00 x1875765327721216/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872775 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872775.343222:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9f6608e00 x1875765327723008/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872780 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872775.343304:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9f5b34e00 x1875765327724416/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872785 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872775.343339:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9ee81e300 x1875765327725824/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872790 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788872775.343348:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788872775.343351:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788872775.343353:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788872775.343355:0:3647:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00080000:0.0:1788872775.343448:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872775.343454:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788872775.343456:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872775.343461:0:52416:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3650 00000100:00080000:0.0:1788872775.343497:0:52416:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872775.343566:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327725824:0@lo:400:kworker.0 00000100:00100000:3.0:1788872775.343577:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327724416:0@lo:400:kworker.0 00000100:00100000:0.0:1788872775.345096:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f6608000 x1875765327726976/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872775.345139:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872775.345143:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872775.345146:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872775.345150:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3711 00000100:00080000:0.0:1788872775.345154:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872775.345159:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872775.345178:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f6609c00 x1875765327727104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872775.345206:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872775.345209:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872775.345211:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872775.345215:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3711 00000100:00080000:0.0:1788872775.345217:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872775.345222:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872775.345234:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f6608a80 x1875765327727360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872775.345258:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872775.345262:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872775.345263:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872775.345267:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3711 00000100:00080000:0.0:1788872775.345269:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872775.345273:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872775.345294:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f6609f80 x1875765327727616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872775.345329:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872775.345332:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872775.345334:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872775.345336:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3711 00000100:00080000:0.0:1788872775.345339:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872775.345342:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872775.345356:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9df437100 x1875765327728000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872775.345393:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327727872:0@lo:400:kworker.0 00000100:00100000:0.0:1788872775.345457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872775.345507:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872775.345513:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327727232:0@lo:400:kworker.0 00000100:00100000:0.0:1788872775.345540:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872775.345589:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f660bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327727744:0@lo:400:kworker.0 00000100:00100000:0.0:1788872775.345613:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872775.345633:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872775.345637:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327727488:0@lo:400:kworker.0 00000100:00100000:0.0:1788872775.345658:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872775.345686:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327727872 00000100:00100000:0.0:1788872775.345694:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327727872 00000100:00100000:0.0:1788872775.345735:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327727744 00000100:00100000:0.0:1788872775.345737:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327727744 00000100:00100000:0.0:1788872775.345757:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:0.0:1788872775.345765:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327727872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872775.345826:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327727872:12345-0@lo:400:kworker.0 Request processed in 62us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872775.345833:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:0.0:1788872775.345852:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1788872775.345858:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327727744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872775.345890:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327727744:12345-0@lo:400:kworker.0 Request processed in 32us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872775.345895:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1788872775.345931:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f660bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327727744:0@lo:400:kworker.0 00000100:00100000:0.0:1788872775.345974:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327727872:0@lo:400:kworker.0 00000100:00100000:0.0:1788872775.346013:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327727232 00000100:00100000:0.0:1788872775.346017:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327727232 00000100:00100000:0.0:1788872775.346048:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327727488 00000100:00100000:0.0:1788872775.346051:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327727488 00000100:00100000:0.0:1788872775.346069:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:0.0:1788872775.346076:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327727232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872775.346114:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327727232:12345-0@lo:400:kworker.0 Request processed in 38us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872775.346119:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:0.0:1788872775.346130:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1788872775.346136:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327727488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872775.346167:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327727488:12345-0@lo:400:kworker.0 Request processed in 31us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872775.346174:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1788872775.346191:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327726976:0@lo:250:kworker.0 00000400:00000100:0.0:1788872775.346219:0:3643:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327726976 offset 0 length 520: 4 00000100:00100000:0.0:1788872775.346244:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327727104:0@lo:38:kworker.0 00000100:00100000:0.0:1788872775.346262:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872775.346283:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327727360:0@lo:38:kworker.0 00000100:00100000:0.0:1788872775.346303:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872775.346334:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327727616:0@lo:38:kworker.0 00000100:00100000:0.0:1788872775.346358:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872775.346377:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327728000:0@lo:38:kworker.0 00000100:00100000:0.0:1788872775.346397:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872775.346424:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327727104 00000100:00100000:0.0:1788872775.346428:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327727104 00000100:00100000:0.0:1788872775.346441:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327727360 00000100:00100000:0.0:1788872775.346443:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327727360 00000100:00100000:0.0:1788872775.346449:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327728000 00000100:00100000:0.0:1788872775.346451:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327728000 00000100:00100000:0.0:1788872775.346460:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1788872775.346464:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327727104:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872775.346481:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872775.346516:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327727104:12345-0@lo:38:kworker.0 Request processed in 50us (253us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872775.346522:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1788872775.346533:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1788872775.346536:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327727360:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872775.346544:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872775.346601:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327727360:12345-0@lo:38:kworker.0 Request processed in 62us (296us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872775.346613:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1788872775.346625:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1788872775.346629:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327728000:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872775.346637:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872775.346662:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327728000:12345-0@lo:38:kworker.0 Request processed in 32us (265us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872775.346668:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1788872775.346694:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327727616 00000100:00100000:0.0:1788872775.346697:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327727616 00000100:00100000:0.0:1788872775.346718:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:0.0:1788872775.346722:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f660bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327727616:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872775.346731:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872775.346759:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f660bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327727616:12345-0@lo:38:kworker.0 Request processed in 35us (400us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872775.346764:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00000100:00100000:0.0:1788872775.346794:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327727488:0@lo:400:kworker.0 00000100:00080000:0.0:1788872775.346821:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872775.346826:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872775.346829:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327727104:0@lo:38:kworker.0 00000100:00080000:0.0:1788872775.346837:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872775.346840:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872775.346843:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327727360:0@lo:38:kworker.0 00000100:00080000:0.0:1788872775.346849:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872775.346852:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872775.346861:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327727616:0@lo:38:kworker.0 00000100:00080000:0.0:1788872775.346870:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872775.346873:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872775.346876:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327728000:0@lo:38:kworker.0 00000100:00100000:0.0:1788872775.346906:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327727232:0@lo:400:kworker.0 00000100:00100000:0.0:1788872775.346925:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327721216:0@lo:400:kworker.0 00000100:00100000:1.0:1788872775.349629:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327723008:0@lo:400:kworker.0 00000400:00000100:3.0:1788872775.945822:0:3637:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311179008 offset 0 length 520: 4 00000100:00100000:3.0:1788872775.945869:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872775.945906:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872775.945930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872775.945950:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872775.945984:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311179520 00000100:00100000:3.0:1788872775.945995:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311179520 00000100:00100000:3.0:1788872775.946055:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311179392 00000100:00100000:3.0:1788872775.946058:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311179392 00000100:00100000:3.0:1788872775.946082:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2601 00000100:00100000:3.0:1788872775.946105:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311179520:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872775.946176:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311179520:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872775.946183:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2601 00000100:00100000:3.0:1788872775.946202:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2602 00000100:00100000:3.0:1788872775.946208:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2406:x1875765311179392:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872775.946230:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2406:x1875765311179392:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 23us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872775.946235:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2602 00000100:00100000:0.0:1788872775.946584:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311179136 00000100:00100000:0.0:1788872775.946589:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311179136 00000100:00100000:0.0:1788872775.946617:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1263 00000100:00100000:0.0:1788872775.946623:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311179136:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:0.0:1788872775.946644:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872775.946681:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311179136:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 57us (811us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872775.946688:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1263 00000100:00100000:0.0:1788872775.946700:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311179264 00000100:00100000:0.0:1788872775.946703:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311179264 00000100:00100000:0.0:1788872775.946728:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1283 00000100:00100000:0.0:1788872775.946734:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311179264:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872775.946762:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2406:x1875765311179264:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872775.946768:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1283 00010000:00010000:0.0:1788872775.994734:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872777.017183:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872777.403453:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872777.403476:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327728128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872777.403579:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872777.403638:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327728128 00000100:00100000:3.0:1788872777.403647:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327728128 00000100:00100000:3.0:1788872777.403700:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:3.0:1788872777.403709:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327728128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872777.403748:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872777.403791:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327728128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872777.403798:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00080000:3.0:1788872777.403820:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872777.403859:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327728128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872777.405475:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872777.405504:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327728256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872777.405588:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872777.405672:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327728256 00000100:00100000:3.0:1788872777.405678:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327728256 00000100:00100000:3.0:1788872777.405731:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:3.0:1788872777.405739:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327728256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872777.405764:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872777.405803:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327728256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872777.405810:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:0.0:1788872777.405892:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327728256:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788872777.405913:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788872778.045105:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872779.069897:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872780.089370:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788872780.472748:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872780.472761:0:86506:0:(pinger.c:247:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788872780.472764:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872780.472768:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872780.472772:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872780.472780:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3712 00000100:00080000:2.0:1788872780.472785:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872780.472793:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872780.472831:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8caab8a80 x1875765327728384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872780.472881:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872780.472885:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872780.472887:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872780.472891:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3712 00000100:00080000:2.0:1788872780.472893:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872780.472897:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872780.472908:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8caabb800 x1875765327728640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872780.472947:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872780.472951:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872780.472952:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872780.472956:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3712 00000100:00080000:2.0:1788872780.472959:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872780.472963:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872780.472975:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8caab8e00 x1875765327728896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872780.472997:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872780.473000:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872780.473002:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872780.473019:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3712 00000100:00080000:2.0:1788872780.473022:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872780.473025:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872780.473036:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8caab9c00 x1875765327729280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872780.473063:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caaba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327728512:0@lo:400:kworker.0 00000100:00100000:2.0:1788872780.473135:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872780.473429:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872780.473437:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327729152:0@lo:400:kworker.0 00000100:00100000:2.0:1788872780.473529:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872780.473609:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327728768:0@lo:400:kworker.0 00000100:00100000:2.0:1788872780.473635:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872780.473665:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872780.473671:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327729024:0@lo:400:kworker.0 00000100:00100000:2.0:1788872780.473695:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872780.473745:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327728512 00000100:00100000:2.0:1788872780.473753:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327728512 00000100:00100000:2.0:1788872780.473807:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327728768 00000100:00100000:2.0:1788872780.473810:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327728768 00000100:00100000:2.0:1788872780.473833:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1788872780.473842:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327728512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872780.473892:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327728512:12345-0@lo:400:kworker.0 Request processed in 51us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872780.473899:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1788872780.473917:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1788872780.473923:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327728768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872780.473954:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327728768:12345-0@lo:400:kworker.0 Request processed in 32us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872780.473960:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1788872780.473979:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327729152 00000100:00100000:2.0:1788872780.473983:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327729152 00000100:00100000:2.0:1788872780.474010:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327729024 00000100:00100000:2.0:1788872780.474013:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327729024 00000100:00100000:2.0:1788872780.474036:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1788872780.474042:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327729152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872780.474072:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327729152:12345-0@lo:400:kworker.0 Request processed in 30us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872780.474079:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1788872780.474091:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1788872780.474098:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327729024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872780.474133:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327729024:12345-0@lo:400:kworker.0 Request processed in 35us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872780.474139:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00080000:2.0:1788872780.474162:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872780.474166:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872780.474169:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872780.474884:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327728384:0@lo:38:kworker.0 00000100:00100000:0.0:1788872780.474925:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872780.474961:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caabb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327728640:0@lo:38:kworker.0 00000100:00100000:0.0:1788872780.474984:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872780.475018:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327728896:0@lo:38:kworker.0 00000100:00100000:0.0:1788872780.475043:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872780.475075:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327729280:0@lo:38:kworker.0 00000100:00100000:0.0:1788872780.475099:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872780.475140:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327728384 00000100:00100000:0.0:1788872780.475146:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327728384 00000100:00100000:0.0:1788872780.475413:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327728640 00000100:00100000:0.0:1788872780.475417:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327728640 00000100:00100000:0.0:1788872780.475431:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327729280 00000100:00100000:0.0:1788872780.475433:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327729280 00000100:00100000:0.0:1788872780.475443:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1788872780.475447:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327728384:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872780.475468:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872780.475511:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327728384:12345-0@lo:38:kworker.0 Request processed in 62us (585us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872780.475517:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1788872780.475532:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1788872780.475535:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327728640:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872780.475588:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872780.475618:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327728640:12345-0@lo:38:kworker.0 Request processed in 80us (633us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872780.475624:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1788872780.475636:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1788872780.475640:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327729280:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872780.475648:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872780.475675:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327729280:12345-0@lo:38:kworker.0 Request processed in 33us (575us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872780.475681:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00080000:0.0:1788872780.475722:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872780.475726:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872780.475730:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327728384:0@lo:38:kworker.0 00000100:00080000:0.0:1788872780.475738:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872780.475741:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872780.475744:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caabb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327728640:0@lo:38:kworker.0 00000100:00080000:0.0:1788872780.475751:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872780.475753:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872780.475756:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327729280:0@lo:38:kworker.0 00000100:00100000:2.0:1788872780.477690:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327729024:0@lo:400:kworker.0 00000100:00100000:2.0:1788872780.478340:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327728768:0@lo:400:kworker.0 00000100:00100000:2.0:1788872780.478396:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327729152:0@lo:400:kworker.0 00000100:00100000:2.0:1788872780.478408:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caaba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327728512:0@lo:400:kworker.0 00000100:00100000:0.0:1788872780.479646:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327728896 00000100:00100000:0.0:1788872780.479656:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327728896 00000100:00100000:0.0:1788872780.479704:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:0.0:1788872780.479712:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327728896:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872780.479733:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872780.479837:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327728896:12345-0@lo:38:kworker.0 Request processed in 124us (4791us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872780.479844:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00080000:0.0:1788872780.479912:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872780.479918:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872780.479921:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327728896:0@lo:38:kworker.0 00000100:00100000:1.0:1788872781.068701:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872781.068779:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872781.068809:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872781.068887:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872781.068931:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311180032 00000100:00100000:2.0:1788872781.068943:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311180032 00000100:00100000:2.0:1788872781.069003:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311179904 00000100:00100000:2.0:1788872781.069006:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311179904 00000100:00100000:2.0:1788872781.069031:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2605 00000100:00100000:2.0:1788872781.069041:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311180032:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872781.069116:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311180032:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 76us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872781.069124:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2605 00000100:00100000:2.0:1788872781.069142:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2606 00000100:00100000:2.0:1788872781.069149:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311179904:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872781.069185:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311179904:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 36us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872781.069192:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2606 00000100:00080000:2.0:1788872781.069233:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872781.069237:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872781.077645:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311179776 00000100:00100000:0.0:1788872781.077664:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311179776 00000100:00100000:1.0:1788872781.077760:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311179648 00000100:00100000:1.0:1788872781.077765:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311179648 00000100:00100000:1.0:1788872781.077819:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1267 00000100:00100000:1.0:1788872781.077941:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311179648:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:1.0:1788872781.077974:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872781.078092:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311179648:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 263us (9202us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872781.078101:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1267 00000100:00100000:3.0:1788872781.078566:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1286 00000100:00100000:3.0:1788872781.078575:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311179776:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872781.078619:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311179776:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 46us (9926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872781.078625:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1286 00000100:00080000:2.0:1788872781.080754:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788872781.115072:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788872781.206801:0:91000:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788872781.206808:0:91000:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788872781.206810:0:91000:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788872781.207300:0:91000:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98a8c394c000 00000020:01000004:1.0:1788872781.207319:0:91000:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788872781.207335:0:91000:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788872781.207351:0:91000:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98a9f67119c0) 00000020:00000080:1.0:1788872781.207685:0:91000:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788872781.345798:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788872781.352175:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788872781.354144:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788872781.355669:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788872781.356323:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788872781.356662:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788872781.357128:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788872781.357697:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788872781.358152:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788872781.358396:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788872781.358617:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788872781.359042:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788872781.359305:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788872781.359529:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788872781.360790:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788872781.368991:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.370034:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.373000:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.373712:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.374305:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.374809:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.375335:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.375542:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.375900:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.376971:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.377373:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.377929:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.378958:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.379431:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.379927:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.381087:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.381316:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.382034:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.382596:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.383370:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.383665:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.384113:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.384318:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.384506:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.386069:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.386660:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.387077:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.387287:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.387483:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.387960:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.388248:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788872781.388474:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788872781.389295:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788872781.390984:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788872781.391533:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788872781.392863:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788872781.393210:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788872781.393526:0:91000:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1788872781.394680:0:91000:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788872781.396491:0:91000:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788872781.396503:0:91000:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788872781.396516:0:91000:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da6f6 00000020:01000004:2.0:1788872781.396523:0:91000:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788872781.396536:0:91000:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788872781.396681:0:91000:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a8c394c000 from MGS 00000020:01000004:2.0:1788872781.396685:0:91000:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788872781.396699:0:91000:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98a9fa794d40) 00000020:00000080:2.0:1788872781.396713:0:91000:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:2.0:1788872781.397730:0:91000:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a8c394c000 from MGS, refs=2 00080000:01000000:2.0:1788872781.397749:0:91000:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788872781.397759:0:91000:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da704 00010000:00010000:2.0:1788872781.397903:0:91000:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1788872781.410150:0:91000:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788872781.411087:0:91004:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788872781.411139:0:91000:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788872781.411184:0:91000:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788872781.415084:0:91000:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788872781.415394:0:91000:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788872781.416447:0:91000:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788872781.416458:0:91000:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788872781.418936:0:91000:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788872781.418950:0:91000:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788872781.419468:0:91000:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788872781.419475:0:91000:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788872781.425624:0:91000:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788872781.425651:0:91000:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788872781.425652:0:91000:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.139@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788872781.425656:0:91000:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.139@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788872781.425661:0:91000:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98a9e98d3800 already not connected (conn 66, was 0): CONNECTING 00000100:00100000:1.0:1788872781.425667:0:91000:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:3.0:1788872782.142878:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872782.521673:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327729408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872782.521750:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872782.522033:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327729408 00000100:00100000:3.0:1788872782.522042:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327729408 00000100:00100000:3.0:1788872782.522114:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:3.0:1788872782.522124:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caaba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327729408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872782.522155:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872782.522220:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caaba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327729408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872782.522228:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00080000:2.0:1788872782.522287:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872782.522326:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327729408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872782.525341:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872782.525360:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327729536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872782.525436:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872782.525645:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327729536 00000100:00100000:3.0:1788872782.525654:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327729536 00000100:00100000:3.0:1788872782.525756:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:3.0:1788872782.525766:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327729536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872782.525796:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872782.525992:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327729536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872782.526035:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327729536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872782.526044:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00080000:2.0:1788872782.526088:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788872783.160800:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872784.185787:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872785.208801:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872785.592685:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788872775/real 1788872775] req@ffff98a9f6608000 x1875765327726976/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788872785 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872785.592745:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98a9f6608000 x1875765327726976/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788872785 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872785.592800:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872785.592836:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788872785.592852:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327726976:0@lo:250:kworker.0 00000100:00080000:0.0:1788872785.592968:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872785.592974:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788872785.592977:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872785.592982:0:86506:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3712 00000100:00080000:0.0:1788872785.592987:0:86506:0:(import.c:589:import_select_connection()) MGC192.168.204.139@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788872785.592994:0:86506:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872785.593027:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f660b480 x1875765327729664/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872785.593052:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872785.593055:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872785.593057:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872785.593060:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3717 00000100:00080000:0.0:1788872785.593062:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872785.593074:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872785.593089:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f6608000 x1875765327729792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872785.593134:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872785.593138:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872785.593140:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872785.593143:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3717 00000100:00080000:0.0:1788872785.593155:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872785.593160:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872785.593174:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9df5ad880 x1875765327730048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872785.593201:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872785.593205:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872785.593207:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872785.593210:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3717 00000100:00080000:0.0:1788872785.593212:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872785.593216:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872785.593227:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c6563b80 x1875765327730304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872785.593265:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1788872785.593268:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872785.593273:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872785.593276:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872785.593279:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3717 00000100:00080000:0.0:1788872785.593282:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1788872785.593284:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327730560:0@lo:400:kworker.0 00000100:00080000:0.0:1788872785.593297:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872785.593314:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c4a16680 x1875765327730688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872785.593365:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327730176:0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.593374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.593408:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327729920:0@lo:400:kworker.0 00000100:00100000:0.0:1788872785.593428:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.593447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872785.593478:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872785.593486:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327730432:0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.593498:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327730176 00000100:00100000:2.0:1788872785.593507:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327730176 00000100:00100000:0.0:1788872785.593517:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.593584:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327729920 00000100:00100000:2.0:1788872785.593587:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327729920 00000100:00100000:2.0:1788872785.593613:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1788872785.593619:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327730560 00000100:00100000:2.0:1788872785.593624:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327730176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872785.593626:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327730560 00000100:00100000:0.0:1788872785.593662:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327730432 00000100:00100000:0.0:1788872785.593667:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327730432 00000100:00100000:2.0:1788872785.593689:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327730176:12345-0@lo:400:kworker.0 Request processed in 66us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.593695:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:2.0:1788872785.593702:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1788872785.593707:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327730560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.593736:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1788872785.593745:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327729920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872785.593757:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327730560:12345-0@lo:400:kworker.0 Request processed in 53us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.593765:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:2.0:1788872785.593784:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327729920:12345-0@lo:400:kworker.0 Request processed in 39us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.593786:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:2.0:1788872785.593796:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1788872785.593801:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327730432:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788872785.593824:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872785.593829:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872785.593832:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872785.593840:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327730432:12345-0@lo:400:kworker.0 Request processed in 43us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.593847:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:2.0:1788872785.593860:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327730560:0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.593873:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327729920:0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.593921:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327730432:0@lo:400:kworker.0 10000000:01000000:0.0:1788872785.593933:0:91000:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00100000:2.0:1788872785.593934:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327730176:0@lo:400:kworker.0 00010000:00010000:0.0:1788872785.593950:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3400/0xe4e6e89fb01da2ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da2d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.593963:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3400/0xe4e6e89fb01da2ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da2d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.593976:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788872785.593990:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594000:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3400/0xe4e6e89fb01da2ce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da2d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.594021:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da23b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.594028:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da23b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.594033:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872785.594048:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594052:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da23b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.594062:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01da250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.594069:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01da250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.594075:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872785.594078:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594082:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01da250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.594091:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01da27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.594108:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01da27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.594126:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872785.594131:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594135:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa98e400/0xe4e6e89fb01da27a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.594145:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fe00/0xe4e6e89fb01da288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.594150:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fe00/0xe4e6e89fb01da288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.594156:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872785.594160:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594163:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa98fe00/0xe4e6e89fb01da288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.594171:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da2a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.594177:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da2a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.594183:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872785.594186:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594189:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da2a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.594209:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f400/0xe4e6e89fb01da2b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.594215:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f400/0xe4e6e89fb01da2b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.594220:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872785.594223:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594227:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa98f400/0xe4e6e89fb01da2b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.594236:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52afc00/0xe4e6e89fb01da2dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da2e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.594241:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52afc00/0xe4e6e89fb01da2dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da2e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.594246:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872785.594249:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594253:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52afc00/0xe4e6e89fb01da2dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da2e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.594265:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01da242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da249 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.594271:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01da242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da249 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.594276:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872785.594286:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594290:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01da242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da249 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.594301:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2e00/0xe4e6e89fb01da25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.594308:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2e00/0xe4e6e89fb01da25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.594313:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872785.594316:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594319:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2e00/0xe4e6e89fb01da25e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.594329:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01da26c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.594335:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01da26c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.594340:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788872785.594343:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594346:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01da26c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.594354:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01da296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.594360:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01da296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.594375:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788872785.594379:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594384:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01da296 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.594394:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01da2c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872785.594401:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01da2c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872785.594407:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788872785.594425:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788872785.594428:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01da2c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788872785.594442:0:91000:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98a9e98d3800 already not connected (conn 67, was 0): CONNECTING 00000100:00080000:0.0:1788872785.594446:0:91000:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1788872785.594577:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327729664:0@lo:250:kworker.0 00000100:00100000:1.0:1788872785.594613:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.594643:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f6608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327729792:0@lo:38:kworker.0 00000100:00100000:1.0:1788872785.594664:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.594680:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327730048:0@lo:38:kworker.0 00000100:00100000:1.0:1788872785.594697:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.594711:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327730304:0@lo:38:kworker.0 00000100:00100000:1.0:1788872785.594731:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.594745:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327730688:0@lo:38:kworker.0 00000100:00100000:1.0:1788872785.594763:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.594791:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327729792 00000100:00100000:1.0:1788872785.594796:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327729792 00000100:00100000:1.0:1788872785.594816:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327730048 00000100:00100000:1.0:1788872785.594819:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327730048 00000100:00100000:1.0:1788872785.594830:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327730688 00000100:00100000:1.0:1788872785.594833:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327730688 00000100:00100000:1.0:1788872785.594844:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1788872785.594849:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327729792:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872785.594869:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872785.594906:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327729792:12345-0@lo:38:kworker.0 Request processed in 55us (240us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872785.594912:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1788872785.594932:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1788872785.594936:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327730048:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872785.594945:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872785.594967:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327730048:12345-0@lo:38:kworker.0 Request processed in 30us (269us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872785.594972:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1788872785.594982:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1788872785.594985:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327730688:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872785.594993:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872785.595011:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327730688:12345-0@lo:38:kworker.0 Request processed in 25us (247us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872785.595016:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1788872785.595036:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327730304 00000100:00100000:1.0:1788872785.595039:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327730304 00000100:00100000:1.0:1788872785.595060:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:1.0:1788872785.595064:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327730304:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872785.595073:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872785.595101:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327730304:12345-0@lo:38:kworker.0 Request processed in 35us (369us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872785.595107:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00080000:1.0:1788872785.595150:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872785.595155:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872785.595158:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f6608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327729792:0@lo:38:kworker.0 00000100:00080000:1.0:1788872785.595165:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872785.595168:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872785.595177:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327730048:0@lo:38:kworker.0 00000100:00080000:1.0:1788872785.595187:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872785.595190:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872785.595192:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327730304:0@lo:38:kworker.0 00000100:00080000:1.0:1788872785.595199:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872785.595202:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872785.595204:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327730688:0@lo:38:kworker.0 00000100:00100000:0.0:1788872785.596711:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327729664 00000100:00100000:0.0:1788872785.596724:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327729664 00000100:00100000:0.0:1788872785.596778:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788872785.596785:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1875765327729664:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1788872785.596811:0:91005:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo t0 exp 0000000000000000 cur 3722 last 0 00000020:00000080:0.0:1788872785.596843:0:91005:0:(genops.c:1406:class_connect()) connect: client f2e885a0-f180-4b85-9f87-6a01e20afd1a, cookie 0xe4e6e89fb01da70b 00000100:00080000:0.0:1788872785.597005:0:91005:0:(import.c:65:import_set_state_nolock()) ffff98a9ff609800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872785.597103:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:3643:x1875765327729664:12345-0@lo:250:kworker.0 Request processed in 317us (2488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.597110:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788872785.597213:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.139@tcp: connect to target with instance 0 10000000:01000000:0.0:1788872785.597224:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:0.0:1788872785.597228:0:3643:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0xe4e6e89fb01da70b 00000100:00080000:0.0:1788872785.610057:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:0.0:1788872785.610073:0:3643:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:0.0:1788872785.610475:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327729664:0@lo:250:kworker.0 00000100:00080000:1.0:1788872785.610581:0:91000:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:1.0:1788872785.610596:0:91000:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788872785.610635:0:91000:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788872785.610641:0:91000:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788872785.610745:0:91000:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788872785.610782:0:91000:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.139@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788872785.610788:0:91000:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788872785.610790:0:91000:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788872785.610791:0:91000:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872785.610793:0:91000:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872785.610794:0:91000:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872785.610795:0:91000:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872785.610797:0:91000:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788872785.610798:0:91000:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788872785.610800:0:91000:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872785.610801:0:91000:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788872785.610804:0:91000:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788872785.610806:0:91000:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788872785.610807:0:91000:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788872785.610808:0:91000:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872785.610809:0:91000:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872785.610810:0:91000:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872785.610811:0:91000:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872785.610812:0:91000:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788872785.610813:0:91000:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788872785.610818:0:91000:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872785.610819:0:91000:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788872785.610843:0:91000:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788872785.610859:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82ba780 going to sleep for 0 seconds 00000100:00100000:1.0:1788872785.610866:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327730816:0@lo:253:mount.lustre.0 00000020:00080000:1.0:1788872785.610878:0:91000:0:(tgt_mount.c:1454:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:1.0:1788872785.610888:0:91000:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a8c394c000 from lustre-MDT0000 10000000:01000000:1.0:1788872785.610925:0:91000:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788872785.610928:0:91000:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788872785.610938:0:91000:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98a8c394c000 10000000:01000000:1.0:1788872785.610943:0:91000:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788872785.610947:0:91000:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98a8c394c000 10000000:01000000:1.0:1788872785.610950:0:91000:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788872785.610953:0:91000:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a8c394c000 from 1 10000000:01000000:1.0:1788872785.610956:0:91000:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788872785.610984:0:91000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.610994:0:91000:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.611003:0:91000:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872785.611012:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82bad80 going to sleep for 0 seconds 00000100:00100000:1.0:1788872785.611016:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327730944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872785.611025:0:91000:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.611031:0:91000:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.611050:0:91000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.611058:0:91000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.611065:0:91000:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.611071:0:91000:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52afa00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872785.611074:0:91000:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.611082:0:91000:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872785.611089:0:91000:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872785.611095:0:91000:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1788872785.611098:0:91000:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788872785.611104:0:91000:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.611111:0:91000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01da712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872785.611141:0:91000:0:(mgc_request.c:1816:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:1.0:1788872785.611144:0:91000:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:0.0:1788872785.614856:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level EVICTED/10 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872785.614872:0:86506:0:(pinger.c:247:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1788872785.616149:0:91009:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.204.139@tcp to MGS@0@lo 00000100:00100000:3.0:1788872785.616155:0:91009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788872785.616160:0:91009:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:3.0:1788872785.616184:0:91009:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:3.0:1788872785.616205:0:91009:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from RECOVER to FULL 10000000:01000000:3.0:1788872785.616207:0:91009:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 10000000:01000000:1.0:1788872785.616283:0:91000:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a8c394c000 from 1 10000000:01000000:1.0:1788872785.616287:0:91000:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788872785.616350:0:91000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.616362:0:91000:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.616372:0:91000:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872785.616395:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327731072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788872785.616463:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.616506:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82bad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788872785.616585:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327731072 00000100:00100000:1.0:1788872785.616592:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327731072 00000100:00100000:1.0:1788872785.616642:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788872785.616650:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:91000:x1875765327731072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872785.616664:0:91008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872785.616679:0:91008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52aec00/0xe4e6e89fb01da720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da719 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.616703:0:91008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52aec00/0xe4e6e89fb01da720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da719 expref: 6 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.616713:0:91008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52aec00/0xe4e6e89fb01da720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da719 expref: 6 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.616722:0:91008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52aec00, rc 0) 00000100:00100000:1.0:1788872785.616771:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:91000:x1875765327731072:12345-0@lo:101:mount.lustre.0 Request processed in 122us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.616786:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788872785.616835:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327731072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872785.616848:0:91000:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.616857:0:91000:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872785.616873:0:91000:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00000100:00080000:3.0:1788872785.616935:0:91009:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:3.0:1788872785.616940:0:91009:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) MGC192.168.204.139@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:0.0:1788872785.617588:0:86506:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.139@tcp 10000000:01000000:0.0:1788872785.617610:0:86506:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1788872785.617614:0:86506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788872785.617615:0:86506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788872785.617617:0:86506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872785.617618:0:86506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872785.617620:0:86506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872785.617622:0:86506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872785.617623:0:86506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788872785.617625:0:86506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872785.617626:0:86506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788872785.617670:0:86506:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788872785.617677:0:86506:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1788872785.617679:0:86506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788872785.617680:0:86506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788872785.617682:0:86506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872785.617683:0:86506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872785.617684:0:86506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872785.617685:0:86506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872785.617686:0:86506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788872785.617687:0:86506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872785.617688:0:86506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788872785.617712:0:86506:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788872785.617717:0:86506:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1788872785.617719:0:86506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788872785.617720:0:86506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788872785.617728:0:86506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872785.617730:0:86506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872785.617730:0:86506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872785.617731:0:86506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872785.617732:0:86506:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872785.617734:0:86506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872785.617734:0:86506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788872785.617759:0:86506:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1788872785.617788:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327731456:0@lo:253:kworker.0 00000100:00100000:0.0:1788872785.617837:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872785.617885:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872785.617906:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327731328:0@lo:253:kworker.0 00000100:00100000:0.0:1788872785.617936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872785.618073:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327731456 00000100:00100000:0.0:1788872785.618080:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327731456 00000100:00100000:0.0:1788872785.618112:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327731328 00000100:00100000:0.0:1788872785.618126:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327731328 00000100:00100000:0.0:1788872785.618141:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788872785.618148:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:3645:x1875765327731456:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788872785.618175:0:91008:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1788872785.618221:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788872785.618228:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:3645:x1875765327731328:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788872785.618245:0:91005:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1788872785.618263:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872785.618275:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327731200:0@lo:253:kworker.0 00000100:00100000:0.0:1788872785.618309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872785.618349:0:91007:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1788872785.618357:0:91007:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1788872785.618959:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327731200 00000100:00100000:3.0:1788872785.618965:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327731200 00000100:00100000:3.0:1788872785.619065:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788872785.619074:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3646:x1875765327731200:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788872785.619092:0:91011:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:0.0:1788872785.619413:0:91010:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788872785.619522:0:91008:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 115 00010000:00010000:1.0:1788872785.620696:0:91000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.620714:0:91000:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872785.620724:0:91000:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788872785.620732:0:91000:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788872785.620739:0:91000:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98a8c394c000 10000000:01000000:1.0:1788872785.620742:0:91000:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788872785.620746:0:91000:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788872785.620760:0:91000:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788872785.620800:0:91000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.620809:0:91000:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.620819:0:91000:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872785.620854:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327731584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788872785.620934:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.620976:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82bad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872785.621304:0:91007:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:3.0:1788872785.621316:0:91007:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:3.0:1788872785.621529:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327731584 00000100:00100000:3.0:1788872785.621537:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327731584 00000100:00100000:1.0:1788872785.621740:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788872785.621869:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:91000:x1875765327731584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872785.621888:0:91012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872785.621915:0:91012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01da72e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da727 expref: -99 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.621943:0:91012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01da72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da727 expref: 10 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.621954:0:91012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01da72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da727 expref: 10 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.621963:0:91012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52aea00, rc 0) 00000100:00100000:1.0:1788872785.622030:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91000:x1875765327731584:12345-0@lo:101:mount.lustre.0 Request processed in 282us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.622037:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788872785.622339:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327731584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872785.622359:0:91000:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872785.622368:0:91000:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872785.622437:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327731712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788872785.622469:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872785.622504:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa954300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872785.622575:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327731712 00000100:00100000:0.0:1788872785.622588:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327731712 00000100:00100000:0.0:1788872785.622618:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788872785.622625:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c733a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91000:x1875765327731712:12345-0@lo:501:mount.lustre.0 20000000:01000000:2.0:1788872785.624426:0:91013:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788872785.624436:0:91013:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788872785.624438:0:91013:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788872785.624441:0:91013:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788872785.624852:0:91013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788872785.625087:0:91008:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788872785.625125:0:91008:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788872785.625508:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c733a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91000:x1875765327731712:12345-0@lo:501:mount.lustre.0 Request processed in 2880us (3035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.625518:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788872785.625677:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327731712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872785.625737:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327731840:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872785.625880:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.625920:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f68c7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872785.625974:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327731840 00000100:00100000:0.0:1788872785.625982:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327731840 00000100:00100000:0.0:1788872785.626025:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788872785.626034:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c733ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91000:x1875765327731840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872785.630810:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c733ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91000:x1875765327731840:12345-0@lo:503:mount.lustre.0 Request processed in 4767us (4919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.630828:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788872785.631009:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327731840:0@lo:503:mount.lustre.0 20000000:01000000:0.0:1788872785.635472:0:91008:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788872785.635492:0:91008:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788872785.635643:0:91010:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788872785.635648:0:91010:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788872785.635675:0:91010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da735 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.635692:0:91010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da735 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788872785.635701:0:91010:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054419s 00010000:00010000:0.0:1788872785.635707:0:91010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da735 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.635715:0:91010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da735 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.635736:0:91010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da735 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.635744:0:91010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da735 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.635750:0:91010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872785.635755:0:91010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da735 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.635763:0:91010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da735 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.635777:0:91010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da735 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.635785:0:91010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da735 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.635791:0:91010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da735 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788872785.636002:0:91005:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788872785.637125:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:3645:x1875765327731456:12345-0@lo:253:kworker.0 Request processed in 18959us (19269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.637138:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1788872785.637251:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788872785.637255:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788872785.637256:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872785.637258:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872785.637259:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872785.637260:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872785.637262:0:3645:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788872785.637264:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872785.637265:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788872785.637269:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327731456:0@lo:253:kworker.0 00000100:00100000:1.0:1788872785.638210:0:91014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91014:1875765327731968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872785.638479:0:91014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.638602:0:91014:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f68c7180 going to sleep for 11 seconds 00000100:00100000:0.0:1788872785.641394:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327731968 00000100:00100000:0.0:1788872785.641412:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327731968 00000100:00100000:3.0:1788872785.641644:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788872785.641656:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7339450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91014:x1875765327731968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872785.642719:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7339450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91014:x1875765327731968:12345-0@lo:502:llog_process_th.0 Request processed in 1061us (4234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.642730:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788872785.642861:0:91014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91014:1875765327731968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788872785.642908:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872785.642925:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872785.642928:0:91014:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788872785.642935:0:91014:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788872785.642938:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788872785.642953:0:91014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98a8c340b380) 00000020:00000080:3.0:1788872785.642977:0:91014:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1788872785.642983:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788872785.643069:0:91014:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788872785.643076:0:91014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da743 00000020:00000080:3.0:1788872785.643532:0:91014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788872785.643537:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872785.643541:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872785.643543:0:91014:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788872785.643546:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872785.643573:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872785.643575:0:91014:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788872785.643578:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788872785.643586:0:91014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98a8c3408000) 00000020:00000080:3.0:1788872785.643599:0:91014:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1788872785.643603:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788872785.643604:0:91014:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788872785.643607:0:91014:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788872785.643613:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788872785.643656:0:91014:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a8c394c000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788872785.643671:0:91014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98a8c1cf8000) 00000020:00000080:3.0:1788872785.643681:0:91014:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1788872785.643731:0:91014:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788872785.643736:0:91014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da758 00000020:00000080:3.0:1788872785.643845:0:91014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788872785.643853:0:91014:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788872785.643859:0:91014:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe4e6e89fb01da75f 00080000:01000000:3.0:1788872785.643864:0:91014:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788872785.643867:0:91014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da766 20000000:01000000:2.0:1788872785.645411:0:91005:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788872785.645431:0:91005:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788872785.647444:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:3645:x1875765327731328:12345-0@lo:253:kworker.0 Request processed in 29206us (29496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872785.647466:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1788872785.647539:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788872785.647542:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788872785.647544:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872785.647545:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872785.647546:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872785.647566:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872785.647567:0:3645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788872785.647569:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872785.647571:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788872785.647576:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327731328:0@lo:253:kworker.0 20000000:01000000:1.0:1788872785.647883:0:91010:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788872785.647899:0:91010:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788872785.647932:0:91010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da76d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.647950:0:91010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da76d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788872785.647963:0:91010:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000073326s 00010000:00010000:1.0:1788872785.647968:0:91010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da76d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.647976:0:91010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da76d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.647984:0:91010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da76d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.647992:0:91010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da76d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.648000:0:91010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52afa00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872785.648004:0:91010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da76d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.648014:0:91010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da76d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.648047:0:91010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da76d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.648056:0:91010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da76d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.648063:0:91010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da76d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788872785.651643:0:91011:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788872785.664661:0:91011:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788872785.664729:0:91011:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788872785.669252:0:91010:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788872785.669265:0:91010:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788872785.669363:0:91010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da774 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.669383:0:91010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da774 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788872785.669393:0:91010:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000129621s 00010000:00010000:1.0:1788872785.669398:0:91010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da774 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.669404:0:91010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da774 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.669413:0:91010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da774 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.669420:0:91010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da774 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.669428:0:91010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872785.669513:0:91010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da774 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.669522:0:91010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da774 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.669536:0:91010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da774 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.669544:0:91010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da774 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.669568:0:91010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52ae400/0xe4e6e89fb01da774 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872785.670312:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3646:x1875765327731200:12345-0@lo:253:kworker.0 Request processed in 51233us (51995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872785.670325:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1788872785.670406:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788872785.670409:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788872785.670411:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872785.670412:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872785.670414:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872785.670416:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872785.670418:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788872785.670420:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872785.670422:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788872785.670426:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327731200:0@lo:253:kworker.0 00010000:00010000:3.0:1788872785.777245:0:91014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1788872785.777392:0:91014:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 idx: 0 lr: 107374182411 srv lr: 111669149696 lx: 0 gen 23 00000001:00080000:3.0:1788872785.777444:0:91014:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149696 lx: 0 gen 22 00000001:00000004:3.0:1788872785.777482:0:91014:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149696 00000001:00080000:3.0:1788872785.777633:0:91014:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788872785.777686:0:91014:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff98a9f9e84240: xid 1875765311169792, transno 111669149703, client gen 23, slot idx 0 00000001:00080000:3.0:1788872785.777697:0:91014:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff98a9f9e84900: xid 1875765311169536, transno 111669149702, client gen 23, slot idx 1 00000020:00000080:3.0:1788872785.778140:0:91014:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98a9e999b380) 00000020:00000080:3.0:1788872785.778162:0:91014:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1788872785.778239:0:91014:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788872785.778246:0:91014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da790 00000020:00000080:1.0:1788872785.794859:0:91014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788872785.804345:0:91014:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe4e6e89fb01da797 00000020:00000080:1.0:1788872785.805109:0:91014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788872785.805132:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872785.805140:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872785.805142:0:91014:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788872785.805146:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788872785.805150:0:91014:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788872785.805160:0:91014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788872785.805162:0:91014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788872785.805163:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788872785.805167:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872785.805168:0:91014:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788872785.805170:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788872785.805176:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872785.805177:0:91014:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788872785.805182:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788872785.805229:0:91014:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788872785.805243:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872785.805246:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872785.805248:0:91014:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788872785.805250:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788872785.805253:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872785.805254:0:91014:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788872785.805257:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788872785.805262:0:91014:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:00000080:1.0:1788872785.805287:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788872785.805304:0:91014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98a9f6713380) 00000020:00000080:1.0:1788872785.805323:0:91014:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788872785.805327:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788872785.805385:0:91014:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788872785.805391:0:91014:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788872785.805397:0:91014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da7a5 00010000:00080000:1.0:1788872785.805430:0:91014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9ff638000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:1.0:1788872785.814202:0:91014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1788872785.817519:0:91014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872785.817533:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788872785.817593:0:91014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788872785.817621:0:91014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da7ac 00000100:00080000:1.0:1788872785.817632:0:91014:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788872785.817638:0:91014:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98a9ff638000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872785.817687:0:91014:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ee81df80 x1875765327732096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872785.817717:0:91014:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788872785.817908:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327732224:0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.817982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872785.818130:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327732096:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788872785.818171:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872785.818234:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327732224 00000100:00100000:0.0:1788872785.818241:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327732224 00000100:00100000:0.0:1788872785.818281:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788872785.818291:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3646:x1875765327732224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872785.818341:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3646:x1875765327732224:12345-0@lo:400:kworker.0 Request processed in 51us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.818348:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788872785.818500:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327732096 00000100:00100000:2.0:1788872785.818504:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327732096 00000100:00100000:2.0:1788872785.818536:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1788872785.818542:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327732096:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788872785.818581:0:8447:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3722 last 0 00000020:00000080:2.0:1788872785.818613:0:8447:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da7b3 00000004:00100000:2.0:1788872785.818628:0:8447:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788872785.818749:0:8447:0:(import.c:65:import_set_state_nolock()) ffff98a9ff60d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872785.818792:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327732096:12345-0@lo:38:llog_process_th.0 Request processed in 249us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872785.818805:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:0.0:1788872785.819028:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788872785.819036:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1788872785.819042:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788872785.819048:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788872785.819050:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ff638000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788872785.819076:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327732224:0@lo:400:kworker.0 00000020:01000000:1.0:1788872785.819680:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872785.819687:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872785.819690:0:91014:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788872785.819694:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788872785.819697:0:91014:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788872785.819698:0:91014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788872785.819700:0:91014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788872785.819702:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788872785.819704:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872785.819705:0:91014:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788872785.819709:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788872785.819714:0:91014:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788872785.819717:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872785.819718:0:91014:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788872785.819721:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788872785.819725:0:91014:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:1.0:1788872785.819746:0:91014:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788872785.819749:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788872785.819766:0:91014:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98a9f6714d40) 00000020:00000080:1.0:1788872785.819805:0:91014:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788872785.819812:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788872785.819895:0:91014:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788872785.819901:0:91014:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788872785.819908:0:91014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da7c1 00010000:00080000:1.0:1788872785.819937:0:91014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9dfe95000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:1.0:1788872785.820176:0:91014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:1.0:1788872785.821381:0:91014:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788872785.821417:0:91014:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788872785.822144:0:91014:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000100:00100000:2.0:1788872785.823021:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327732352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872785.823100:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.823269:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327732352 00000100:00100000:1.0:1788872785.823280:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327732352 00000100:00100000:1.0:1788872785.823340:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:1.0:1788872785.823349:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327732352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872785.823387:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872785.823440:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327732352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.823447:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:1.0:1788872785.823497:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327732352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872785.823504:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327732096:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788872785.824305:0:91014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788872785.824336:0:91014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:2.0:1788872785.824485:0:91014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:2.0:1788872785.829458:0:91020:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:2.0:1788872785.829467:0:91020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1788872785.829710:0:91020:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:2.0:1788872785.829731:0:91020:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1788872785.830046:0:91020:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:2.0:1788872785.830049:0:91020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788872785.831598:0:91014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872785.831613:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788872785.831662:0:91014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788872785.831687:0:91014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da7c8 00000100:00080000:3.0:1788872785.831699:0:91014:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788872785.831705:0:91014:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98a9dfe95000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872785.831746:0:91014:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3a62300 x1875765327732480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872785.831767:0:91014:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788872785.831834:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872785.831849:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872785.831851:0:91014:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788872785.831854:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788872785.831857:0:91014:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788872785.831859:0:91014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788872785.831860:0:91014:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788872785.831861:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788872785.831864:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872785.831865:0:91014:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788872785.831874:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788872785.831889:0:91014:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788872785.831966:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872785.831968:0:91014:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788872785.831972:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788872785.831976:0:91014:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:3.0:1788872785.832002:0:91014:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788872785.832005:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788872785.832016:0:91014:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98a9e99999c0) 00000020:00000080:3.0:1788872785.832035:0:91014:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788872785.832040:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788872785.832104:0:91014:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788872785.832121:0:91014:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788872785.832129:0:91014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01da7d6 00010000:00080000:3.0:1788872785.832164:0:91014:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a8c6774000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:3.0:1788872785.832355:0:91014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1788872785.832427:0:91014:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788872785.832442:0:91014:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788872785.833306:0:91014:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000100:00100000:0.0:1788872785.833713:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327732480:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788872785.833790:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.834081:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327732480 00000100:00100000:1.0:1788872785.834091:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327732480 00000100:00100000:1.0:1788872785.834148:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5970 00000100:00100000:1.0:1788872785.834156:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3643:x1875765327732480:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788872785.834190:0:26191:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3722 last 0 00000020:00000080:1.0:1788872785.834222:0:26191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da7dd 00002000:00100000:1.0:1788872785.834235:0:26191:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98a9dfe94000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788872785.834239:0:26191:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788872785.834242:0:26191:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788872785.834306:0:26191:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788872785.834334:0:26191:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872785.834404:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327732480:12345-0@lo:8:llog_process_th.0 Request processed in 247us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.834412:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5970 00000100:00100000:2.0:1788872785.834498:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788872785.834509:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788872785.834517:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788872785.834521:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788872785.834525:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe95000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788872785.834575:0:3643:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:2.0:1788872785.834582:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327732480:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1788872785.834610:0:91020:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788872785.834667:0:91020:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3722961116979ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788872785.834673:0:91020:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788872785.836586:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872785.836603:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327732608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872785.836664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.836721:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327732608 00000100:00100000:2.0:1788872785.836729:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327732608 00000100:00100000:2.0:1788872785.836782:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:2.0:1788872785.836791:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caaba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327732608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872785.836818:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872785.836874:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caaba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327732608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872785.836890:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00080000:2.0:1788872785.837027:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872785.837075:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327732608:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788872785.838693:0:91014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788872785.838729:0:91014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:0.0:1788872785.840193:0:91014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000040:00080000:2.0:1788872785.841438:0:91022:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:2.0:1788872785.841444:0:91022:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1788872785.841655:0:91022:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000040:00080000:2.0:1788872785.841684:0:91022:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1788872785.841807:0:91022:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:2.0:1788872785.841811:0:91022:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1788872785.843619:0:91001:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:0.0:1788872785.844480:0:91014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872785.844497:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788872785.844546:0:91014:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788872785.844611:0:91014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da7e4 00000100:00080000:0.0:1788872785.844623:0:91014:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788872785.844629:0:91014:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98a8c6774000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872785.844670:0:91014:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c6c95180 x1875765327732736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872785.844693:0:91014:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788872785.844824:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872785.844829:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872785.844830:0:91014:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788872785.844834:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872785.844852:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872785.844854:0:91014:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788872785.844858:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788872785.844860:0:91014:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788872785.844863:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872785.844865:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872785.844866:0:91014:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788872785.844869:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872785.844871:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872785.844873:0:91014:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788872785.844888:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788872785.844936:0:91014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c94000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91014:1875765327732864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872785.845025:0:91014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872785.845072:0:91014:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f033ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788872785.845164:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327732736:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788872785.845205:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872785.845396:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327732736 00000100:00100000:0.0:1788872785.845403:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327732736 00000100:00100000:0.0:1788872785.845442:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5971 00000100:00100000:0.0:1788872785.845449:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3643:x1875765327732736:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788872785.845476:0:26194:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3722 last 0 00000020:00000080:0.0:1788872785.845501:0:26194:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01da7eb 00002000:00100000:0.0:1788872785.845516:0:26194:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98a9e99ab000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788872785.845520:0:26194:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788872785.845523:0:26194:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788872785.845617:0:26194:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788872785.845640:0:26194:0:(import.c:65:import_set_state_nolock()) ffff98a9e99ae000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872785.845694:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327732736:12345-0@lo:8:llog_process_th.0 Request processed in 243us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.845709:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5971 00000100:00100000:0.0:1788872785.845749:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788872785.845757:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788872785.845764:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788872785.845769:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788872785.845771:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c6774000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788872785.845863:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327732864 00000100:00100000:1.0:1788872785.845867:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327732864 00000100:00100000:1.0:1788872785.845907:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788872785.845921:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:91014:x1875765327732864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872785.846028:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:91014:x1875765327732864:12345-0@lo:502:llog_process_th.0 Request processed in 107us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.846035:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788872785.846493:0:91014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c94000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91014:1875765327732864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872785.846524:0:91014:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872785.846529:0:91014:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872785.846531:0:91014:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788872785.846536:0:91014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788872785.846747:0:91000:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788872785.846773:0:91000:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788872785.846789:0:91000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.846801:0:91000:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872785.846810:0:91000:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a8c394c000 from 1 10000000:01000000:2.0:1788872785.846820:0:91000:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788872785.846865:0:91000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.846874:0:91000:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.846906:0:91000:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872785.846925:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caabad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327732992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788872785.846971:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.846999:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c8784c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788872785.847025:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327732992 00000100:00100000:2.0:1788872785.847030:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327732992 00000100:00100000:2.0:1788872785.847070:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788872785.847078:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:91000:x1875765327732992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872785.847089:0:91011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872785.847103:0:91011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01da7f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da7f2 expref: -99 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.847133:0:91011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01da7f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da7f2 expref: 9 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.847143:0:91011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01da7f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da7f2 expref: 9 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.847151:0:91011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58ae600, rc 0) 00000100:00100000:2.0:1788872785.847179:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:91000:x1875765327732992:12345-0@lo:101:mount.lustre.0 Request processed in 102us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872785.847194:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788872785.847230:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caabad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327732992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872785.847543:0:91000:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da7f9 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.847579:0:91000:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da7f9 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872785.848123:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caabad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327733120:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788872785.848173:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.848207:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c8784c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872785.848301:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327733120 00000100:00100000:1.0:1788872785.848308:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327733120 00000100:00100000:1.0:1788872785.848341:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788872785.848349:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:91000:x1875765327733120:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788872785.848365:0:91012:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788872785.848383:0:91012:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788872785.848387:0:91012:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788872785.848389:0:91012:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788872785.848391:0:91012:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 118 00000100:00100000:1.0:1788872785.848470:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:91000:x1875765327733120:12345-0@lo:256:mount.lustre.0 Request processed in 121us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.848477:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788872785.853693:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caabad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327733120:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788872785.856586:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872785.856608:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327733248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872785.856686:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872785.857040:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327733248 00000100:00100000:3.0:1788872785.857050:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327733248 10000000:01000000:2.0:1788872785.857215:0:91000:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788872785.857244:0:91000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da7f9 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.857257:0:91000:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da7f9 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872785.857266:0:91000:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a8c394c000 from 1 10000000:01000000:2.0:1788872785.857269:0:91000:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788872785.857300:0:91000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.857308:0:91000:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.857336:0:91000:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872785.857352:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caabad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327733376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788872785.857392:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.857418:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c8784c00 going to sleep for 11 seconds 00000100:00080000:2.0:1788872785.857443:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872785.858523:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:3.0:1788872785.858541:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327733248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872785.858585:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872785.858652:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327733248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872785.858659:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000004:00080000:0.0:1788872785.859037:0:3643:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:0.0:1788872785.859048:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327732736:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1788872785.860604:0:91022:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788872785.860714:0:91022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3722987163139ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788872785.860723:0:91022:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788872785.861771:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327733376 00000100:00100000:2.0:1788872785.861785:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327733376 00000100:00100000:2.0:1788872785.861856:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788872785.861866:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:91000:x1875765327733376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872785.861892:0:91005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872785.861918:0:91005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c58ae200/0xe4e6e89fb01da807 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da800 expref: -99 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.861943:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c58ae200/0xe4e6e89fb01da807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da800 expref: 10 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.861954:0:91005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c58ae200/0xe4e6e89fb01da807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da800 expref: 10 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.861962:0:91005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58ae200, rc 0) 00000100:00100000:2.0:1788872785.862045:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91000:x1875765327733376:12345-0@lo:101:mount.lustre.0 Request processed in 182us (4652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872785.862053:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788872785.862152:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caabad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327733376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872785.862173:0:91000:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.862183:0:91000:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872785.862262:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caabad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327733504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872785.862299:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.862336:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3771b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872785.862652:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327733504 00000100:00100000:0.0:1788872785.862658:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327733504 00000100:00100000:0.0:1788872785.862687:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788872785.862694:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91000:x1875765327733504:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788872785.862872:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91000:x1875765327733504:12345-0@lo:501:mount.lustre.0 Request processed in 178us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.863026:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788872785.866826:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caabad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327733504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872785.866916:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caabad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327733632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872785.867009:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.867051:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3771b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872785.869536:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327733632 00000100:00100000:1.0:1788872785.869568:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327733632 00000100:00100000:1.0:1788872785.869623:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788872785.869633:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91000:x1875765327733632:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872785.869803:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91000:x1875765327733632:12345-0@lo:503:mount.lustre.0 Request processed in 170us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.869811:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788872785.870137:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327733248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872785.871160:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caabad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327733632:0@lo:503:mount.lustre.0 00000004:00080000:0.0:1788872785.872002:0:91001:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788872785.883953:0:91024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91024:1875765327733760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872785.884050:0:91024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.884097:0:91024:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7119c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872785.884166:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327733760 00000100:00100000:0.0:1788872785.884176:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327733760 00000100:00100000:0.0:1788872785.884240:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788872785.884250:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91024:x1875765327733760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872785.885610:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91024:x1875765327733760:12345-0@lo:502:llog_process_th.0 Request processed in 1357us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.885622:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788872785.885755:0:91024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91024:1875765327733760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788872785.885792:0:91024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872785.885802:0:91024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872785.885804:0:91024:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788872785.885812:0:91024:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a8c394c000 00000020:00000080:2.0:1788872785.885815:0:91024:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788872785.885824:0:91024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872785.885826:0:91024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872785.885828:0:91024:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788872785.885830:0:91024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872785.885833:0:91024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872785.885834:0:91024:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788872785.885837:0:91024:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a8c394c000 00000020:00000080:2.0:1788872785.885852:0:91024:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788872785.885975:0:91024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caabb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91024:1875765327733888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872785.886020:0:91024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.886062:0:91024:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3771480 going to sleep for 11 seconds 00000100:00100000:1.0:1788872785.889710:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327733888 00000100:00100000:1.0:1788872785.889724:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327733888 00000100:00100000:1.0:1788872785.889836:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788872785.889849:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91024:x1875765327733888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872785.890172:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91024:x1875765327733888:12345-0@lo:502:llog_process_th.0 Request processed in 326us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.890180:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788872785.890247:0:91024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caabb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91024:1875765327733888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872785.890280:0:91024:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872785.890288:0:91024:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872785.890291:0:91024:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788872785.890295:0:91024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788872785.892423:0:91000:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788872785.892464:0:91000:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788872785.892535:0:91000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872785.892590:0:91000:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872785.892651:0:91000:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788872785.892655:0:91000:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98a8c394c000 10000000:01000000:3.0:1788872785.892658:0:91000:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98a8c394c000 10000000:01000000:3.0:1788872785.892663:0:91000:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788872785.892669:0:91000:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a8c394c000 from 1 10000000:01000000:3.0:1788872785.892672:0:91000:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788872785.892711:0:91000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872785.892720:0:91000:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872785.892731:0:91000:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872785.892761:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327734016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788872785.892835:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872785.892874:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c4e3d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872785.896828:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327734016 00000100:00100000:1.0:1788872785.896855:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327734016 00000100:00100000:1.0:1788872785.896938:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788872785.896948:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:91000:x1875765327734016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872785.896964:0:91007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872785.896996:0:91007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da80e expref: -99 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.897024:0:91007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da80e expref: 11 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.897035:0:91007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da80e expref: 11 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.897043:0:91007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52afa00, rc 0) 00000100:00100000:1.0:1788872785.897124:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91000:x1875765327734016:12345-0@lo:101:mount.lustre.0 Request processed in 178us (4289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.897130:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788872785.897508:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327734016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872785.897527:0:91000:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872785.897537:0:91000:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872785.897658:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327734144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788872785.897702:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872785.897735:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c4e3d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872785.897797:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327734144 00000100:00100000:1.0:1788872785.897802:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327734144 00000100:00100000:1.0:1788872785.897831:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788872785.897849:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91000:x1875765327734144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872785.898001:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91000:x1875765327734144:12345-0@lo:501:mount.lustre.0 Request processed in 163us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.898008:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788872785.898233:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327734144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788872785.898260:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327734272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788872785.898300:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872785.898328:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c4e3d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872785.901176:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327734272 00000100:00100000:1.0:1788872785.901193:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327734272 00000100:00100000:1.0:1788872785.901266:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788872785.901279:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91000:x1875765327734272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872785.901470:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91000:x1875765327734272:12345-0@lo:503:mount.lustre.0 Request processed in 193us (3167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.901478:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788872785.901544:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327734272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788872785.902589:0:91027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91027:1875765327734400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872785.902654:0:91027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872785.902691:0:91027:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c4e3d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872785.903395:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327734400 00000100:00100000:1.0:1788872785.903403:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327734400 00000100:00100000:1.0:1788872785.903452:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788872785.903460:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91027:x1875765327734400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872785.903607:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91027:x1875765327734400:12345-0@lo:502:llog_process_th.0 Request processed in 147us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.903614:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788872785.906753:0:91027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91027:1875765327734400:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788872785.906840:0:91027:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788872785.906862:0:91027:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98a8c72e99c0) 00000020:00000080:0.0:1788872785.906890:0:91027:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788872785.907091:0:91027:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a8c394c000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788872785.907096:0:91027:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a8c394c000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788872785.907098:0:91027:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a8c394c000 4 00010000:00080000:0.0:1788872785.907142:0:91027:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9c9892800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:0.0:1788872785.908741:0:91027:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1788872785.908835:0:91027:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788872785.908880:0:91027:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788872785.908894:0:91027:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe4e6e89fb01da823 00000100:00080000:0.0:1788872785.908905:0:91027:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788872785.908910:0:91027:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98a9c9892800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872785.908945:0:91027:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c6c95180 x1875765327734528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872785.908993:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327734528:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788872785.909062:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872785.909158:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327734528 00000100:00100000:0.0:1788872785.909165:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327734528 00000100:00100000:0.0:1788872785.909197:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1788872785.909204:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327734528:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788872785.909276:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327734528:12345-0@lo:38:llog_process_th.0 Request processed in 70us (214us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788872785.909283:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1788872785.909396:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788872785.909403:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9c9892800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872785.909419:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788872785.909422:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327734528:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788872785.909455:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872785.909460:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872785.909462:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872785.909466:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3722 00000100:00080000:0.0:1788872785.909468:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872785.909472:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872785.909487:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c6c95180 x1875765327734656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872785.913914:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327734784:0@lo:400:kworker.0 00000100:00100000:3.0:1788872785.913998:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872785.914064:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327734784 00000100:00100000:3.0:1788872785.914071:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327734784 00000100:00100000:3.0:1788872785.914130:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:3.0:1788872785.914139:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327734784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872785.914192:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327734784:12345-0@lo:400:kworker.0 Request processed in 55us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872785.914199:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:3.0:1788872785.914241:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327734784:0@lo:400:kworker.0 00000100:00100000:1.0:1788872785.915194:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327734656:0@lo:38:kworker.0 00000100:00100000:1.0:1788872785.915245:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872785.915958:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327734656 00000100:00100000:3.0:1788872785.915965:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327734656 00000100:00100000:3.0:1788872785.916003:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1788872785.916010:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327734656:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788872785.916082:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327734656:12345-0@lo:38:kworker.0 Request processed in 70us (835us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788872785.916089:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00080000:1.0:1788872785.916168:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872785.916173:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788872785.916176:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327734656:0@lo:38:kworker.0 00000100:00080000:0.0:1788872785.918317:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872785.918330:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872785.918334:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872785.918342:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3722 00000100:00080000:0.0:1788872785.918347:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872785.918353:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872785.918398:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c6c95500 x1875765327734912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872785.918453:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872785.918457:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872785.918459:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872785.918462:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3722 00000100:00080000:0.0:1788872785.918465:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872785.918468:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872785.918487:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327735040:0@lo:400:kworker.0 00000100:00100000:1.0:1788872785.918804:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327734912:0@lo:38:kworker.0 00000100:00100000:0.0:1788872785.918953:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872785.919051:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9faa7b100 x1875765327735168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872785.919105:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872785.919119:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872785.919121:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872785.919126:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3722 00000100:00080000:0.0:1788872785.919128:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872785.919132:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872785.919145:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8ca109180 x1875765327735552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872785.919169:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872785.919176:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327735680:0@lo:400:kworker.0 00000100:00100000:0.0:1788872785.919206:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.919522:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327735424:0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.919594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.919620:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872785.919625:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327735296:0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.919648:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.919683:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327735424 00000100:00100000:2.0:1788872785.919690:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327735424 00000100:00100000:2.0:1788872785.919736:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327735296 00000100:00100000:2.0:1788872785.919739:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327735296 00000100:00100000:2.0:1788872785.919761:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:2.0:1788872785.919770:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327735424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.919818:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327735424:12345-0@lo:400:kworker.0 Request processed in 49us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872785.919826:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:0.0:1788872785.919991:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327735680 00000100:00100000:0.0:1788872785.919996:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327735680 00000100:00100000:0.0:1788872785.920025:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:0.0:1788872785.920032:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327735680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872785.920078:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327735680:12345-0@lo:400:kworker.0 Request processed in 46us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.920084:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000100:00100000:0.0:1788872785.920106:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:0.0:1788872785.920126:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327735296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872785.920159:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327735296:12345-0@lo:400:kworker.0 Request processed in 36us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.920165:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:0.0:1788872785.920207:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327735680:0@lo:400:kworker.0 00000100:00100000:1.0:1788872785.920344:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327735040 00000100:00100000:1.0:1788872785.920349:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327735040 00000100:00100000:2.0:1788872785.920517:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327735296:0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.920529:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327735424:0@lo:400:kworker.0 00000100:00100000:3.0:1788872785.922650:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872785.928144:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327735168:0@lo:38:kworker.0 00000100:00100000:3.0:1788872785.928214:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872785.928255:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327735552:0@lo:38:kworker.0 00000100:00100000:3.0:1788872785.928282:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.930453:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327734912 00000100:00100000:1.0:1788872785.930468:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327734912 00000100:00100000:1.0:1788872785.930490:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327735168 00000100:00100000:1.0:1788872785.930493:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327735168 00000100:00100000:1.0:1788872785.930543:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:1.0:1788872785.930566:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327735168:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788872785.930661:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327735168:12345-0@lo:38:kworker.0 Request processed in 95us (2446us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788872785.930669:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:1.0:1788872785.930722:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:1.0:1788872785.930732:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327735040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872785.930792:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327735040:12345-0@lo:400:kworker.0 Request processed in 62us (11838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.930798:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:1.0:1788872785.930815:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1788872785.930820:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327734912:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788872785.930867:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327734912:12345-0@lo:38:kworker.0 Request processed in 46us (8224us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788872785.930874:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00080000:1.0:1788872785.932825:0:91027:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788872785.934779:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327735808:0@lo:400:kworker.0 00000100:00100000:1.0:1788872785.934882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.934950:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327735040:0@lo:400:kworker.0 00000100:00100000:1.0:1788872785.934999:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327735808 00000100:00100000:1.0:1788872785.935006:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327735808 00000100:00100000:1.0:1788872785.935052:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:1.0:1788872785.935061:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327735808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872785.935127:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327735808:12345-0@lo:400:kworker.0 Request processed in 65us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.935134:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00000100:00100000:1.0:1788872785.935169:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327735808:0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.935595:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872785.935609:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327735936:0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.935645:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.935678:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327735936 00000100:00100000:2.0:1788872785.935682:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327735936 00000100:00100000:2.0:1788872785.935711:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:2.0:1788872785.935718:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327735936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872785.935766:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327735936:12345-0@lo:400:kworker.0 Request processed in 48us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872785.935773:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:2.0:1788872785.935804:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327735936:0@lo:400:kworker.0 00000100:00080000:3.0:1788872785.936130:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872785.936136:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788872785.936140:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327734912:0@lo:38:kworker.0 00000100:00080000:3.0:1788872785.936164:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872785.936168:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788872785.936171:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327735168:0@lo:38:kworker.0 00000100:00100000:2.0:1788872785.936378:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327735552 00000100:00100000:2.0:1788872785.936383:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327735552 00000100:00100000:2.0:1788872785.936418:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1788872785.936423:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327735552:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788872785.936659:0:91027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91027:1875765327736064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872785.936716:0:91027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.936744:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327736064 00000100:00100000:1.0:1788872785.936747:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327736064 00000100:00100000:1.0:1788872785.936778:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788872785.936793:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91027:x1875765327736064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872785.936909:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91027:x1875765327736064:12345-0@lo:502:llog_process_th.0 Request processed in 118us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.936916:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788872785.936956:0:91027:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788872785.936971:0:91027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91027:1875765327736064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872785.937005:0:91027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91027:1875765327736192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872785.937037:0:91027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.937052:0:91027:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788872785.937236:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327735552:12345-0@lo:38:kworker.0 Request processed in 811us (8952us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788872785.937243:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00080000:3.0:1788872785.937382:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872785.937386:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788872785.937390:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327735552:0@lo:38:kworker.0 00000100:00100000:0.0:1788872785.937468:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327736192 00000100:00100000:0.0:1788872785.937472:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327736192 00000100:00100000:0.0:1788872785.937539:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788872785.937576:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91027:x1875765327736192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872785.937679:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91027:x1875765327736192:12345-0@lo:502:llog_process_th.0 Request processed in 133us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.937686:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788872785.937802:0:91027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91027:1875765327736192:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788872785.937825:0:91027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788872785.937956:0:91000:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788872785.937978:0:91000:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788872785.937994:0:91000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872785.938006:0:91000:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788872785.938065:0:91000:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788872785.938068:0:91000:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788872785.938070:0:91000:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872785.938071:0:91000:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872785.938072:0:91000:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872785.938073:0:91000:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872785.938075:0:91000:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788872785.938076:0:91000:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788872785.938078:0:91000:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872785.938080:0:91000:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788872785.938084:0:91000:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788872785.938086:0:91000:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788872785.938092:0:91000:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788872785.938093:0:91000:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872785.938094:0:91000:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872785.938095:0:91000:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872785.938096:0:91000:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872785.938096:0:91000:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788872785.938097:0:91000:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788872785.938098:0:91000:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872785.938099:0:91000:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788872785.938126:0:91000:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788872785.938137:0:91000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8caab9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327736320:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788872785.938171:0:91000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872785.938468:0:91000:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3771900 going to sleep for 11 seconds 00000100:00100000:1.0:1788872785.938500:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327736320 00000100:00100000:1.0:1788872785.938505:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327736320 00000100:00100000:1.0:1788872785.938535:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788872785.938543:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91000:x1875765327736320:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788872785.938583:0:91012:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788872785.938597:0:91012:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788872785.946070:0:91012:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788872785.946096:0:91012:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788872785.946475:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:91000:x1875765327736320:12345-0@lo:253:mount.lustre.0 Request processed in 7927us (8298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.946488:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788872785.946648:0:91000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8caab9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:91000:1875765327736320:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788872785.946663:0:91000:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788872785.946667:0:91000:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788872785.946669:0:91000:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788872785.946670:0:91000:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872785.946683:0:91000:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872785.946697:0:91000:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872785.946698:0:91000:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872785.946700:0:91000:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788872785.946701:0:91000:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788872785.946704:0:91000:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872785.946705:0:91000:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788872785.946725:0:91000:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788872785.947770:0:91010:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788872785.947776:0:91010:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788872785.947799:0:91010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.947816:0:91010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01da7f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da7f2 expref: 10 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.947825:0:91010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.947861:0:91010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01da7f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01da7f2 expref: 10 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.947876:0:91010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01da7f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01da7f2 expref: 10 pid: 91011 timeout: 3823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872785.947900:0:91010:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:91010:1875765327736448:0@lo:104: 00000100:00100000:0.0:1788872785.947953:0:91010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872785.948009:0:91010:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f68c7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872785.948150:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327736448 00000100:00100000:1.0:1788872785.948158:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327736448 00000100:00100000:1.0:1788872785.948201:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788872785.948210:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:91010:x1875765327736448:12345-0@lo:104: 00010000:00010000:1.0:1788872785.948223:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01da7f9 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948306:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788872785.948312:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:91010:x1875765327736448:12345-0@lo:104: Request processed in 103us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.948320:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00010000:1.0:1788872785.948345:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872785.948351:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01da7f9 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948358:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872785.948361:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01da7f9 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948371:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01da7f9 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872785.948377:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01da7f9 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872785.948383:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788872785.948414:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01da7f9 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948421:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872785.948444:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01da7f9 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948451:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c58af400/0xe4e6e89fb01da7f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01da7f9 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948476:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872785.948478:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872785.948480:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872785.948492:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327736576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872785.948521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872785.948587:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327736576 00000100:00100000:1.0:1788872785.948592:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327736576 00010000:00010000:1.0:1788872785.948608:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01da7f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01da7f2 expref: 11 pid: 91011 timeout: 3823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872785.948630:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1788872785.948636:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:3645:x1875765327736576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872785.948647:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872785.948652:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01da7f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01da7f2 expref: 11 pid: 91011 timeout: 3823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948662:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01da7f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01da7f2 expref: 11 pid: 91011 timeout: 3823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948679:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948686:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788872785.948700:0:7929:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000924530s 00010000:00010000:1.0:1788872785.948705:0:7929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948722:0:7929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948729:0:7929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948735:0:7929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948740:0:7929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872785.948743:0:7929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948750:0:7929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948758:0:7929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872785.948767:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872785.948798:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:3645:x1875765327736576:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.948805:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1788872785.948841:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327736576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872785.949124:0:91010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c58ae600/0xe4e6e89fb01da7f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01da7f2 expref: 10 pid: 91011 timeout: 3823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872785.949147:0:91010:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:91010:1875765327736448:0@lo:104: 00010000:00010000:0.0:1788872785.949162:0:91010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.949171:0:91010:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.949177:0:91010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872785.949183:0:91010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8cc3e6c00/0xe4e6e89fb01da82a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788872785.967907:0:91000:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411353 00000040:01000000:0.0:1788872785.977996:0:91000:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788872785.978118:0:91032:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411353 00000020:00080000:1.0:1788872785.978124:0:91032:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411353 00000040:01000000:3.0:1788872785.978985:0:91033:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788872785.979191:0:91000:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788872785.980005:0:91033:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788872785.981760:0:91034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91034:1875765327736704:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788872785.981836:0:91034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872785.981868:0:91034:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73ec300 going to sleep for 11 seconds 00000040:01000000:2.0:1788872785.982400:0:91000:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788872785.982440:0:91000:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788872785.982900:0:91000:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788872785.982909:0:91000:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788872785.982950:0:91000:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788872785.983927:0:91000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788872785.984491:0:91000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788872785.984528:0:91000:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788872785.984643:0:91000:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788872785.985024:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327736704 00000100:00100000:0.0:1788872785.985035:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327736704 00000100:00100000:0.0:1788872785.985085:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:0.0:1788872785.985095:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91034:x1875765327736704:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788872785.985257:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91034:x1875765327736704:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 163us (3419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872785.985265:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000040:00080000:1.0:1788872785.986591:0:91033:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788872785.986687:0:91033:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788872785.987368:0:91034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91034:1875765327736704:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788872785.987414:0:91034:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788872785.987463:0:91034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91034:1875765327736832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788872785.987526:0:91034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872785.987590:0:91034:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73ec300 going to sleep for 11 seconds 00080000:10000000:2.0:1788872785.988264:0:91000:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00000100:00100000:1.0:1788872785.989008:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327736832 00000100:00100000:1.0:1788872785.989018:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327736832 00000100:00100000:1.0:1788872785.989140:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:1.0:1788872785.989151:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91034:x1875765327736832:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788872785.990066:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91034:x1875765327736832:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 915us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872785.990075:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00000100:00100000:0.0:1788872785.990182:0:91034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91034:1875765327736832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788872785.990307:0:91034:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91034:1875765327736960:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788872785.990350:0:91034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788872785.994789:0:91000:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149703 00000100:00100000:2.0:1788872785.996163:0:91034:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef8a0600 going to sleep for 11 seconds 00010000:00080000:2.0:1788872786.000911:0:91035:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 91035 00010000:02000000:2.0:1788872786.000933:0:91035:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000100:00100000:3.0:1788872786.002848:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327736960 00000100:00100000:3.0:1788872786.002865:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327736960 00000100:00100000:3.0:1788872786.002998:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:3.0:1788872786.003008:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fbfc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91034:x1875765327736960:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788872786.003182:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fbfc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91034:x1875765327736960:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 174us (12829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872786.003190:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00000100:00100000:3.0:1788872786.003501:0:91034:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91034:1875765327736960:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788872786.003591:0:91034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:0.0:1788872786.018608:0:91000:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788872786.018632:0:91000:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788872786.018650:0:91000:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788872786.018673:0:91000:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788872786.021747:0:91000:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000040:00080000:3.0:1788872786.022402:0:91034:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788872786.022486:0:91034:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1788872786.022490:0:91034:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1788872786.025095:0:91000:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:3.0:1788872786.046619:0:91035:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788872786.046626:0:91035:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1788872786.212462:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872786.212507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872786.212527:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872786.212568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872786.212666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872786.212710:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311180288 00000100:00100000:2.0:1788872786.212728:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311180288 00000100:00100000:2.0:1788872786.212782:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311180160 00000100:00100000:2.0:1788872786.212786:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311180160 00000100:00100000:2.0:1788872786.217791:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1291 00000100:00100000:2.0:1788872786.217817:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caabb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311180288:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872786.217962:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caabb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311180288:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 154us (5512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872786.217971:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1291 00000100:00100000:2.0:1788872786.217995:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1275 00000100:00100000:2.0:1788872786.218000:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875765311180160:12345-192.168.204.39@tcp:38:kworker.0 00010000:00080000:2.0:1788872786.218029:0:66192:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '2a005fe2-2a3d-4ca6-8402-a633d5d16eb3' at ffff98a9ef255000, cookie 0xe4e6e89fb01da77b 00010000:00080000:2.0:1788872786.218034:0:66192:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp recovering/t111669149704 exp ffff98a9ef255000 cur 3723 last 1788872785 00010000:02000400:2.0:1788872786.218043:0:66192:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:3.0:1788872786.225054:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311180672 00000100:00100000:3.0:1788872786.225071:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311180672 00000100:00100000:3.0:1788872786.225134:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 25 00000100:00100000:3.0:1788872786.225143:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2403:x1875765311180672:12345-192.168.204.39@tcp:250:kworker.0 00010000:00080000:3.0:1788872786.225173:0:91007:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 8a09bb38-f574-4ce9-b65f-ec6facc58f7e@192.168.204.39@tcp t0 exp 0000000000000000 cur 3723 last 0 00000020:00000080:3.0:1788872786.225459:0:91007:0:(genops.c:1406:class_connect()) connect: client 8a09bb38-f574-4ce9-b65f-ec6facc58f7e, cookie 0xe4e6e89fb01da831 00000100:00080000:3.0:1788872786.225636:0:91007:0:(import.c:65:import_set_state_nolock()) ffff98a8c5115800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872786.225820:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+5:2403:x1875765311180672:12345-192.168.204.39@tcp:250:kworker.0 Request processed in 675us (13151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872786.225828:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 25 00000100:00100000:3.0:1788872786.225870:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311180416 00000100:00100000:3.0:1788872786.225874:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311180416 00000100:00100000:3.0:1788872786.225967:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311180544 00000100:00100000:3.0:1788872786.225971:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311180544 00000100:00100000:3.0:1788872786.225993:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2613 00000100:00100000:3.0:1788872786.226000:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311180416:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872786.226032:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311180416:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 33us (13525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872786.226037:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2613 00000100:00100000:3.0:1788872786.226047:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2614 00000100:00100000:3.0:1788872786.226052:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8caab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311180544:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872786.226071:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311180544:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 19us (13522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872786.226076:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2614 00000100:00080000:3.0:1788872786.226138:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872786.226142:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872786.226143:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788872786.235674:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788872786.241795:0:66192:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788872786.241827:0:66192:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788872786.241992:0:66192:0:(import.c:65:import_set_state_nolock()) ffff98a9c4c3b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872786.242078:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8caab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311180160:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 24074us (29548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872786.242089:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1275 00000100:00100000:2.0:1788872786.252143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872786.252201:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311170688 00000100:00100000:2.0:1788872786.252212:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311170688 00000100:00100000:2.0:1788872786.252271:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1276 00000100:00100000:2.0:1788872786.252282:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311170688:12345-192.168.204.39@tcp:36:mcreate.0 00010000:00080000:2.0:1788872786.252304:0:66193:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149704, current: 111669149704, replaying 00000100:00100000:2.0:1788872786.252325:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311170688:12345-192.168.204.39@tcp:36:mcreate.0 Request processed in 46us (193us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788872786.252332:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1276 00010000:00080000:3.0:1788872786.252404:0:91035:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:3.0:1788872787.130002:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788872787.130012:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a8c394c000 from 119 10000000:01000000:3.0:1788872787.130018:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788872787.130069:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.130082:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.130107:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872787.130137:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.130217:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872787.130267:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73ec600 going to sleep for 11 seconds 00000100:00100000:0.0:1788872787.130941:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327737088 00000100:00100000:0.0:1788872787.130951:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327737088 00000100:00100000:0.0:1788872787.131003:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788872787.131013:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:6517:x1875765327737088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872787.131028:0:91005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872787.131048:0:91005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8cc3e7600/0xe4e6e89fb01da83f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da838 expref: -99 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.131078:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8cc3e7600/0xe4e6e89fb01da83f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da838 expref: 11 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.131168:0:91005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8cc3e7600/0xe4e6e89fb01da83f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da838 expref: 11 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.131177:0:91005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e7600, rc 0) 00000100:00100000:0.0:1788872787.133410:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327737088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2387us (3182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872787.133425:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788872787.137311:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872787.137348:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.137362:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872787.140327:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788872787.140427:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872787.140531:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82ba180 going to sleep for 11 seconds 00000100:00100000:1.0:1788872787.145056:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327737216 00000100:00100000:1.0:1788872787.145077:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327737216 00000100:00100000:0.0:1788872787.147671:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788872787.147688:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327737216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788872787.148003:0:91012:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788872787.148021:0:91012:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788872787.148024:0:91012:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 119 00000100:00100000:0.0:1788872787.148362:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327737216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 676us (7933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872787.148371:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788872787.148486:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788872787.148591:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788872787.148603:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.148616:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872787.148626:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788872787.148630:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9d0cfb000 from 52 10000000:01000000:3.0:1788872787.148633:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788872787.148673:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01da846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.148682:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01da846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.148692:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01da846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872787.148724:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.148762:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872787.148797:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73ecc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872787.149359:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327737344 00000100:00100000:0.0:1788872787.149368:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327737344 00000100:00100000:0.0:1788872787.149416:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788872787.149424:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327737344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872787.149438:0:91011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872787.149454:0:91011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8cc3e6000/0xe4e6e89fb01da84d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da846 expref: -99 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.149493:0:91011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8cc3e6000/0xe4e6e89fb01da84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da846 expref: 12 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.149505:0:91011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8cc3e6000/0xe4e6e89fb01da84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da846 expref: 12 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.149515:0:91011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e6000, rc 0) 00000100:00100000:0.0:1788872787.149596:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327737344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872787.149602:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788872787.149752:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872787.149769:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01da846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da84d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.149779:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01da846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da84d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872787.149854:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.149888:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872787.149909:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872787.150018:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327737472 00000100:00100000:0.0:1788872787.150023:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327737472 00000100:00100000:0.0:1788872787.150065:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788872787.150072:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c654b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327737472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872787.150237:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c654b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327737472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872787.150244:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788872787.150375:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.150411:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.150454:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872787.150485:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.150656:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327737600 00000100:00100000:3.0:1788872787.150661:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327737600 00000100:00100000:3.0:1788872787.150690:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788872787.150697:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c654bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327737600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.150902:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c654bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327737600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.150909:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788872787.150993:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788872787.158138:0:91085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788872787.163441:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788872787.168238:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788872787.168258:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01da846 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da84d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.168271:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01da846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da84d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872787.173579:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788872787.173588:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9d0cfb000 from 116 10000000:01000000:2.0:1788872787.173593:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788872787.173645:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58afa00/0xe4e6e89fb01da854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.173658:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c58afa00/0xe4e6e89fb01da854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.173681:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c58afa00/0xe4e6e89fb01da854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872787.173934:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.174013:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872787.174075:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788872787.174141:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327737728 00000100:00100000:1.0:1788872787.174150:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327737728 00000100:00100000:1.0:1788872787.174214:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788872787.174223:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327737728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872787.174237:0:91005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872787.174250:0:91005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52ae000/0xe4e6e89fb01da85b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da854 expref: -99 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.174276:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52ae000/0xe4e6e89fb01da85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da854 expref: 13 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.174288:0:91005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52ae000/0xe4e6e89fb01da85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da854 expref: 13 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.174306:0:91005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52ae000, rc 0) 00000100:00100000:1.0:1788872787.174357:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327737728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872787.174364:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788872787.174500:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872787.174516:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c58afa00/0xe4e6e89fb01da854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da85b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.174526:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c58afa00/0xe4e6e89fb01da854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da85b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872787.174888:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.174931:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872787.174955:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.174964:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327737856 00000100:00100000:3.0:1788872787.174971:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327737856 00000100:00100000:3.0:1788872787.175019:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788872787.175026:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c654a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327737856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788872787.175041:0:91008:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788872787.175059:0:91008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788872787.175063:0:91008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788872787.175066:0:91008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788872787.175069:0:91008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788872787.175071:0:91008:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:3.0:1788872787.175228:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c654a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327737856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 201us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.175237:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788872787.177366:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788872787.177729:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788872787.177740:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58afa00/0xe4e6e89fb01da854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da85b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.177752:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c58afa00/0xe4e6e89fb01da854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da85b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872787.177761:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788872787.177764:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1788872787.177777:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788872787.177814:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58af200/0xe4e6e89fb01da862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.177822:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c58af200/0xe4e6e89fb01da862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.177830:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c58af200/0xe4e6e89fb01da862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872787.177850:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.178302:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872787.178387:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788872787.182906:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327737984 00000100:00100000:0.0:1788872787.182924:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327737984 00000100:00100000:0.0:1788872787.182984:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788872787.182996:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c654a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327737984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872787.183014:0:91012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872787.183037:0:91012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01da869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da862 expref: -99 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.183079:0:91012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01da869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da862 expref: 14 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.183100:0:91012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01da869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da862 expref: 14 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.183110:0:91012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e6800, rc 0) 00000100:00100000:0.0:1788872787.183207:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c654a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327737984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (4905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872787.183214:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788872787.186368:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327737984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872787.186400:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c58af200/0xe4e6e89fb01da862 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da869 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.186414:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c58af200/0xe4e6e89fb01da862 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da869 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872787.186502:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.186671:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872787.186718:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788872787.188073:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327738112 00000100:00100000:0.0:1788872787.188096:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327738112 00000100:00100000:0.0:1788872787.188196:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788872787.188208:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c654a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327738112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872787.188444:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c654a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327738112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872787.188460:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788872787.188546:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.188634:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.188676:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872787.190385:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73ec840 going to sleep for 11 seconds 00000100:00100000:1.0:1788872787.190712:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327738240 00000100:00100000:1.0:1788872787.190721:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327738240 00000100:00100000:1.0:1788872787.190818:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788872787.190829:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327738240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.192215:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327738240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1379us (3530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872787.192228:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788872787.192438:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872787.196010:0:91087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1788872787.197509:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1788872787.197541:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788872787.197642:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58af200/0xe4e6e89fb01da862 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da869 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.197657:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c58af200/0xe4e6e89fb01da862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da869 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872787.197666:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1788872787.197669:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a9d0cfb000 from 1 10000000:01000000:1.0:1788872787.197672:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788872787.197717:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.197727:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.197752:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872787.197787:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.197860:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872787.198046:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.198477:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327738368 00000100:00100000:3.0:1788872787.198487:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327738368 00000100:00100000:3.0:1788872787.198545:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788872787.198693:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c654b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327738368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872787.198708:0:91005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872787.198726:0:91005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9f5440400/0xe4e6e89fb01da877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da870 expref: -99 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.198753:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9f5440400/0xe4e6e89fb01da877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da870 expref: 15 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.198778:0:91005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9f5440400/0xe4e6e89fb01da877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da870 expref: 15 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.198787:0:91005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5440400, rc 0) 00000100:00100000:3.0:1788872787.198837:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c654b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327738368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 266us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.198843:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788872787.199114:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872787.199130:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da877 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.199140:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da877 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872787.199157:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788872787.199161:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da870 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da877 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.199168:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da877 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872787.199175:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788872787.199177:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9d0cfb000 from 7 10000000:01000000:1.0:1788872787.199180:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788872787.199199:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af800/0xe4e6e89fb01da87e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.199206:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52af800/0xe4e6e89fb01da87e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.199226:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52af800/0xe4e6e89fb01da87e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872787.199248:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.199281:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872787.199310:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.199701:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327738496 00000100:00100000:3.0:1788872787.199706:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327738496 00000100:00100000:3.0:1788872787.199746:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788872787.199753:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6548450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327738496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872787.199763:0:91008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872787.199773:0:91008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9f5441c00/0xe4e6e89fb01da885 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da87e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.199788:0:91008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9f5441c00/0xe4e6e89fb01da885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da87e expref: 16 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.199797:0:91008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9f5441c00/0xe4e6e89fb01da885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da87e expref: 16 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.199804:0:91008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5441c00, rc 0) 00000100:00100000:3.0:1788872787.199838:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6548450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327738496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.199844:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788872787.199969:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872787.199981:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52af800/0xe4e6e89fb01da87e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da885 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.199990:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af800/0xe4e6e89fb01da87e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da885 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872787.200049:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.200075:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872787.200113:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.200193:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327738624 00000100:00100000:3.0:1788872787.200198:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327738624 00000100:00100000:3.0:1788872787.200235:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788872787.200242:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6549450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327738624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.200354:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6549450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327738624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.200361:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788872787.200435:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.200691:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.200735:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872787.200787:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.200954:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327738752 00000100:00100000:3.0:1788872787.200959:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327738752 00000100:00100000:3.0:1788872787.201019:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788872787.201027:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c654b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327738752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.201149:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c654b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327738752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.201155:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788872787.201218:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788872787.202851:0:91089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788872787.203137:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788872787.203163:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788872787.203173:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af800/0xe4e6e89fb01da87e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da885 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.203205:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52af800/0xe4e6e89fb01da87e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da885 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872787.203214:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788872787.203217:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff5b1000 from 52 10000000:01000000:1.0:1788872787.203220:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788872787.203259:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52aee00/0xe4e6e89fb01da88c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.203267:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52aee00/0xe4e6e89fb01da88c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.203277:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52aee00/0xe4e6e89fb01da88c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872787.203301:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.203363:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872787.203417:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788872787.203711:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327738880 00000100:00100000:2.0:1788872787.203720:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327738880 00000100:00100000:2.0:1788872787.203781:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788872787.203796:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6549c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327738880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872787.203810:0:91011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872787.203823:0:91011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c58ae400/0xe4e6e89fb01da893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da88c expref: -99 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.203848:0:91011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c58ae400/0xe4e6e89fb01da893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da88c expref: 17 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.203858:0:91011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c58ae400/0xe4e6e89fb01da893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da88c expref: 17 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.203970:0:91011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58ae400, rc 0) 00000100:00100000:2.0:1788872787.204027:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6549c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327738880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872787.204035:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788872787.204124:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327738880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872787.204140:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52aee00/0xe4e6e89fb01da88c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da893 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.204150:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52aee00/0xe4e6e89fb01da88c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da893 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872787.204212:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.204242:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872787.204282:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788872787.204324:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327739008 00000100:00100000:2.0:1788872787.204329:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327739008 00000100:00100000:2.0:1788872787.204360:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788872787.204366:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c779e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327739008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.204790:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c779e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327739008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 423us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872787.204798:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788872787.204944:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.204981:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.205020:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872787.205046:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788872787.205095:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327739136 00000100:00100000:2.0:1788872787.205100:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327739136 00000100:00100000:2.0:1788872787.205167:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788872787.205175:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c779cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327739136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.205279:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c779cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327739136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872787.205293:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788872787.206140:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872787.208619:0:91090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788872787.209065:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788872787.209100:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788872787.209111:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52aee00/0xe4e6e89fb01da88c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da893 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.209122:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52aee00/0xe4e6e89fb01da88c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da893 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872787.209131:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788872787.209134:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788872787.209136:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788872787.209174:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da89a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.209182:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da89a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.209192:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da89a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872787.209217:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.209282:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872787.209337:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.209497:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327739264 00000100:00100000:3.0:1788872787.209505:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327739264 00000100:00100000:2.0:1788872787.209770:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788872787.209782:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c779c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327739264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872787.209797:0:91005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872787.209812:0:91005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c58afc00/0xe4e6e89fb01da8a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da89a expref: -99 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.209837:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c58afc00/0xe4e6e89fb01da8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da89a expref: 18 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.209848:0:91005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c58afc00/0xe4e6e89fb01da8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da89a expref: 18 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.209856:0:91005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58afc00, rc 0) 00000100:00100000:2.0:1788872787.209910:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c779c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327739264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872787.209916:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788872787.210077:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872787.210104:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da89a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.210115:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da89a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da8a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872787.210187:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.210222:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872787.210255:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.210294:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327739392 00000100:00100000:3.0:1788872787.210299:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327739392 00000100:00100000:3.0:1788872787.210331:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788872787.210339:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c779e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327739392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.211190:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c779e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327739392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 849us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.211199:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788872787.211329:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.211372:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.211432:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872787.211677:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327739520 00000100:00100000:2.0:1788872787.211683:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327739520 00000100:00100000:2.0:1788872787.211725:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788872787.211734:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c779d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327739520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.212106:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c47f2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.213836:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c779d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327739520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2096us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.213848:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788872787.214029:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872787.221360:0:91091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788872787.221747:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788872787.221775:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788872787.221796:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da89a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.221809:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da89a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872787.221820:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788872787.221823:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ff5b1000 from 7 10000000:01000000:3.0:1788872787.221827:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788872787.221873:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01da8a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.221882:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01da8a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.221893:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01da8a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872787.221922:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.221997:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872787.222050:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73ec300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872787.222111:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327739648 00000100:00100000:1.0:1788872787.222121:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327739648 00000100:00100000:1.0:1788872787.222181:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788872787.222191:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c779f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327739648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872787.222207:0:91012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872787.222222:0:91012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01da8af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da8a8 expref: -99 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.222248:0:91012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01da8af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da8a8 expref: 19 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.222260:0:91012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01da8af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da8a8 expref: 19 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.222276:0:91012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52afc00, rc 0) 00000100:00100000:1.0:1788872787.222320:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c779f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327739648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872787.222327:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788872787.222425:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872787.222441:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01da8a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.222451:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01da8a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da8af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872787.222520:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.222579:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872787.222603:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73ec300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872787.222766:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327739776 00000100:00100000:1.0:1788872787.222771:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327739776 00000100:00100000:1.0:1788872787.222803:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788872787.222810:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c779e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327739776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.222926:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c779e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327739776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872787.222933:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788872787.222999:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.223028:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.223067:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872787.223133:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73ec300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872787.223237:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327739904 00000100:00100000:1.0:1788872787.223241:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327739904 00000100:00100000:1.0:1788872787.223303:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788872787.223310:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c779f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327739904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.223445:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c779f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327739904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872787.223452:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788872787.223750:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327739904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788872787.224623:0:91093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788872787.224880:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788872787.224908:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788872787.224919:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01da8a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.224931:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01da8a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872787.224942:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788872787.224946:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ef97c000 from 52 10000000:01000000:3.0:1788872787.224949:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788872787.224986:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5441e00/0xe4e6e89fb01da8b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.224994:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5441e00/0xe4e6e89fb01da8b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.225004:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5441e00/0xe4e6e89fb01da8b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872787.225028:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.225092:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872787.225170:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73ec300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872787.225212:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327740032 00000100:00100000:1.0:1788872787.225220:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327740032 00000100:00100000:1.0:1788872787.225299:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788872787.225308:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c779ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327740032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872787.225321:0:91008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872787.225336:0:91008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52af200/0xe4e6e89fb01da8bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da8b6 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.225374:0:91008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52af200/0xe4e6e89fb01da8bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da8b6 expref: 20 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.225387:0:91008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52af200/0xe4e6e89fb01da8bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da8b6 expref: 20 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.225397:0:91008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af200, rc 0) 00000100:00100000:1.0:1788872787.225592:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c779ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327740032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 283us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872787.225599:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788872787.225681:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872787.225695:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5441e00/0xe4e6e89fb01da8b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.225704:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5441e00/0xe4e6e89fb01da8b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da8bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872787.225758:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872787.225785:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872787.225944:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef8a0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.225991:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327740160 00000100:00100000:3.0:1788872787.225996:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327740160 00000100:00100000:3.0:1788872787.226034:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788872787.226040:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c779dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327740160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.226164:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c779dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327740160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.226172:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788872787.226240:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872787.226272:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872787.226325:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872787.226345:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef8a0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872787.226360:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327740288 00000100:00100000:0.0:1788872787.226363:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327740288 00000100:00100000:0.0:1788872787.226385:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788872787.226392:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327740288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872787.226504:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327740288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872787.226521:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788872787.226600:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788872787.227249:0:91094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788872787.227305:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788872787.227325:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872787.227336:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5441e00/0xe4e6e89fb01da8b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.227345:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5441e00/0xe4e6e89fb01da8b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872787.227355:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788872787.227358:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1788872787.227362:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788872787.227390:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e7200/0xe4e6e89fb01da8c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.227401:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e7200/0xe4e6e89fb01da8c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.227410:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e7200/0xe4e6e89fb01da8c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872787.227427:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872787.227467:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872787.227489:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c65073c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.227856:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327740416 00000100:00100000:3.0:1788872787.227862:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327740416 00000100:00100000:3.0:1788872787.227898:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788872787.227906:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327740416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872787.227918:0:91005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872787.227934:0:91005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9f5440600/0xe4e6e89fb01da8cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da8c4 expref: -99 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.227957:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9f5440600/0xe4e6e89fb01da8cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da8c4 expref: 21 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.227968:0:91005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9f5440600/0xe4e6e89fb01da8cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da8c4 expref: 21 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.227976:0:91005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5440600, rc 0) 00000100:00100000:3.0:1788872787.228010:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327740416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.228016:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788872787.228188:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872787.228204:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e7200/0xe4e6e89fb01da8c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.228231:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e7200/0xe4e6e89fb01da8c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da8cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872787.228291:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872787.228320:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872787.228359:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c65073c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.228400:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327740544 00000100:00100000:3.0:1788872787.228414:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327740544 00000100:00100000:3.0:1788872787.228442:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788872787.228455:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9baa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327740544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.228801:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9baa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327740544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 345us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.228810:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788872787.228873:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872787.228908:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872787.228949:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872787.228975:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c65073c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.229017:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327740672 00000100:00100000:3.0:1788872787.229022:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327740672 00000100:00100000:3.0:1788872787.229055:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788872787.229061:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327740672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.235061:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327740672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5986us (6098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872787.235091:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788872787.235129:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872787.236872:0:91096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1788872787.237953:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788872787.237982:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788872787.237995:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e7200/0xe4e6e89fb01da8c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.238015:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e7200/0xe4e6e89fb01da8c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872787.238024:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788872787.238028:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ef97c000 from 7 10000000:01000000:2.0:1788872787.238031:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788872787.238071:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae000/0xe4e6e89fb01da8d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.238080:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae000/0xe4e6e89fb01da8d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.238103:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae000/0xe4e6e89fb01da8d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872787.238132:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.238275:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872787.238330:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872787.238453:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327740800 00000100:00100000:0.0:1788872787.238650:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327740800 00000100:00100000:0.0:1788872787.238748:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788872787.238758:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327740800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872787.238775:0:91012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872787.238792:0:91012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8cc3e6600/0xe4e6e89fb01da8d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da8d2 expref: -99 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.238820:0:91012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8cc3e6600/0xe4e6e89fb01da8d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da8d2 expref: 22 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.238832:0:91012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8cc3e6600/0xe4e6e89fb01da8d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da8d2 expref: 22 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.238842:0:91012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e6600, rc 0) 00000100:00100000:0.0:1788872787.238908:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327740800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872787.238921:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788872787.239003:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872787.239019:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae000/0xe4e6e89fb01da8d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.239028:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae000/0xe4e6e89fb01da8d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da8d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872787.239107:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.239134:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872787.239169:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872787.239289:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327740928 00000100:00100000:0.0:1788872787.239294:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327740928 00000100:00100000:0.0:1788872787.239372:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788872787.239380:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327740928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872787.239532:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327740928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872787.239539:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788872787.239718:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327740928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.239749:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327741056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.239789:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872787.239837:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788872787.239853:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327741056 00000100:00100000:2.0:1788872787.239856:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327741056 00000100:00100000:2.0:1788872787.240299:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788872787.240308:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327741056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.240409:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327741056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872787.240416:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788872787.245857:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327741056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788872787.251451:0:91098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788872787.251819:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788872787.251847:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788872787.251861:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae000/0xe4e6e89fb01da8d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.251873:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae000/0xe4e6e89fb01da8d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872787.251929:0:6517:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788872787.251933:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98a9e9b999c0 from 1 10000000:01000000:3.0:1788872787.251936:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788872787.251986:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440800/0xe4e6e89fb01da8e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.251995:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9f5440800/0xe4e6e89fb01da8e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.252007:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9f5440800/0xe4e6e89fb01da8e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872787.252033:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9faa78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327741184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.252114:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872787.252166:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1788872787.252289:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327741184 00000100:00100000:0.0:1788872787.252297:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327741184 00000100:00100000:0.0:1788872787.252351:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788872787.252360:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327741184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872787.252376:0:91012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872787.252393:0:91012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8cc3e7a00/0xe4e6e89fb01da8e7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da8e0 expref: -99 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.252428:0:91012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8cc3e7a00/0xe4e6e89fb01da8e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da8e0 expref: 23 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.252439:0:91012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8cc3e7a00/0xe4e6e89fb01da8e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da8e0 expref: 23 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.252448:0:91012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e7a00, rc 0) 00000100:00100000:0.0:1788872787.252500:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f650a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327741184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872787.252507:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788872787.252698:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9faa78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327741184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872787.252716:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9f5440800/0xe4e6e89fb01da8e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.252725:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440800/0xe4e6e89fb01da8e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da8e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872787.252752:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788872787.252756:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440800/0xe4e6e89fb01da8e0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.252763:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9f5440800/0xe4e6e89fb01da8e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872787.252770:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788872787.252772:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98a9e9b999c0 from 1 10000000:01000000:2.0:1788872787.252774:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788872787.252791:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae800/0xe4e6e89fb01da8ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.252799:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae800/0xe4e6e89fb01da8ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.252807:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae800/0xe4e6e89fb01da8ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872787.252974:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327741312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.253015:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872787.253665:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872787.255864:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327741312 00000100:00100000:0.0:1788872787.256112:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327741312 00000100:00100000:0.0:1788872787.256182:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788872787.256194:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327741312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872787.256214:0:91007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872787.256238:0:91007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8cc3e7400/0xe4e6e89fb01da8f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01da8ee expref: -99 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.256269:0:91007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8cc3e7400/0xe4e6e89fb01da8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01da8ee expref: 24 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.256280:0:91007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8cc3e7400/0xe4e6e89fb01da8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01da8ee expref: 24 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872787.256288:0:91007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e7400, rc 0) 00000100:00100000:0.0:1788872787.256819:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327741312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 626us (3800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872787.256827:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:0.0:1788872787.257013:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872787.257466:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327741312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872787.257490:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae800/0xe4e6e89fb01da8ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.257503:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae800/0xe4e6e89fb01da8ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da8f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872787.257626:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327741440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872787.257668:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872787.257700:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872787.257706:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327741440 00000100:00100000:3.0:1788872787.257711:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327741440 00000100:00100000:3.0:1788872787.257752:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788872787.257766:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327741440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.257861:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327741440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (192us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788872787.257870:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788872787.257914:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327741440:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788872787.257946:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788872787.257952:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae800/0xe4e6e89fb01da8ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872787.257960:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae800/0xe4e6e89fb01da8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da8f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872787.540978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872787.541149:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311180800 00000100:00100000:3.0:1788872787.541162:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311180800 00000100:00100000:3.0:1788872787.541232:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 61 00000100:00100000:3.0:1788872787.541244:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+5:42482:x1875765311180800:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872787.541263:0:91008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872787.541282:0:91008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9f5441200/0xe4e6e89fb01da8fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf9f expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.541313:0:91008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9f5441200/0xe4e6e89fb01da8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf9f expref: 6 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.541325:0:91008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9f5441200/0xe4e6e89fb01da8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf9f expref: 6 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.541334:0:91008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5441200, rc 0) 00000100:00100000:3.0:1788872787.541397:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311180800:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 155us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.541405:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 61 00000100:00100000:3.0:1788872787.547708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872787.548028:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311180928 00000100:00100000:0.0:1788872787.548042:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311180928 00000100:00100000:0.0:1788872787.548121:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:0.0:1788872787.548132:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311180928:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788872787.548165:0:91007:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788872787.548194:0:91007:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788872787.548198:0:91007:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788872787.548201:0:91007:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788872787.548204:0:91007:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788872787.548206:0:91007:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:3.0:1788872787.561784:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311180928:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 Request processed in 13639us (14072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.561802:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:3.0:1788872787.568294:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872787.568424:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311181056 00000100:00100000:1.0:1788872787.568437:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311181056 00000100:00100000:1.0:1788872787.568503:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:1.0:1788872787.568515:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+6:42482:x1875765311181056:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872787.568532:0:91011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872787.568574:0:91011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01da903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fafa6 expref: -99 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.568604:0:91011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01da903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafa6 expref: 7 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.568614:0:91011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01da903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafa6 expref: 7 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.568622:0:91011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af400, rc 0) 00000100:00100000:1.0:1788872787.568678:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+7:42482:x1875765311181056:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 165us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872787.568692:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:1.0:1788872787.571623:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872787.571682:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311181184 00000100:00100000:3.0:1788872787.571694:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311181184 00000100:00100000:3.0:1788872787.571756:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 64 00000100:00100000:3.0:1788872787.571765:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+7:42482:x1875765311181184:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.571940:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311181184:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 175us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.571947:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 64 00000100:00100000:0.0:1788872787.575211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872787.575280:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311181312 00000100:00100000:3.0:1788872787.575361:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311181312 00000100:00100000:3.0:1788872787.575472:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 65 00000100:00100000:3.0:1788872787.575484:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311181312:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.575672:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311181312:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 189us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.575680:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 65 00000100:00100000:3.0:1788872787.591040:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872787.591848:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311181440 00000100:00100000:1.0:1788872787.591925:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311181440 00000100:00100000:1.0:1788872787.592056:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 66 00000100:00100000:1.0:1788872787.592068:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:42482:x1875765311181440:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872787.592096:0:91008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872787.592119:0:91008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01da90a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fafad expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.592166:0:91008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01da90a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafad expref: 9 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.592178:0:91008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01da90a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafad expref: 9 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872787.592190:0:91008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9dc00, rc 0) 00000100:00100000:1.0:1788872787.592269:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311181440:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 203us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872787.592277:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 66 00000100:00100000:3.0:1788872787.605294:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872787.607191:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311181568 00000100:00100000:1.0:1788872787.607206:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311181568 00000100:00100000:1.0:1788872787.607276:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 67 00000100:00100000:1.0:1788872787.607287:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c733a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311181568:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872787.607471:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c733a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311181568:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 185us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872787.607492:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 67 00000100:00100000:1.0:1788872787.616738:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872787.616832:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311181696 00000100:00100000:3.0:1788872787.616843:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311181696 00000100:00100000:3.0:1788872787.616915:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 68 00000100:00100000:3.0:1788872787.616926:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c733ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311181696:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.617092:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c733ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311181696:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 167us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.617101:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 68 00000100:00100000:1.0:1788872787.621069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872787.624732:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311181824 00000100:00100000:3.0:1788872787.624746:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311181824 00000100:00100000:3.0:1788872787.624867:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 69 00000100:00100000:3.0:1788872787.624890:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:42482:x1875765311181824:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872787.624910:0:91008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872787.624931:0:91008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9f5441400/0xe4e6e89fb01da911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fafb4 expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.624964:0:91008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9f5441400/0xe4e6e89fb01da911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafb4 expref: 10 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.624977:0:91008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9f5441400/0xe4e6e89fb01da911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafb4 expref: 10 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872787.624986:0:91008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5441400, rc 0) 00000100:00100000:3.0:1788872787.626037:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:42482:x1875765311181824:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 1144us (4975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872787.626047:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 69 00000100:00100000:0.0:1788872787.632084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872787.632171:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311181952 00000100:00100000:3.0:1788872787.632183:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311181952 00000100:00100000:3.0:1788872787.632283:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 70 00000100:00100000:3.0:1788872787.632295:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7339450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:42482:x1875765311181952:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872787.632421:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7339450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:42482:x1875765311181952:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 128us (357us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788872787.632431:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 70 00000100:00100000:0.0:1788872787.641799:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872787.641826:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327741568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872787.641915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872787.642107:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327741568 00000100:00100000:1.0:1788872787.642117:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327741568 00000100:00100000:1.0:1788872787.642197:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:1.0:1788872787.642210:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327741568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872787.642242:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872787.642291:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327741568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872787.642299:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:1.0:1788872787.642346:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327741568:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788872787.642947:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872787.643063:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872787.643087:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327741696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872787.643128:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872787.644002:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327741696 00000100:00100000:1.0:1788872787.644011:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327741696 00000100:00100000:1.0:1788872787.644066:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:1.0:1788872787.644086:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327741696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872787.644114:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872787.644168:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327741696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872787.644175:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:1.0:1788872787.644225:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327741696:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788872787.644564:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788872788.289084:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872789.305215:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872790.328662:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872791.229830:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327741824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872791.229950:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872791.230027:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327741824 00000100:00100000:1.0:1788872791.230035:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327741824 00000100:00100000:1.0:1788872791.230106:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:1.0:1788872791.230117:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327741824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872791.230166:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872791.230232:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327741824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872791.230239:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00100000:1.0:1788872791.230289:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327741824:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788872791.230749:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872791.230754:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872791.230758:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872791.230766:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872791.230797:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c6561500 x1875765327742080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872791.230830:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872791.230834:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872791.230836:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872791.230847:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872791.230861:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9df5aed80 x1875765327742336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872791.230877:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872791.230880:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872791.230881:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872791.230886:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872791.230896:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9df5aea00 x1875765327742592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872791.230916:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872791.230919:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872791.230921:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872791.230925:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872791.230934:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9c12aea00 x1875765327742976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872791.230958:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788872791.230962:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872791.230963:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9c9892800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872791.230968:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98a9c9892800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872791.230977:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9c12aed80 x1875765327743360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872791.231001:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327742464:0@lo:400:kworker.0 00000100:00100000:2.0:1788872791.231052:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872791.231072:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327743232:0@lo:400:kworker.0 00000100:00100000:2.0:1788872791.231123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872791.231162:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788872791.231170:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327742208:0@lo:400:kworker.0 00000100:00100000:2.0:1788872791.231196:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872791.231213:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327743104:0@lo:400:kworker.0 00000100:00100000:2.0:1788872791.231237:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872791.231270:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327743232 00000100:00100000:2.0:1788872791.231275:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327743232 00000100:00100000:2.0:1788872791.231336:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327743104 00000100:00100000:2.0:1788872791.231339:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327743104 00000100:00100000:2.0:1788872791.231364:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:2.0:1788872791.231370:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327743232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872791.231412:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327743232:12345-0@lo:400:kworker.0 Request processed in 42us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872791.231420:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00100000:2.0:1788872791.231437:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:2.0:1788872791.231443:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327743104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872791.231472:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327743104:12345-0@lo:400:kworker.0 Request processed in 30us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872791.231478:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00080000:2.0:1788872791.231499:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872791.231504:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872791.231536:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327743104:0@lo:400:kworker.0 00000100:00100000:2.0:1788872791.231575:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327743232:0@lo:400:kworker.0 00000100:00100000:3.0:1788872791.232238:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327742080:0@lo:38:kworker.0 00000100:00100000:3.0:1788872791.232302:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.232332:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327742336:0@lo:38:kworker.0 00000100:00100000:3.0:1788872791.232354:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.232381:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327742592:0@lo:38:kworker.0 00000100:00100000:3.0:1788872791.232407:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.232429:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327742976:0@lo:38:kworker.0 00000100:00100000:3.0:1788872791.232455:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.232490:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327743360:0@lo:38:kworker.0 00000100:00100000:3.0:1788872791.232518:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.232583:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327742464 00000100:00100000:3.0:1788872791.232588:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327742464 00000100:00100000:3.0:1788872791.232621:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327742208 00000100:00100000:3.0:1788872791.232624:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327742208 00000100:00100000:3.0:1788872791.232638:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327742080 00000100:00100000:3.0:1788872791.232641:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327742080 00000100:00100000:3.0:1788872791.232650:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327742336 00000100:00100000:3.0:1788872791.232652:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327742336 00000100:00100000:3.0:1788872791.232659:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327742976 00000100:00100000:3.0:1788872791.232661:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327742976 00000100:00100000:3.0:1788872791.232667:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327743360 00000100:00100000:3.0:1788872791.232669:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327743360 00000100:00100000:3.0:1788872791.232680:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1788872791.232687:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327742464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872791.232746:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327742464:12345-0@lo:400:kworker.0 Request processed in 59us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.232754:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1788872791.232780:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1788872791.232795:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327742208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872791.232825:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327742208:12345-0@lo:400:kworker.0 Request processed in 39us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.232830:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1788872791.232850:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1788872791.232854:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327742080:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872791.232878:0:83669:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3728 last 0 00000020:00000080:3.0:1788872791.232915:0:83669:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe4e6e89fb01da918 00000004:00100000:3.0:1788872791.232933:0:83669:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872791.233073:0:83669:0:(import.c:65:import_set_state_nolock()) ffff98a9cb5ea800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872791.233115:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875765327742080:12345-0@lo:38:kworker.0 Request processed in 258us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.233122:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1788872791.233135:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1788872791.233140:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327742336:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872791.233156:0:83669:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3728 last 0 00000020:00000080:3.0:1788872791.233179:0:83669:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe4e6e89fb01da91f 00000004:00100000:3.0:1788872791.233186:0:83669:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872791.233208:0:83669:0:(import.c:65:import_set_state_nolock()) ffff98a9cb5ed800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872791.233243:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875765327742336:12345-0@lo:38:kworker.0 Request processed in 100us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.233249:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1788872791.233266:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1788872791.233271:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327742976:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872791.233283:0:83669:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3728 last 0 00000020:00000080:3.0:1788872791.233308:0:83669:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe4e6e89fb01da926 00000004:00100000:3.0:1788872791.233314:0:83669:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872791.233328:0:83669:0:(import.c:65:import_set_state_nolock()) ffff98a8c5116800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872791.233357:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875765327742976:12345-0@lo:38:kworker.0 Request processed in 85us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.233370:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1788872791.233384:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1788872791.233387:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327743360:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872791.233401:0:83669:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3728 last 0 00000020:00000080:3.0:1788872791.233426:0:83669:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe4e6e89fb01da92d 00000004:00100000:3.0:1788872791.233433:0:83669:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872791.233447:0:83669:0:(import.c:65:import_set_state_nolock()) ffff98a9fa737000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872791.233476:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875765327743360:12345-0@lo:38:kworker.0 Request processed in 87us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.233483:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1788872791.233515:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327742592 00000100:00100000:3.0:1788872791.233521:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327742592 00000100:00100000:3.0:1788872791.233546:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:3.0:1788872791.233582:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327742592:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872791.233597:0:8447:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff98a9ef256800, cookie 0xe4e6e89fb01da782 00010000:00080000:3.0:1788872791.233602:0:8447:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378652 exp ffff98a9ef256800 cur 3728 last 1788872785 00000004:00100000:3.0:1788872791.233611:0:8447:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872791.233625:0:8447:0:(import.c:65:import_set_state_nolock()) ffff98a9fa733800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872791.233662:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327742592:12345-0@lo:38:kworker.0 Request processed in 79us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.233668:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00010000:00080000:3.0:1788872791.233692:0:91035:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788872791.233698:0:91035:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 111669149704 00000020:00080000:3.0:1788872791.233702:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872791.233706:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 111669149704, next_transno: 111669149704 00010000:00080000:3.0:1788872791.233716:0:91035:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (111669149704) 00000020:00080000:3.0:1788872791.233719:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872791.233729:0:91035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311170688 t111669149704 from 192.168.204.39@tcp req@ffff98a9ef3d0e00 x1875765311170688/t0(111669149704) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:712/0 lens 528/0 e 0 to 0 dl 1788872797 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872791.233796:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872791.233825:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327742720:0@lo:400:kworker.0 00000100:00100000:3.0:1788872791.233858:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.233887:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788872791.233896:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327741952:0@lo:400:kworker.0 00000100:00100000:3.0:1788872791.233959:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.233985:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327742848:0@lo:400:kworker.0 00000100:00100000:3.0:1788872791.234028:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.234077:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327742720 00000100:00100000:3.0:1788872791.234081:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327742720 00000100:00100000:3.0:1788872791.234119:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327742848 00000100:00100000:3.0:1788872791.234122:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327742848 00000100:00100000:3.0:1788872791.234143:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00100000:3.0:1788872791.234149:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327742720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872791.234186:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327742720:12345-0@lo:400:kworker.0 Request processed in 37us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.234192:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00100000:3.0:1788872791.234205:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:3.0:1788872791.234213:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327742848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872791.234246:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327742848:12345-0@lo:400:kworker.0 Request processed in 35us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.234252:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00080000:3.0:1788872791.234282:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872791.234285:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872791.234459:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327742208:0@lo:400:kworker.0 00000100:00100000:3.0:1788872791.234476:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327742464:0@lo:400:kworker.0 00010000:00080000:3.0:1788872791.234518:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a8c6561500 x1875765327742080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872791.234530:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000100:00100000:1.0:1788872791.236343:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327741952 00000100:00100000:1.0:1788872791.236356:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327741952 00000100:00100000:1.0:1788872791.236408:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788872791.236417:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327741952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872791.236495:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327741952:12345-0@lo:400:kworker.0 Request processed in 79us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872791.236501:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788872791.238213:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327741952:0@lo:400:kworker.0 00000100:00100000:0.0:1788872791.238239:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327742848:0@lo:400:kworker.0 00000100:00100000:0.0:1788872791.238253:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327742720:0@lo:400:kworker.0 00000100:00080000:3.0:1788872791.241134:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff98a8c6561500 x1875765327742080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872816 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872791.241148:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788872791.241155:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788872791.241160:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788872791.241167:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327742080:0@lo:38:kworker.0 00010000:00080000:3.0:1788872791.241206:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9df5aed80 x1875765327742336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872791.241223:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000100:00080000:3.0:1788872791.243468:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff98a9df5aed80 x1875765327742336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872816 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872791.243482:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788872791.243486:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788872791.243490:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788872791.243496:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327742336:0@lo:38:kworker.0 00000100:00080000:3.0:1788872791.243536:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:3.0:1788872791.246896:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788872791.246918:0:3643:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788872791.246922:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:3.0:1788872791.246929:0:3643:0:(recover.c:53:ptlrpc_replay_next()) import ffff98a9df8c9800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:3.0:1788872791.246932:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000004:00080000:3.0:1788872791.246954:0:91035:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13175us 00000100:00100000:3.0:1788872791.253528:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327742592:0@lo:38:kworker.0 00010000:00080000:3.0:1788872791.253595:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9c12aea00 x1875765327742976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872791.253617:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00010000:00080000:0.0:1788872791.255416:0:91274:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1788872791.255424:0:91274:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1788872791.255431:0:91274:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1788872791.256117:0:91274:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:3.0:1788872791.257264:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff98a9c12aea00 x1875765327742976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872816 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872791.257277:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788872791.257281:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788872791.257286:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788872791.257292:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327742976:0@lo:38:kworker.0 00010000:00080000:3.0:1788872791.257334:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9c12aed80 x1875765327743360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872791.257351:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:3.0:1788872791.257361:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788872791.257368:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788872791.257370:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9c9892800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788872791.257375:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327743360:0@lo:38:kworker.0 00000100:00100000:3.0:1788872791.257428:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327743488:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788872791.257516:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872791.257897:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327743488 00000100:00100000:0.0:1788872791.257904:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327743488 00000100:00100000:0.0:1788872791.257955:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:0.0:1788872791.257964:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327743488:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788872791.257983:0:8446:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a9df5aea00 x1875765327743488/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:717/0 lens 224/0 e 0 to 0 dl 1788872802 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872791.257994:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327743488:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 32us (479us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788872791.258001:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00010000:00010000:1.0:1788872791.292245:0:91035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da934 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.292270:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.292286:0:91035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.292299:0:91035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01da93b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.292326:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01da93b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.292335:0:91035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01da93b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.295145:0:91035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.295165:0:91035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da934 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.295173:0:91035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da934 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.295181:0:91035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872791.295186:0:91035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da934 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.295194:0:91035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da934 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.295211:0:91035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4700) 00010000:00010000:1.0:1788872791.295215:0:91035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872791.295219:0:91035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da934 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.295225:0:91035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da934 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872791.295252:0:91035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d35998d reply state 00000000ddf9e82c transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01da93b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.295279:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01da93b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.295286:0:91035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4d00) 00010000:00010000:1.0:1788872791.295288:0:91035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872791.295292:0:91035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788872791.295465:0:91035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788872791.295488:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872791.295491:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000020:00080000:1.0:1788872791.295496:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872791.295498:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000001:00080000:3.0:1788872791.304539:0:91001:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149704 is committed 00010000:00010000:2.0:1788872791.305940:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01da93b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.305978:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01da93b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.305986:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01da93b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.305992:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872791.305997:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01da93b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.306016:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01da93b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.306037:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4d00) 00010000:00010000:2.0:1788872791.306041:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872791.306046:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01da93b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.306053:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01da93b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872791.307134:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872791.307178:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872791.307208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872791.307245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872791.307276:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311182208 00000100:00100000:3.0:1788872791.307288:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311182208 00000100:00100000:3.0:1788872791.307362:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1294 00000100:00100000:3.0:1788872791.307373:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311182208:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872791.307454:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311182208:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.307462:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1294 00000100:00100000:3.0:1788872791.307487:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311182336 00000100:00100000:3.0:1788872791.307490:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311182336 00000100:00100000:3.0:1788872791.307515:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311182464 00000100:00100000:3.0:1788872791.307518:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311182464 00000100:00100000:3.0:1788872791.307539:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2619 00000100:00100000:3.0:1788872791.307545:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311182336:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872791.307597:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311182336:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 51us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.307604:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2619 00000100:00100000:3.0:1788872791.307615:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2620 00000100:00100000:3.0:1788872791.307622:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311182464:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872791.307647:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311182464:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.307669:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2620 00000100:00080000:3.0:1788872791.307689:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872791.307693:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872791.307695:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872791.308374:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311182080 00000100:00100000:1.0:1788872791.308382:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311182080 00000100:00100000:1.0:1788872791.308429:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 72 00000100:00100000:1.0:1788872791.308437:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311182080:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872791.308474:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311182080:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 39us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872791.308481:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 72 00000100:00100000:1.0:1788872791.324098:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872791.325156:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311171200 00000100:00100000:3.0:1788872791.325169:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311171200 00000100:00100000:3.0:1788872791.325300:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1281 00000100:00100000:3.0:1788872791.325313:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311171200:12345-192.168.204.39@tcp:36:rm.0 00010000:00080000:3.0:1788872791.325336:0:66193:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149705, current: 111669149705, replaying 00000100:00100000:3.0:1788872791.325354:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311171200:12345-192.168.204.39@tcp:36:rm.0 Request processed in 45us (1271us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872791.325361:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1281 00000020:00080000:1.0:1788872791.325397:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872791.325402:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149705, next_transno: 111669149705 00010000:00080000:1.0:1788872791.325407:0:91035:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (111669149705) 00000020:00080000:1.0:1788872791.325410:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872791.325419:0:91035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311171200 t111669149705 from 192.168.204.39@tcp req@ffff98a8c4a14000 x1875765311171200/t0(111669149705) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:717/0 lens 512/0 e 0 to 0 dl 1788872802 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788872791.325511:0:91035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da942 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.325539:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da942 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.325569:0:91035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da942 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.325583:0:91035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01da949 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.325590:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01da949 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.325596:0:91035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01da949 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.325682:0:91035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01da950 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.325691:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01da950 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.325710:0:91035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01da950 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.325996:0:91035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01da950 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326016:0:91035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01da950 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326022:0:91035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01da950 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326039:0:91035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9de00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872791.326043:0:91035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01da950 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326051:0:91035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01da950 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326064:0:91035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff98a9e7bf4100) 00010000:00010000:1.0:1788872791.326067:0:91035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788872791.326071:0:91035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01da950 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326076:0:91035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01da950 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326099:0:91035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da942 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326104:0:91035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da942 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326109:0:91035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da942 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326113:0:91035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872791.326116:0:91035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da942 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326122:0:91035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da942 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326139:0:91035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9e7bf4700) 00010000:00010000:1.0:1788872791.326141:0:91035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872791.326144:0:91035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da942 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326149:0:91035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01da942 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872791.326159:0:91035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063d64537 reply state 0000000038bf2cb3 transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01da949 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326169:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01da949 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.326175:0:91035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4300) 00010000:00010000:1.0:1788872791.326177:0:91035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872791.326180:0:91035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788872791.326274:0:91035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788872791.326299:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872791.326302:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000020:00080000:1.0:1788872791.326307:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872791.326308:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000100:00100000:3.0:1788872791.336591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872791.341709:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311173248 00000100:00100000:2.0:1788872791.341727:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311173248 00000100:00100000:2.0:1788872791.342148:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1282 00000100:00100000:2.0:1788872791.342172:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2403:x1875765311173248:12345-192.168.204.39@tcp:36:dd.0 00010000:00080000:2.0:1788872791.342200:0:66192:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149706, current: 111669149708, replaying 00000100:00100000:2.0:1788872791.342223:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2403:x1875765311173248:12345-192.168.204.39@tcp:36:dd.0 Request processed in 54us (5687us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788872791.342231:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1282 00000020:00080000:3.0:1788872791.342257:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872791.342269:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149708, next_transno: 111669149706 00010000:00080000:3.0:1788872791.342279:0:91035:0:(ldlm_lib.c:2258:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 111669149706, ql: 1, comp: 1, conn: 2, next: 111669149708, next_update 0 last_committed: 111669149704) 00000020:00080000:3.0:1788872791.342286:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872791.342303:0:91035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311173248 t111669149708 from 192.168.204.39@tcp req@ffff98a9c77b2d80 x1875765311173248/t0(111669149708) o36->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:717/0 lens 488/0 e 0 to 0 dl 1788872802 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788872791.343756:0:91035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da957 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.343779:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da957 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.343792:0:91035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da957 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788872791.343863:0:91035:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149708 00000004:00010000:3.0:1788872791.343886:0:91035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f1378371 reply state 00000000ee211585 transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da957 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.343898:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da957 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.343906:0:91035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1f7a400) 00010000:00010000:3.0:1788872791.343908:0:91035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872791.343912:0:91035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788872791.346465:0:91035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788872791.346485:0:91035:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:3.0:1788872791.346508:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872791.346512:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000020:00080000:3.0:1788872791.346517:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872791.346519:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000100:00100000:1.0:1788872791.353243:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00010000:00010000:0.0:1788872791.353539:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872791.353910:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311173632 00000100:00100000:3.0:1788872791.353923:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311173632 00000100:00100000:3.0:1788872791.353999:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1283 00000100:00100000:3.0:1788872791.354021:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2403:x1875765311173632:12345-192.168.204.39@tcp:101:dd.0 00010000:00080000:3.0:1788872791.354045:0:83669:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149709, current: 111669149709, replaying 00000100:00100000:3.0:1788872791.354062:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2403:x1875765311173632:12345-192.168.204.39@tcp:101:dd.0 Request processed in 44us (831us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872791.354069:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1283 00000020:00080000:3.0:1788872791.354089:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872791.354094:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149709, next_transno: 111669149709 00010000:00080000:3.0:1788872791.354100:0:91035:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (111669149709) 00000020:00080000:3.0:1788872791.354111:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872791.354119:0:91035:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311173632 t111669149709 from 192.168.204.39@tcp req@ffff98a8c4a16300 x1875765311173632/t0(111669149709) o101->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:717/0 lens 640/0 e 0 to 0 dl 1788872802 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788872791.354143:0:91035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872791.354165:0:91035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da95e lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faf6e expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.354269:0:91035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da965 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.354286:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da965 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.354314:0:91035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da965 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788872791.354474:0:91035:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x2a3:0x0], count =127 00000004:00080000:3.0:1788872791.354479:0:91035:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x2a3:0x0]+127 in llog 00000004:00080000:3.0:1788872791.354516:0:91035:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x322:0x0], index 1: 0 00000004:00080000:3.0:1788872791.354524:0:91035:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x323:0x0], index 0: 0 00010000:00010000:3.0:1788872791.354636:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da965 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf6e expref: 14 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.354647:0:91035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1f7a400) 00010000:00010000:3.0:1788872791.354650:0:91035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788872791.354663:0:91035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441a00/0xe4e6e89fb01da95e lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf6e expref: 14 pid: 91035 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.354677:0:91035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da965 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf6e expref: 13 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.355055:0:91035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1f7a400) 00010000:00010000:3.0:1788872791.355059:0:91035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788872791.355061:0:91035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3e00, rc 0) 00010000:00080000:3.0:1788872791.355126:0:91035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788872791.355142:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872791.355145:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000020:00080000:3.0:1788872791.355148:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872791.355150:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000100:00100000:2.0:1788872791.370439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872791.373525:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311182592 00000100:00100000:1.0:1788872791.373540:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311182592 00000100:00100000:1.0:1788872791.373773:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1295 00000100:00100000:1.0:1788872791.373786:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:2403:x1875765311182592:12345-192.168.204.39@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788872791.373814:0:68674:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a9c12aed80 x1875765311182592/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:717/0 lens 224/0 e 0 to 0 dl 1788872802 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872791.373850:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:2403:x1875765311182592:12345-192.168.204.39@tcp:400:ldlm_lock_repla.0 Request processed in 68us (3420us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872791.373859:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1295 00000020:00080000:1.0:1788872791.374496:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872791.374502:0:91035:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149710 00010000:00080000:1.0:1788872791.374506:0:91035:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788872791.374509:0:91035:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872791.374516:0:91035:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788872791.374518:0:91035:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788872791.374712:0:91035:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 00000001:00100000:3.0:1788872791.392996:0:91001:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00100000:3.0:1788872791.393017:0:91001:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788872791.393036:0:91001:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149709 is committed 00000001:00080000:3.0:1788872791.393091:0:91035:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788872791.393135:0:91035:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788872791.393150:0:91035:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff98a9df5aea00 x1875765327743488/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:717/0 lens 224/0 e 0 to 0 dl 1788872802 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788872791.393913:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01da949 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.393927:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01da949 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.393934:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01da949 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.393941:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872791.393945:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01da949 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.393952:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01da949 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.393970:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9e7bf4300) 00010000:00010000:2.0:1788872791.393973:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872791.393978:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01da949 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.393984:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01da949 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.394019:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da957 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.394026:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da957 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.394031:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da957 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.394042:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872791.394045:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da957 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.394050:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da957 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.394059:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1f7a400) 00010000:00010000:2.0:1788872791.394062:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872791.394065:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da957 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.394070:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9f5441800/0xe4e6e89fb01da957 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788872791.395482:0:91035:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.39@tcp: req@ffff98a9c12aed80 x1875765311182592/t0(0) o400->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:717/0 lens 224/0 e 0 to 0 dl 1788872802 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788872791.395611:0:91035:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1788872791.399963:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1788872791.399984:0:3643:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff98a8ca10b480 x1875765327743488/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872807 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872791.400016:0:3643:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff98a8ca10b480 x1875765327743488/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872807 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872791.400024:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788872791.400044:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1788872791.400052:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000518aec5c): req@ffff98a8c6c97100 x1875765327721088/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872775 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872791.400067:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327743488:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788872791.400152:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327743616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872791.400220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872791.401996:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872791.404638:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327743616 00000100:00100000:0.0:1788872791.404657:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327743616 00000100:00100000:0.0:1788872791.404721:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327721088 00000100:00100000:0.0:1788872791.404724:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327721088 00000100:00100000:0.0:1788872791.404755:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:0.0:1788872791.404766:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327743616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872791.404823:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445105664 avail 1298866176 00000100:00100000:0.0:1788872791.404934:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327743616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 170us (4713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872791.404942:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00100000:0.0:1788872791.404958:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:0.0:1788872791.404965:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327721088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872791.404975:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445105664 avail 1298866176 00000100:00100000:0.0:1788872791.405019:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327721088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (3030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872791.405036:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00100000:0.0:1788872791.405112:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327743616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872791.405124:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327721088:0@lo:41:osp-pre-0-1.0 00000004:00000080:3.0:1788872791.450187:0:91035:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb002c8597e10 00100000:10000000:3.0:1788872791.450202:0:91035:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1788872791.457026:0:91021:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x323:0x0] 00000100:00100000:3.0:1788872791.457086:0:91021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91021:1875765327743744:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788872791.457171:0:91021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.457205:0:91021:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4fd80 going to sleep for 11 seconds 00000004:00080000:3.0:1788872791.457227:0:91023:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x322:0x0] 00000100:00100000:3.0:1788872791.457246:0:91023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91023:1875765327743872:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788872791.457280:0:91023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.457297:0:91023:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872791.460717:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327743744 00000100:00100000:0.0:1788872791.460732:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327743744 00000100:00100000:0.0:1788872791.460792:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327743872 00000100:00100000:0.0:1788872791.460796:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327743872 00000100:00100000:0.0:1788872791.460821:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5972 00000100:00100000:0.0:1788872791.461467:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:91021:x1875765327743744:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788872791.461506:0:26184:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -30 00002000:02000040:0.0:1788872791.461512:0:26184:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:804 to 0x280000401:833) 00000100:00100000:1.0:1788872791.464392:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5973 00000100:00100000:1.0:1788872791.464417:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:91023:x1875765327743872:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788872791.464457:0:26192:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -31 00002000:02000040:1.0:1788872791.464462:0:26192:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:803 to 0x2c0000401:833) 00002000:00010000:0.0:1788872791.481539:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.481587:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b7a5c3e/0xe4e6e89fb01da96c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.481607:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x341:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.481612:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x341:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.481619:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b7a5c3e/0xe4e6e89fb01da96c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.481635:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b7a5c3e/0xe4e6e89fb01da96c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.481645:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b7a5c3e/0xe4e6e89fb01da96c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.481666:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b7a5c3e/0xe4e6e89fb01da96c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.486359:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:02000400:2.0:1788872791.486463:0:91289:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00002000:00010000:0.0:1788872791.487643:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.487656:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3959613/0xe4e6e89fb01da973 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.487674:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x340:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.487679:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x340:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.487685:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3959613/0xe4e6e89fb01da973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.487709:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3959613/0xe4e6e89fb01da973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.487721:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3959613/0xe4e6e89fb01da973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.487729:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3959613/0xe4e6e89fb01da973 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.487754:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788872791.487828:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.487845:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bff7441/0xe4e6e89fb01da97a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.487859:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33f:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.487862:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.487866:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bff7441/0xe4e6e89fb01da97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.487876:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bff7441/0xe4e6e89fb01da97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.487883:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bff7441/0xe4e6e89fb01da97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.487890:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bff7441/0xe4e6e89fb01da97a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.487907:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788872791.487963:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.487968:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da981 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.487975:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33e:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.487978:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.487981:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.488461:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.488484:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.488492:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da981 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.488507:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788872791.488518:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788872791.488524:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b7a5c3e/0xe4e6e89fb01da96c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.488531:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.488536:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b7a5c3e/0xe4e6e89fb01da96c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.488546:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b7a5c3e/0xe4e6e89fb01da96c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.488921:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b7a5c3e/0xe4e6e89fb01da96c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.488931:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b7a5c3e/0xe4e6e89fb01da96c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.488950:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788872791.488959:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3959613/0xe4e6e89fb01da973 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.488967:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.488970:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3959613/0xe4e6e89fb01da973 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.488978:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3959613/0xe4e6e89fb01da973 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489057:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3959613/0xe4e6e89fb01da973 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489066:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3959613/0xe4e6e89fb01da973 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489078:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872791.489081:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bff7441/0xe4e6e89fb01da97a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489088:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.489091:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bff7441/0xe4e6e89fb01da97a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489098:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bff7441/0xe4e6e89fb01da97a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489120:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bff7441/0xe4e6e89fb01da97a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489128:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bff7441/0xe4e6e89fb01da97a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489141:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.489145:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da981 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489151:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.489155:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da981 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489162:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da981 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489172:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da981 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489179:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdae7b95/0xe4e6e89fb01da981 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489189:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.489191:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.489197:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.489262:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.489268:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f6ad194/0xe4e6e89fb01da988 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489277:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33d:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.489280:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.489285:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f6ad194/0xe4e6e89fb01da988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489295:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f6ad194/0xe4e6e89fb01da988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489303:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f6ad194/0xe4e6e89fb01da988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489310:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f6ad194/0xe4e6e89fb01da988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489324:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.489329:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.489333:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f6ad194/0xe4e6e89fb01da988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489339:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.489342:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f6ad194/0xe4e6e89fb01da988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489360:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f6ad194/0xe4e6e89fb01da988 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489370:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f6ad194/0xe4e6e89fb01da988 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489378:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f6ad194/0xe4e6e89fb01da988 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489389:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.489390:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.489392:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.489425:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.489429:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01da98f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489437:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33c:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.489440:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.489444:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01da98f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489452:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01da98f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489459:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01da98f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489471:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01da98f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489482:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.489487:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.489490:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01da98f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489496:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.489500:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01da98f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489508:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01da98f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489517:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01da98f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489523:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01da98f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.489534:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.489536:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.489537:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.490400:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.490416:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082dd2c39/0xe4e6e89fb01da996 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.490426:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33b:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.490429:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.490434:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082dd2c39/0xe4e6e89fb01da996 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.490443:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082dd2c39/0xe4e6e89fb01da996 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.490452:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082dd2c39/0xe4e6e89fb01da996 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.490459:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082dd2c39/0xe4e6e89fb01da996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.490475:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.490484:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.490488:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082dd2c39/0xe4e6e89fb01da996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.490495:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.490499:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082dd2c39/0xe4e6e89fb01da996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.490506:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082dd2c39/0xe4e6e89fb01da996 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.490525:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082dd2c39/0xe4e6e89fb01da996 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.490532:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082dd2c39/0xe4e6e89fb01da996 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.491099:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.494376:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.494386:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.494392:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872791.494546:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872791.494597:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032639e62/0xe4e6e89fb01da99d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.494617:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x341:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:1.0:1788872791.494621:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x341:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872791.494627:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032639e62/0xe4e6e89fb01da99d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.494660:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032639e62/0xe4e6e89fb01da99d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.494671:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032639e62/0xe4e6e89fb01da99d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.494679:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032639e62/0xe4e6e89fb01da99d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.494716:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872791.494725:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872791.494730:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032639e62/0xe4e6e89fb01da99d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.494738:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.494743:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032639e62/0xe4e6e89fb01da99d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.494752:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032639e62/0xe4e6e89fb01da99d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.494769:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032639e62/0xe4e6e89fb01da99d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.494777:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032639e62/0xe4e6e89fb01da99d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.494804:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.494806:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.494808:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788872791.496158:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788872791.496177:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.496180:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.496257:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.496265:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015098e1/0xe4e6e89fb01da9a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.496279:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33a:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.496283:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.496288:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015098e1/0xe4e6e89fb01da9a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.496299:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015098e1/0xe4e6e89fb01da9a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.496308:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015098e1/0xe4e6e89fb01da9a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.496315:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015098e1/0xe4e6e89fb01da9a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.496339:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872791.496379:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.496384:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01da9ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.497489:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x339:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.497495:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x339:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.497501:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01da9ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.497516:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01da9ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.497526:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01da9ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.497534:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01da9ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.497564:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788872791.497654:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.497660:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01da9b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.497668:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x338:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.497678:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x338:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.497682:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01da9b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.499603:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01da9b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.499631:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01da9b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.499641:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01da9b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.499675:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788872791.499800:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.499807:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01da9b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.499819:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x337:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.499823:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x337:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.499837:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01da9b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.499851:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01da9b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.499859:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01da9b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.499879:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01da9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.499895:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788872791.499910:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788872791.499917:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015098e1/0xe4e6e89fb01da9a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.499925:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.499929:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015098e1/0xe4e6e89fb01da9a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.499938:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015098e1/0xe4e6e89fb01da9a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500230:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015098e1/0xe4e6e89fb01da9a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500241:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015098e1/0xe4e6e89fb01da9a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500265:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788872791.500269:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01da9ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500286:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.500290:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01da9ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500299:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01da9ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500310:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01da9ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500316:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01da9ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500339:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872791.500342:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01da9b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500348:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.500351:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01da9b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500358:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01da9b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500367:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01da9b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500381:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01da9b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500395:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.500398:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01da9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500405:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.500408:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01da9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500414:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01da9b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500424:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01da9b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500430:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01da9b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500441:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.500443:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.500444:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.500501:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.500506:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01da9c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500520:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x336:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.500525:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x336:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.500530:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01da9c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500539:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01da9c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.500546:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01da9c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501197:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01da9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501215:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.501228:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.501231:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01da9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501237:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.501241:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01da9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501247:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01da9c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501271:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01da9c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501278:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01da9c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501293:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.501294:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.501296:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.501359:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.501365:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01da9c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501373:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x335:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.501377:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x335:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.501381:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01da9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501391:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01da9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501398:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01da9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501405:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01da9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501427:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.501434:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.501438:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01da9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501443:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.501446:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01da9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501454:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01da9c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501464:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01da9c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501470:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01da9c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501481:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.501482:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.501484:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.501525:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.501530:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01da9ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.501538:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x334:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.501545:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x334:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.504690:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01da9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.504719:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01da9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.504740:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01da9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.504749:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01da9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.504772:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.504786:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.504792:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01da9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.504800:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.504804:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01da9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.504813:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01da9ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.504830:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01da9ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.504850:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01da9ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.504873:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.504875:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.504877:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.504984:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.504990:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01da9d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505014:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x333:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.505019:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x333:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.505023:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01da9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505033:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01da9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505040:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01da9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505047:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01da9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505060:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.505073:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.505077:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01da9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505083:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.505086:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01da9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505094:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01da9d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505105:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01da9d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505112:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01da9d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505123:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.505125:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.505127:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.505171:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.505176:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01da9dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505184:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x332:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.505187:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x332:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.505191:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01da9dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505211:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01da9dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505218:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01da9dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505224:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01da9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505235:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.505241:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.505245:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01da9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505251:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.505254:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01da9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505261:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01da9dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505270:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01da9dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505277:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01da9dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505295:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.505297:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.505299:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.505357:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.505362:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da9e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505369:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x331:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.505372:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x331:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.505375:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505384:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505390:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505396:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505407:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.505412:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.505415:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505430:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.505433:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505439:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da9e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505449:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da9e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505456:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01da9e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505469:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.505470:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.505472:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.505515:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.505520:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da9ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505528:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x330:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.505531:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x330:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.505535:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da9ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505543:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da9ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505578:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da9ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505585:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505596:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.505603:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.505606:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505612:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.505615:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505622:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da9ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505631:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da9ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505639:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01da9ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505651:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.505659:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.505661:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.505702:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.505707:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da9f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505714:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32f:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.505716:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.505720:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505728:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505734:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505740:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505752:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.505759:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.505762:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505768:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.505771:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505790:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da9f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505800:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da9f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505807:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01da9f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505819:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.505821:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.505822:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.505861:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.505867:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da9f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505874:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32e:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.505877:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.505881:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505890:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505897:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505909:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505920:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.505927:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.505930:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505936:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.505939:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505946:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505955:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da9f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505961:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01da9f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.505972:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.505973:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.505975:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.506031:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.506042:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da9ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.506050:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32d:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.506053:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.506057:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.506067:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.506075:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.506082:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.506093:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.510820:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.510848:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.510865:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.510870:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.510884:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da9ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.510931:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da9ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.510940:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01da9ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.510979:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.510982:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.510984:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.511491:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.511499:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.511504:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872791.512047:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872791.512058:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01daa06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.512075:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x340:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:1.0:1788872791.512079:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x340:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872791.512086:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01daa06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.512101:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01daa06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.512111:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01daa06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.512118:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01daa06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.512138:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872791.512149:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872791.512163:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01daa06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788872791.512167:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788872791.512172:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9de00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.512178:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01daa06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.512186:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01daa06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.512199:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01daa06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.512207:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9392df5/0xe4e6e89fb01daa06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.512222:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.512224:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.512225:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.513410:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.513420:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01daa0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.513435:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32c:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.513440:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.513445:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01daa0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.513458:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01daa0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.513467:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01daa0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.513475:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01daa0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.513509:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872791.513932:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872791.513940:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01daa0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.513950:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.513955:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01daa0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.513976:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01daa0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.513992:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01daa0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514011:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01daa0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514032:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.514034:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.514036:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872791.514118:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872791.514124:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01daa14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514134:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33f:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:1.0:1788872791.514138:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872791.514143:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01daa14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514153:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01daa14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514162:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01daa14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514175:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01daa14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514189:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872791.514196:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872791.514201:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01daa14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514208:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.514212:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01daa14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514220:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01daa14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514232:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01daa14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872791.514305:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.514312:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01daa1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514332:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32b:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.514341:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872791.514342:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f237e439/0xe4e6e89fb01daa14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514346:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01daa1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514363:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01daa1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514365:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.514368:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.514371:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.514375:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01daa1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514385:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01daa1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514407:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872791.514412:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872791.514424:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01daa1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514432:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.514436:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01daa1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514445:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01daa1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.514458:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01daa1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872791.514464:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872791.514466:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01daa1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514473:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01daa22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514482:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32a:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:1.0:1788872791.514486:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.514490:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.514493:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872791.514495:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.514500:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01daa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514510:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01daa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514518:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01daa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872791.514519:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872791.514531:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01daa29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514532:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01daa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514606:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872791.514657:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.514662:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01daa30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514669:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x329:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.514672:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x329:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.514675:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01daa30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514682:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01daa30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514689:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01daa30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514900:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01daa30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514916:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788872791.514968:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.514973:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000874308b4/0xe4e6e89fb01daa37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.514982:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x328:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.514985:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x328:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872791.515970:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33e:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:1.0:1788872791.515980:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872791.515987:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01daa29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516023:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01daa29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516032:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01daa29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516040:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01daa29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516053:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872791.516058:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01daa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516058:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000874308b4/0xe4e6e89fb01daa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516076:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.516082:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01daa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516086:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000874308b4/0xe4e6e89fb01daa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516092:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01daa22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516102:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000874308b4/0xe4e6e89fb01daa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516110:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01daa22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516112:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000874308b4/0xe4e6e89fb01daa37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516126:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01daa22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516139:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788872791.516161:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872791.516165:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01daa30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516172:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.516175:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01daa30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516183:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01daa30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516194:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01daa30 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516201:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01daa30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872791.516212:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872791.516216:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.516220:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0713fc5/0xe4e6e89fb01daa3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516221:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000874308b4/0xe4e6e89fb01daa37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516230:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.516241:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x327:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.516245:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x327:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.516250:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0713fc5/0xe4e6e89fb01daa3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516259:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0713fc5/0xe4e6e89fb01daa3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516267:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0713fc5/0xe4e6e89fb01daa3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516274:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0713fc5/0xe4e6e89fb01daa3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516289:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872791.516336:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.516341:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d84f7c59/0xe4e6e89fb01daa45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516349:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x326:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.516353:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x326:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.516357:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d84f7c59/0xe4e6e89fb01daa45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516365:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d84f7c59/0xe4e6e89fb01daa45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516385:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d84f7c59/0xe4e6e89fb01daa45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516392:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d84f7c59/0xe4e6e89fb01daa45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516400:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788872791.516449:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.516454:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01daa4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516464:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x325:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.516467:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x325:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.516471:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01daa4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516493:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01daa4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516508:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01daa4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516515:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01daa4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516538:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788872791.516625:0:26184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.516630:0:26184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fd9ce15/0xe4e6e89fb01daa53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516638:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x324:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.516641:0:26184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x324:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.516644:0:26184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fd9ce15/0xe4e6e89fb01daa53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516652:0:26184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fd9ce15/0xe4e6e89fb01daa53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516659:0:26184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fd9ce15/0xe4e6e89fb01daa53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516667:0:26184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fd9ce15/0xe4e6e89fb01daa53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.516677:0:26184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:0.0:1788872791.516718:0:26184:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:803 00000100:00100000:3.0:1788872791.516870:0:91021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91021:1875765327743744:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788872791.516886:0:91021:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x341:0x0] from OST, last_created [0x280000401:0x341:0x0]last_used is [0x280000401:0x323:0x0] 00010000:00010000:1.0:1788872791.516923:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000874308b4/0xe4e6e89fb01daa37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516944:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000874308b4/0xe4e6e89fb01daa37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516955:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000874308b4/0xe4e6e89fb01daa37 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516961:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000874308b4/0xe4e6e89fb01daa37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516974:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788872791.516978:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0713fc5/0xe4e6e89fb01daa3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516983:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.516986:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0713fc5/0xe4e6e89fb01daa3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.516992:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0713fc5/0xe4e6e89fb01daa3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517012:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0713fc5/0xe4e6e89fb01daa3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517020:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0713fc5/0xe4e6e89fb01daa3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517044:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872791.517047:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d84f7c59/0xe4e6e89fb01daa45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517053:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.517056:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d84f7c59/0xe4e6e89fb01daa45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517063:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d84f7c59/0xe4e6e89fb01daa45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517073:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d84f7c59/0xe4e6e89fb01daa45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517079:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d84f7c59/0xe4e6e89fb01daa45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517089:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872791.517092:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01daa4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517098:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.517101:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01daa4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517120:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01daa4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517130:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01daa4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517138:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6cc56ae/0xe4e6e89fb01daa4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517150:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872791.517153:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fd9ce15/0xe4e6e89fb01daa53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517158:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.517161:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fd9ce15/0xe4e6e89fb01daa53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517168:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fd9ce15/0xe4e6e89fb01daa53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517175:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fd9ce15/0xe4e6e89fb01daa53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517182:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fd9ce15/0xe4e6e89fb01daa53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.517205:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.517206:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.517209:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.517217:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.517222:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.517227:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872791.517295:0:91021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91021:1875765327744128:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788872791.517334:0:91021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.517358:0:91021:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872791.517373:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327744000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872791.517440:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.517482:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327744128 00000100:00100000:3.0:1788872791.517488:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327744128 00000100:00100000:3.0:1788872791.517530:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5974 00000100:00100000:3.0:1788872791.517539:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:91021:x1875765327744128:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788872791.517889:0:26183:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 834 00000100:00100000:0.0:1788872791.518424:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:91021:x1875765327743744:12345-0@lo:5:osp-pre-0-0.0 Request processed in 55997us (59655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872791.518436:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5972 00010000:00010000:1.0:1788872791.519420:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872791.519503:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.519518:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01daa29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872791.519529:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:91021:x1875765327744128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1986us (2190us total) trans 4294969453 rc 0/0 00010000:00010000:0.0:1788872791.519534:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.519539:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01daa29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872791.519540:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5974 00010000:00010000:0.0:1788872791.519572:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01daa29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.519599:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01daa29 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872791.519601:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327744000 00000100:00100000:3.0:1788872791.519609:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327744000 00010000:00010000:0.0:1788872791.519610:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b3d0e6b/0xe4e6e89fb01daa29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.519638:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.519641:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.519644:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872791.519654:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:3.0:1788872791.519663:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327744000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788872791.519684:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872791.519727:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327744000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (2286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872791.519742:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:3.0:1788872791.519882:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327744000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872791.519884:0:91021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91021:1875765327744128:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788872791.519902:0:91021:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x341:0x0]-[0x280000401:0x361:0x0] 00002000:00010000:0.0:1788872791.520131:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.520140:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01daa5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520153:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33d:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.520158:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.520166:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01daa5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520192:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01daa5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520201:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01daa5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520210:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01daa5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520248:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872791.520305:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.520311:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01daa61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520320:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33c:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.520323:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.520327:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01daa61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520337:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01daa61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520345:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01daa61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520363:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01daa61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520378:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788872791.520430:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.520436:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01daa68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520445:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33b:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.520448:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.520452:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01daa68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520462:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01daa68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520469:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01daa68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520475:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01daa68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520488:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788872791.520528:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.520532:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01daa6f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520572:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33a:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.520576:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.520580:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01daa6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520590:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01daa6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520598:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01daa6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520605:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01daa6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520624:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788872791.520660:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788872791.520667:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01daa5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872791.520669:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.520680:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01daa76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.520683:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872791.520690:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01daa5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.520701:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01daa5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520707:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x339:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.520712:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x339:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872791.520717:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01daa5a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520718:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01daa76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.520736:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d15e1f/0xe4e6e89fb01daa5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520748:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01daa76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520770:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01daa76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.520774:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788872791.520779:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01daa76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.520791:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788872791.520895:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01daa61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.520906:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.520910:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01daa61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.520920:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01daa61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.520931:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01daa61 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.520938:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f9cf878/0xe4e6e89fb01daa61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.520966:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872791.520970:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01daa68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.520976:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.520979:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01daa68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.520986:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01daa68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.520995:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01daa68 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.521013:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcca7d44/0xe4e6e89fb01daa68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.521025:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872791.521028:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01daa6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.521034:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.521037:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01daa6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.521056:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01daa6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.521067:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01daa6f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.521073:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1d8845a/0xe4e6e89fb01daa6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.521085:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872791.521089:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01daa76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.521095:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.521098:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01daa76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.521106:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01daa76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.521115:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01daa76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.521122:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a8f8a00/0xe4e6e89fb01daa76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.521145:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.521147:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.521148:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.521155:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.521162:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.521710:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.521714:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.521716:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.524411:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.524426:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01daa7d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.524444:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x338:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.524448:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x338:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.524454:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01daa7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.524469:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01daa7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.524479:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01daa7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.524486:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01daa7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.524534:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872791.524616:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872791.524625:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01daa7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.524636:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872791.524640:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01daa7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.524650:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01daa7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872791.524666:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.524669:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01daa7d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.524673:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01daa84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.524696:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x337:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.524697:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01daa7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.524702:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x337:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.524711:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01daa84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.524719:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.524722:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01daa84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.524723:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.524726:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.524735:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01daa84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.524742:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01daa84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.524765:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872791.524796:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872791.524802:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01daa84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872791.524809:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.524811:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.524816:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01daa8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.524817:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01daa84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.524834:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01daa84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.524846:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01daa84 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.524853:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01daa84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.524865:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.524867:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.524874:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.525158:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x336:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.525169:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x336:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.525174:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01daa8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525184:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01daa8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525193:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01daa8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525199:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01daa8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525224:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872791.525269:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.525274:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01daa92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525281:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x335:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.525284:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x335:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.525287:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01daa92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525296:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01daa92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525304:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01daa92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525317:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01daa92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525340:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788872791.525363:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788872791.525370:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01daa8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.525371:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872791.525381:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01daa92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.525383:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4600 already unused, calling callback (ffffffffc0dc5220) 00002000:00010000:0.0:1788872791.525386:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.525390:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01daa8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525398:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01daa99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.525407:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872791.525414:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01daa92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.525417:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01daa8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525419:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x334:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.525429:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x334:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.525440:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01daa99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.525447:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01daa92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.525447:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01daa8b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525452:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01daa99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.525474:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01daa8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525476:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01daa99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.525480:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01daa92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525501:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01daa99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.525503:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e67c1242/0xe4e6e89fb01daa92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.525505:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.525509:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.525513:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872791.525536:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872791.525540:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01daa99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525542:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788872791.525582:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788872791.525602:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.525609:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01daaa0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525622:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x333:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.525626:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x333:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.525630:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01daaa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525640:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01daaa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525648:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01daaa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525654:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01daaa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525674:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788872791.525734:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872791.525740:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e348c4f2/0xe4e6e89fb01daaa7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525749:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x332:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:0.0:1788872791.525752:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x332:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872791.525756:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e348c4f2/0xe4e6e89fb01daaa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525764:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e348c4f2/0xe4e6e89fb01daaa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525783:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e348c4f2/0xe4e6e89fb01daaa7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525790:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e348c4f2/0xe4e6e89fb01daaa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.525802:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788872791.525895:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788872791.525901:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01daaa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.525919:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872791.525925:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01daaa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.525926:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872791.525931:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01daa99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.525954:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01daaa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.525955:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01daa99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.525976:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01daaa0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.525984:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01daaa0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.525997:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872791.526010:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e348c4f2/0xe4e6e89fb01daaa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.526016:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872791.526019:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e348c4f2/0xe4e6e89fb01daaa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.526026:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e348c4f2/0xe4e6e89fb01daaa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.526035:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e348c4f2/0xe4e6e89fb01daaa7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.526043:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e348c4f2/0xe4e6e89fb01daaa7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.526066:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.526068:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.526070:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.526076:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872791.526095:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01daa99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.526103:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01daa99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.526127:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872791.526129:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872791.526130:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788872791.527663:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.527676:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01daaae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.527691:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x331:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.527695:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x331:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.527700:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01daaae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.527711:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01daaae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.527720:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01daaae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.527727:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01daaae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.527752:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872791.527862:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872791.527869:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01daaae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.527878:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aec00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.527882:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01daaae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.527890:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01daaae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.527905:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01daaae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.527912:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01daaae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788872791.528025:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.528031:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01daab5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528049:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x330:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.528052:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x330:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.528056:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01daab5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528066:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01daab5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528074:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01daab5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528081:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01daab5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528100:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788872791.528142:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.528147:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01daabc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528155:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32f:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.528158:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.528162:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01daabc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528170:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01daabc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528188:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01daabc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528194:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01daabc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528209:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788872791.528218:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788872791.528224:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01daab5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528230:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872791.528243:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01daab5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528253:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01daab5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528264:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01daab5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528271:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01daab5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528284:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872791.528295:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01daabc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528302:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872791.528305:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01daabc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528312:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01daabc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528323:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01daabc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528329:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01daabc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528341:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.528342:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.528344:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788872791.528386:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.528391:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01daac3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528399:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32e:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.528401:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.528405:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01daac3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528426:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01daac3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528433:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01daac3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.528440:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01daac3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.535970:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872791.536119:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01daac3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.536136:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58afe00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.536141:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01daac3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.536154:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01daac3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.536178:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01daac3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.536189:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.536191:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.542697:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788872791.542714:0:26192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01daac3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788872791.542880:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.542887:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01daaca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.542902:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32d:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.542907:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.542913:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01daaca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.542929:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01daaca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.542962:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01daaca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.542971:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01daaca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.546693:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872791.546710:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01daaca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.546726:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872791.546732:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01daaca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.546743:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01daaca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.546776:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01daaca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872791.546910:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872791.546912:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872791.546914:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872791.546922:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.547018:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788872791.547027:0:26192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01daaca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788872791.547185:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.547192:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01daad1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547204:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32c:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.547208:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.547214:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01daad1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547228:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01daad1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547248:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01daad1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547271:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01daad1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.547309:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872791.547341:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872791.547397:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:2.0:1788872791.547442:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.547448:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01daad8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547456:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32b:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.547459:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.547463:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01daad8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547472:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01daad8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547481:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01daad8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547488:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01daad8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547511:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788872791.547578:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.547583:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01daadf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547596:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32a:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.547599:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.547603:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01daadf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547613:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01daadf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547621:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01daadf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547628:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01daadf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547643:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788872791.547683:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.547688:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c98dd303/0xe4e6e89fb01daae6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547696:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x329:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.547699:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x329:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.547703:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c98dd303/0xe4e6e89fb01daae6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547710:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c98dd303/0xe4e6e89fb01daae6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547730:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c98dd303/0xe4e6e89fb01daae6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547736:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c98dd303/0xe4e6e89fb01daae6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547743:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788872791.547865:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.547871:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054047fda/0xe4e6e89fb01daaed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547880:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x328:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.547883:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x328:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.547887:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054047fda/0xe4e6e89fb01daaed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547896:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054047fda/0xe4e6e89fb01daaed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547904:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054047fda/0xe4e6e89fb01daaed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547911:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054047fda/0xe4e6e89fb01daaed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547932:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788872791.547972:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.547976:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01daaf4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.547984:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x327:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.547987:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x327:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.547990:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01daaf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548010:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01daaf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548018:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01daaf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548025:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01daaf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548034:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788872791.548075:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.548080:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003056dfa4/0xe4e6e89fb01daafb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548087:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x326:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.548095:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x326:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.548100:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003056dfa4/0xe4e6e89fb01daafb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548108:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003056dfa4/0xe4e6e89fb01daafb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548116:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003056dfa4/0xe4e6e89fb01daafb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548124:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003056dfa4/0xe4e6e89fb01daafb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548132:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788872791.548169:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.548174:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01dab02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548181:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x325:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.548184:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x325:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.548188:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01dab02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548196:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01dab02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548204:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01dab02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548217:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01dab02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548226:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788872791.548413:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.548418:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009976e8b6/0xe4e6e89fb01dab09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548427:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x324:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.548430:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x324:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.548434:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009976e8b6/0xe4e6e89fb01dab09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548443:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009976e8b6/0xe4e6e89fb01dab09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548451:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009976e8b6/0xe4e6e89fb01dab09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548457:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009976e8b6/0xe4e6e89fb01dab09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548466:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788872791.548502:0:26192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872791.548507:0:26192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf409bf1/0xe4e6e89fb01dab10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548521:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x323:0x0].0x0 since=3728s v=(0 0) 00010000:00010000:2.0:1788872791.548523:0:26192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x323:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872791.548527:0:26192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf409bf1/0xe4e6e89fb01dab10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548537:0:26192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf409bf1/0xe4e6e89fb01dab10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548544:0:26192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf409bf1/0xe4e6e89fb01dab10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548586:0:26192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf409bf1/0xe4e6e89fb01dab10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872791.548597:0:26192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00080000:2.0:1788872791.548629:0:26192:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:802 00000100:00100000:2.0:1788872791.548746:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:91023:x1875765327743872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 84337us (91462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872791.548758:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5973 00010000:00010000:1.0:1788872791.548905:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788872791.548918:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01daad8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.548928:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.548933:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01daad8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.548942:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01daad8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.548962:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01daad8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.548970:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01daad8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.548991:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788872791.548995:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01daadf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549020:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.549024:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01daadf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549031:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01daadf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549053:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01daadf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549059:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01daadf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549072:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788872791.549075:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c98dd303/0xe4e6e89fb01daae6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549080:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5a000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.549083:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c98dd303/0xe4e6e89fb01daae6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549090:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c98dd303/0xe4e6e89fb01daae6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549098:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c98dd303/0xe4e6e89fb01daae6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549104:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c98dd303/0xe4e6e89fb01daae6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549113:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788872791.549116:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054047fda/0xe4e6e89fb01daaed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549127:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5b400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.549131:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054047fda/0xe4e6e89fb01daaed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549137:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054047fda/0xe4e6e89fb01daaed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549146:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054047fda/0xe4e6e89fb01daaed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549153:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054047fda/0xe4e6e89fb01daaed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549167:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788872791.549170:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01daaf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549175:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5ac00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.549178:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01daaf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549184:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01daaf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549192:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01daaf4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549205:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01daaf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549217:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788872791.549220:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003056dfa4/0xe4e6e89fb01daafb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549226:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5b800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.549228:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003056dfa4/0xe4e6e89fb01daafb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549252:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003056dfa4/0xe4e6e89fb01daafb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549262:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003056dfa4/0xe4e6e89fb01daafb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549269:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003056dfa4/0xe4e6e89fb01daafb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549280:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872791.549284:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01dab02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549291:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5ba00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.549300:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01dab02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549308:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01dab02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549318:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01dab02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549325:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01dab02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549338:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872791.549341:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009976e8b6/0xe4e6e89fb01dab09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549348:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5b600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.549352:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009976e8b6/0xe4e6e89fb01dab09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549359:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009976e8b6/0xe4e6e89fb01dab09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549367:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009976e8b6/0xe4e6e89fb01dab09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549374:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009976e8b6/0xe4e6e89fb01dab09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549392:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872791.549396:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf409bf1/0xe4e6e89fb01dab10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549403:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5bc00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872791.549406:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf409bf1/0xe4e6e89fb01dab10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549413:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf409bf1/0xe4e6e89fb01dab10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549424:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf409bf1/0xe4e6e89fb01dab10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549431:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf409bf1/0xe4e6e89fb01dab10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.549443:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.549445:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.549447:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872791.549582:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01daad1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.549600:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aee00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872791.549603:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01daad1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.549612:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01daad1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.549623:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01daad1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872791.549629:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01daad1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872791.550327:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.550331:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872791.550333:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872791.550663:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872791.550672:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872791.550721:0:91023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91023:1875765327743872:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788872791.550740:0:91023:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x341:0x0] from OST, last_created [0x2c0000401:0x341:0x0]last_used is [0x2c0000401:0x322:0x0] 00000100:00100000:3.0:1788872791.550913:0:91023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df455500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91023:1875765327744384:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788872791.550967:0:91023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.551057:0:91023:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872791.551072:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788872791.551084:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327744256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872791.551113:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872791.551148:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327744384 00000100:00100000:3.0:1788872791.551156:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327744384 00000100:00100000:3.0:1788872791.551193:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5975 00000100:00100000:3.0:1788872791.551202:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:91023:x1875765327744384:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788872791.551346:0:26190:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 834 00000100:00100000:2.0:1788872791.551605:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327744256 00000100:00100000:2.0:1788872791.551609:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327744256 00000100:00100000:2.0:1788872791.551661:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:2.0:1788872791.551669:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327744256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872791.551682:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 896 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872791.551728:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327744256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872791.551744:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00100000:3.0:1788872791.555412:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:91023:x1875765327744384:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4202us (4436us total) trans 4294969454 rc 0/0 00000100:00100000:3.0:1788872791.555429:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5975 00000100:00100000:3.0:1788872791.555498:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327744256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872791.557757:0:91023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df455500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91023:1875765327744384:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788872791.557909:0:91023:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x341:0x0]-[0x2c0000401:0x361:0x0] 00000001:00100000:3.0:1788872791.752122:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788872792.376671:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788872792.498436:0:91341:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788872792.498668:0:91341:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788872792.761912:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327744512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872792.762011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872792.762163:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872792.762173:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327744640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872792.762203:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872792.762237:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327744512 00000100:00100000:2.0:1788872792.762245:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327744512 00000100:00100000:2.0:1788872792.762282:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327744640 00000100:00100000:2.0:1788872792.762285:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327744640 00000100:00100000:2.0:1788872792.762304:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:2.0:1788872792.762312:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327744512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872792.762333:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872792.762378:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327744512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872792.762386:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00100000:2.0:1788872792.762403:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:2.0:1788872792.762409:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327744640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872792.762419:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872792.762446:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327744640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872792.762452:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00100000:2.0:1788872792.762507:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327744640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872792.762532:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327744512:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788872793.401698:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788872793.560839:0:91392:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788872793.561263:0:91392:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788872794.425076:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872795.452265:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872795.720110:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872795.720288:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311182720 00000100:00100000:3.0:1788872795.720298:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311182720 00000100:00100000:3.0:1788872795.720379:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1284 00000100:00100000:3.0:1788872795.720389:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:69907:x1875765311182720:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872795.720409:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872795.720431:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fafbb expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872795.720512:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dab1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872795.720527:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dab1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872795.720539:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dab1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872795.720624:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872795.720629:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872795.720667:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dab1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872795.720692:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafbb expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788872795.720789:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788872795.720944:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dab1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafbb expref: 8 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872795.720954:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1f7a800) 00010000:00010000:3.0:1788872795.720957:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872795.720960:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2e00, rc 0) 00000100:00100000:3.0:1788872795.721072:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:69907:x1875765311182720:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 683us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872795.721080:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1284 00000100:00100000:0.0:1788872795.740910:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872795.741245:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311182848 00000100:00100000:3.0:1788872795.741262:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311182848 00000100:00100000:3.0:1788872795.741362:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1285 00000100:00100000:3.0:1788872795.741375:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:69907:x1875765311182848:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872795.741514:0:83669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445105664 avail 1298866176 00000100:00100000:3.0:1788872795.741879:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:69907:x1875765311182848:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 504us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872795.741890:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1285 00000100:00100000:0.0:1788872795.746375:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872795.746653:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311182976 00000100:00100000:2.0:1788872795.746667:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311182976 00000100:00100000:2.0:1788872795.746797:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1286 00000100:00100000:2.0:1788872795.746810:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:69907:x1875765311182976:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:2.0:1788872795.746866:0:66193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872795.746972:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:69907:x1875765311182976:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 165us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872795.746980:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1286 00000100:00080000:0.0:1788872795.748183:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872795.750481:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872795.750727:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311183104 00000100:00100000:3.0:1788872795.750742:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311183104 00000100:00100000:3.0:1788872795.750836:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2111 00000100:00100000:3.0:1788872795.750849:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:69907:x1875765311183104:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872795.750900:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872795.751010:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:69907:x1875765311183104:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 164us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872795.751018:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2111 00000100:00080000:0.0:1788872795.751100:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872795.758643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872795.758814:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311183232 00000100:00100000:2.0:1788872795.758824:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311183232 00000100:00100000:2.0:1788872795.758897:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2112 00000100:00100000:2.0:1788872795.758909:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:69907:x1875765311183232:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:2.0:1788872795.758952:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872795.759177:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:69907:x1875765311183232:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 270us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872795.759185:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2112 00000100:00080000:0.0:1788872795.759529:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872796.345093:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327745024:0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.345172:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872796.345229:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327745536:0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.345268:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872796.345303:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327746048:0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.345322:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872796.345344:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788872796.345349:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327744896:0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.345367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872796.345381:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327745408:0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.345399:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872796.345414:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327745920:0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.345432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872796.345464:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327745408 00000100:00100000:0.0:1788872796.345471:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327745408 00000100:00100000:0.0:1788872796.345516:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327745920 00000100:00100000:0.0:1788872796.345519:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327745920 00000100:00100000:0.0:1788872796.345537:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:0.0:1788872796.345544:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327745408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.345643:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327745408:12345-0@lo:400:kworker.0 Request processed in 99us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872796.345651:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00100000:0.0:1788872796.345667:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:0.0:1788872796.345673:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327745920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.345703:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327745920:12345-0@lo:400:kworker.0 Request processed in 30us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872796.345708:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:0.0:1788872796.345732:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327745024 00000100:00100000:0.0:1788872796.345735:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327745024 00000100:00100000:0.0:1788872796.346013:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327744896 00000100:00100000:0.0:1788872796.346016:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327744896 00000100:00100000:0.0:1788872796.346043:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:0.0:1788872796.346049:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327745024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.346087:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327745024:12345-0@lo:400:kworker.0 Request processed in 38us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872796.346093:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:0.0:1788872796.346105:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:0.0:1788872796.346112:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327744896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.346141:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327744896:12345-0@lo:400:kworker.0 Request processed in 30us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872796.346146:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00080000:0.0:1788872796.346164:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872796.346169:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872796.346196:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327744896:0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.346207:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327745408:0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.346217:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327745920:0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.346225:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327745024:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.346523:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327745152:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.346599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872796.346627:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327745664:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.346651:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872796.346668:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327746176:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.346688:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872796.346709:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788872796.346716:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327744768:0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.346917:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327745152 00000100:00100000:0.0:1788872796.346922:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327745152 00000100:00100000:0.0:1788872796.346963:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:0.0:1788872796.346969:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327745152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.347010:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327745152:12345-0@lo:400:kworker.0 Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872796.347017:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00080000:0.0:1788872796.347033:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872796.347058:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327745536 00000100:00100000:0.0:1788872796.347069:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327745536 00000100:00100000:0.0:1788872796.347098:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327746048 00000100:00100000:0.0:1788872796.347100:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327746048 00000100:00100000:0.0:1788872796.347117:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327745664 00000100:00100000:0.0:1788872796.347119:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327745664 00000100:00100000:0.0:1788872796.347132:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327746176 00000100:00100000:0.0:1788872796.347134:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327746176 00000100:00100000:0.0:1788872796.347150:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:0.0:1788872796.347155:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327745536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872796.347194:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327745536:12345-0@lo:400:kworker.0 Request processed in 39us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872796.347200:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:0.0:1788872796.347211:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:0.0:1788872796.347216:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327746048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872796.347443:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:1.0:1788872796.347461:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327745664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872796.347590:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:2.0:1788872796.347599:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327746176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.352062:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872796.352141:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327745280:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.352230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872796.352270:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327745792:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.352293:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872796.352311:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327746304:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.352330:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872796.352371:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327745152:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.352442:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327744768 00000100:00100000:3.0:1788872796.352449:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327744768 00000100:00100000:3.0:1788872796.352502:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788872796.352511:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327744768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.352581:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327744768:12345-0@lo:400:kworker.0 Request processed in 70us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872796.352588:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788872796.352625:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327745280 00000100:00100000:3.0:1788872796.352628:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327745280 00000100:00100000:3.0:1788872796.352662:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327745792 00000100:00100000:3.0:1788872796.352665:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327745792 00000100:00100000:3.0:1788872796.352676:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327746304 00000100:00100000:3.0:1788872796.352678:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327746304 00000100:00100000:3.0:1788872796.352690:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:3.0:1788872796.352696:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327745280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.352728:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327745280:12345-0@lo:400:kworker.0 Request processed in 31us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872796.352734:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:3.0:1788872796.352757:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:3.0:1788872796.352762:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327745792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.352798:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327745792:12345-0@lo:400:kworker.0 Request processed in 35us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872796.352804:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:3.0:1788872796.352814:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:3.0:1788872796.352819:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327746304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.352841:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327746304:12345-0@lo:400:kworker.0 Request processed in 22us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872796.352846:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:3.0:1788872796.352881:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327744768:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.352893:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327745280:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.352902:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327745792:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.352926:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327746304:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.353160:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327745536:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.353173:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327746048:0@lo:400:kworker.0 00000100:00100000:3.0:1788872796.353187:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788872796.353194:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327746432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872796.353225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788872796.353250:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872796.353256:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872796.353259:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872796.353292:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327746432 00000100:00100000:3.0:1788872796.353295:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327746432 00000100:00100000:3.0:1788872796.353320:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:3.0:1788872796.353326:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327746432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788872796.353359:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:3.0:1788872796.353396:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327746432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872796.353403:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:3.0:1788872796.353429:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327746432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872796.365458:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327746048:12345-0@lo:400:kworker.0 Request processed in 18232us (20125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872796.365474:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:1.0:1788872796.365892:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327745664:12345-0@lo:400:kworker.0 Request processed in 18432us (19238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872796.365902:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00000100:00100000:3.0:1788872796.366013:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327745664:0@lo:400:kworker.0 00000100:00100000:2.0:1788872796.366917:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327746176:12345-0@lo:400:kworker.0 Request processed in 19306us (20214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872796.366928:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00100000:3.0:1788872796.367022:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327746176:0@lo:400:kworker.0 00000100:00100000:1.0:1788872796.434687:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872796.434742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872796.434777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872796.434811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872796.434860:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872796.434893:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311183872 00000100:00100000:1.0:1788872796.434912:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311183872 00000100:00100000:1.0:1788872796.434957:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2625 00000100:00100000:1.0:1788872796.434967:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f660bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311183872:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872796.435050:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f660bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311183872:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872796.435057:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2625 00000100:00100000:1.0:1788872796.435075:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311183744 00000100:00100000:1.0:1788872796.435078:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311183744 00000100:00100000:1.0:1788872796.435099:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2626 00000100:00100000:1.0:1788872796.435104:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f660b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311183744:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872796.435130:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f660b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311183744:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872796.435136:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2626 00000100:00100000:1.0:1788872796.435162:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311183616 00000100:00100000:1.0:1788872796.435165:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311183616 00000100:00100000:1.0:1788872796.435191:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311183488 00000100:00100000:1.0:1788872796.435208:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311183488 00000100:00100000:1.0:1788872796.435234:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1302 00000100:00100000:1.0:1788872796.435240:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311183616:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872796.435269:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311183616:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 29us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872796.435274:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1302 00000100:00100000:1.0:1788872796.435286:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1303 00000100:00100000:1.0:1788872796.435292:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2404:x1875765311183488:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872796.435315:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2404:x1875765311183488:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 24us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872796.435320:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1303 00000100:00100000:2.0:1788872796.435801:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311183360 00000100:00100000:2.0:1788872796.435814:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311183360 00000100:00100000:2.0:1788872796.435852:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 74 00000100:00100000:2.0:1788872796.435860:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311183360:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872796.435913:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311183360:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 44us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872796.435921:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 74 00010000:00010000:1.0:1788872796.472765:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872796.858716:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327746560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872796.859008:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327746688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872796.859059:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872796.859095:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872796.859101:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327746816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872796.859123:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872796.859157:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327746688 00000100:00100000:2.0:1788872796.859165:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327746688 00000100:00100000:2.0:1788872796.859217:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:2.0:1788872796.859226:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327746688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872796.859259:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445105664 avail 1298866176 00000100:00100000:2.0:1788872796.859311:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327746688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872796.859319:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00100000:2.0:1788872796.859344:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327746816 00000100:00100000:2.0:1788872796.859347:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327746816 00000100:00100000:2.0:1788872796.859372:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:2.0:1788872796.859378:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327746816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872796.859392:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872796.859422:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327746816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872796.859437:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00100000:2.0:1788872796.859489:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327746816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872796.859502:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327746688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872796.859656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872796.860975:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327746560 00000100:00100000:2.0:1788872796.860988:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327746560 00000100:00100000:2.0:1788872796.861401:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1788872796.861413:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327746560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872796.861439:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872796.861519:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327746560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872796.861526:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:1.0:1788872796.862192:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327746560:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788872796.863788:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969453 is committed 00000001:00080000:2.0:1788872796.870940:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969454 is committed 00010000:00010000:1.0:1788872797.496669:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872797.881809:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327746944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872797.881903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872797.882015:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327746944 00000100:00100000:0.0:1788872797.882025:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327746944 00000100:00100000:0.0:1788872797.882081:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:0.0:1788872797.882092:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327746944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872797.882123:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872797.884883:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327747072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872797.884965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872797.885086:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327747072 00000100:00100000:2.0:1788872797.885095:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327747072 00000100:00100000:2.0:1788872797.885166:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1788872797.885175:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327747072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872797.885214:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872797.885265:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327747072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872797.885273:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1788872797.885318:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327747072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872797.893535:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327746944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11435us (11621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872797.893560:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:3.0:1788872797.894894:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327746944:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788872798.520826:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872799.549111:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872800.570659:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872801.464935:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327747584:0@lo:400:kworker.0 00000100:00100000:0.0:1788872801.465098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872801.465179:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327748096:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.465351:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327747328:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.465384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872801.465406:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327747840:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.465431:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872801.465447:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327748352:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.465468:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872801.465492:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788872801.465498:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327747200:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.465524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872801.465584:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327747712:0@lo:400:kworker.0 00000100:00100000:0.0:1788872801.465723:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872801.465750:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327748608:0@lo:400:kworker.0 00000100:00100000:0.0:1788872801.465775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872801.465793:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788872801.465798:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327747456:0@lo:400:kworker.0 00000100:00100000:0.0:1788872801.465834:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872801.465856:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327747968:0@lo:400:kworker.0 00000100:00100000:0.0:1788872801.465877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872801.465953:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327748480:0@lo:400:kworker.0 00000100:00100000:0.0:1788872801.465978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872801.466110:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872801.466145:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327748224:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.466168:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872801.466187:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327748736:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.466285:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872801.466323:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327747584 00000100:00100000:3.0:1788872801.466330:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327747584 00000100:00100000:3.0:1788872801.466380:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327747328 00000100:00100000:3.0:1788872801.466383:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327747328 00000100:00100000:3.0:1788872801.466398:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327747456 00000100:00100000:3.0:1788872801.466400:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327747456 00000100:00100000:3.0:1788872801.466412:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327747712 00000100:00100000:3.0:1788872801.466415:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327747712 00000100:00100000:3.0:1788872801.466424:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327748224 00000100:00100000:3.0:1788872801.466426:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327748224 00000100:00100000:3.0:1788872801.466434:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327748736 00000100:00100000:3.0:1788872801.466436:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327748736 00000100:00100000:3.0:1788872801.466449:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1788872801.466456:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327747584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.466513:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327747584:12345-0@lo:400:kworker.0 Request processed in 55us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872801.466520:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1788872801.466536:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:3.0:1788872801.466542:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327747328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872801.466705:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327748096 00000100:00100000:1.0:1788872801.466712:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327748096 00000100:00100000:1.0:1788872801.466742:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327748608 00000100:00100000:1.0:1788872801.466745:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327748608 00000100:00100000:3.0:1788872801.466815:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327747328:12345-0@lo:400:kworker.0 Request processed in 260us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872801.466822:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:3.0:1788872801.466837:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:3.0:1788872801.466843:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327747456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.466895:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327747456:12345-0@lo:400:kworker.0 Request processed in 52us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872801.466901:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:3.0:1788872801.466913:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1788872801.466919:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327747712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.466946:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327747712:12345-0@lo:400:kworker.0 Request processed in 28us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872801.466951:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1788872801.466962:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1788872801.466968:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327748224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.466994:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327748224:12345-0@lo:400:kworker.0 Request processed in 27us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872801.467000:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1788872801.467011:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:3.0:1788872801.469364:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327748736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.469446:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327748736:12345-0@lo:400:kworker.0 Request processed in 2430us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872801.469455:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:3.0:1788872801.469546:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327747840 00000100:00100000:3.0:1788872801.469572:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327747840 00000100:00100000:3.0:1788872801.469608:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327748352 00000100:00100000:3.0:1788872801.469610:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327748352 00000100:00100000:3.0:1788872801.469630:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:3.0:1788872801.469636:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327747840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.469673:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875765327747840:12345-0@lo:400:kworker.0 Request processed in 37us (4242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872801.469687:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:3.0:1788872801.469700:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:3.0:1788872801.469705:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327748352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.469736:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327748352:12345-0@lo:400:kworker.0 Request processed in 31us (4267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872801.469742:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000100:00100000:3.0:1788872801.469769:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327747200 00000100:00100000:3.0:1788872801.469773:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327747200 00000100:00100000:3.0:1788872801.469801:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788872801.469820:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327747200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.469854:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327747200:12345-0@lo:400:kworker.0 Request processed in 35us (4329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872801.469860:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788872801.470296:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327747968 00000100:00100000:0.0:1788872801.470302:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327747968 00000100:00100000:0.0:1788872801.470338:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327748480 00000100:00100000:0.0:1788872801.470341:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327748480 00000100:00100000:0.0:1788872801.470365:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:0.0:1788872801.470373:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327748096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872801.470441:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327748096:12345-0@lo:400:kworker.0 Request processed in 69us (5229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872801.470448:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:0.0:1788872801.470462:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:0.0:1788872801.470469:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327748608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872801.470502:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327748608:12345-0@lo:400:kworker.0 Request processed in 34us (4727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872801.470508:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00100000:0.0:1788872801.470518:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000100:00100000:0.0:1788872801.470533:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327747968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.470683:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:3.0:1788872801.470692:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327748480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.470731:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327748480:12345-0@lo:400:kworker.0 Request processed in 41us (4752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872801.470737:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00080000:3.0:1788872801.470775:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872801.470781:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872801.470785:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872801.470788:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872801.470874:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327747456:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.470889:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327747968:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.470900:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969453 gen 2 00000100:00100000:3.0:1788872801.470927:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327748480:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.470946:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327747584:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.470957:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327748096:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.470966:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 2 00000100:00100000:3.0:1788872801.470976:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327748608:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.471012:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327748864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872801.471689:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327747968:12345-0@lo:400:kworker.0 Request processed in 53us (4707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872801.471698:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000100:00100000:3.0:1788872801.471886:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872801.472333:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327747200:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.472349:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327747712:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.472361:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327748224:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.472534:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327748736:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.472578:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327747328:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.472672:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327747840:0@lo:400:kworker.0 00000100:00100000:3.0:1788872801.472686:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327748352:0@lo:400:kworker.0 00000100:00100000:2.0:1788872801.473411:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327748864 00000100:00100000:2.0:1788872801.473421:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327748864 00000100:00100000:2.0:1788872801.473472:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:2.0:1788872801.473480:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327748864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872801.473528:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1788872801.473619:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327748864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872801.473627:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:2.0:1788872801.473670:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327748864:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788872801.490500:0:91585:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:0.0:1788872801.555760:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872801.555831:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872801.555869:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872801.555894:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872801.555926:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872801.555975:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311184384 00000100:00100000:0.0:1788872801.555984:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311184384 00000100:00100000:0.0:1788872801.556055:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311184512 00000100:00100000:0.0:1788872801.556059:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311184512 00000100:00100000:0.0:1788872801.556099:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2631 00000100:00100000:0.0:1788872801.556112:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311184384:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872801.556196:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311184384:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 87us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872801.556217:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2631 00000100:00100000:0.0:1788872801.556238:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2632 00000100:00100000:0.0:1788872801.556245:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311184512:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872801.556271:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311184512:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872801.556277:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2632 00000100:00100000:0.0:1788872801.556298:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311184000 00000100:00100000:0.0:1788872801.556301:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311184000 00000100:00100000:0.0:1788872801.556329:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 76 00000100:00100000:0.0:1788872801.556348:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311184000:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872801.556374:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311184000:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 27us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872801.556381:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 76 00000100:00100000:0.0:1788872801.556411:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311184128 00000100:00100000:0.0:1788872801.556415:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311184128 00000100:00100000:0.0:1788872801.556445:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311184256 00000100:00100000:0.0:1788872801.556448:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311184256 00000100:00100000:0.0:1788872801.556471:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1310 00000100:00100000:0.0:1788872801.556476:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2404:x1875765311184128:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872801.556528:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2404:x1875765311184128:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 51us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872801.556534:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1310 00000100:00100000:0.0:1788872801.556573:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1311 00000100:00100000:0.0:1788872801.556581:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311184256:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872801.556605:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311184256:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 27us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872801.556611:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1311 00000100:00080000:0.0:1788872801.556652:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872801.556656:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872801.556659:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872801.556660:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788872801.592753:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872801.979234:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872801.979260:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327748992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872801.979333:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872801.979460:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327749248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872801.979489:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872801.979526:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327748992 00000100:00100000:2.0:1788872801.979533:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327748992 00000100:00100000:2.0:1788872801.979602:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327749248 00000100:00100000:2.0:1788872801.979605:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327749248 00000100:00100000:2.0:1788872801.979624:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:2.0:1788872801.979632:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327748992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872801.979664:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872801.979703:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327748992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872801.979710:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:2.0:1788872801.979726:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:2.0:1788872801.979732:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327749248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872801.979747:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872801.979778:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327749248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872801.979784:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00100000:2.0:1788872801.979838:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327749248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872801.979887:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327749120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872801.980689:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872801.980752:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327748992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872801.982132:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327749120 00000100:00100000:2.0:1788872801.982161:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327749120 00000100:00100000:2.0:1788872801.982231:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:2.0:1788872801.982249:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327749120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872801.982291:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445105664 avail 1298866176 00000100:00100000:2.0:1788872801.982379:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327749120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872801.982386:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00000100:00100000:1.0:1788872801.982625:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327749120:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788872802.616862:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872803.001205:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327749376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872803.001406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872803.001515:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872803.001530:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327749504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872803.001606:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872803.001638:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327749376 00000100:00100000:1.0:1788872803.001647:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327749376 00000100:00100000:1.0:1788872803.001701:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327749504 00000100:00100000:1.0:1788872803.001705:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327749504 00000100:00100000:1.0:1788872803.001727:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:1.0:1788872803.001736:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327749376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872803.001769:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872803.002067:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1788872803.002082:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327749504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872803.002095:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872803.002151:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327749504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872803.002158:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00080000:0.0:1788872803.002641:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872803.002647:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872803.002754:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327749376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1018us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872803.002762:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:1.0:1788872803.002833:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327749504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872803.003033:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327749376:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1788872803.257211:0:91634:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1788872803.640928:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872804.664724:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872805.220802:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872805.220927:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311184640 00000100:00100000:3.0:1788872805.220939:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311184640 00000100:00100000:3.0:1788872805.221029:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1287 00000100:00100000:3.0:1788872805.221043:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70375:x1875765311184640:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872805.221084:0:66979:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445105664 avail 1298866176 00000100:00100000:3.0:1788872805.221161:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70375:x1875765311184640:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 121us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872805.221170:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1287 00000100:00080000:0.0:1788872805.221928:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872805.222972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872805.223061:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311184768 00000100:00100000:3.0:1788872805.223069:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311184768 00000100:00100000:3.0:1788872805.223137:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1288 00000100:00100000:3.0:1788872805.223147:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:70375:x1875765311184768:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872805.223184:0:66190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:3.0:1788872805.223262:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:70375:x1875765311184768:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 115us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872805.223269:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1288 00000100:00080000:0.0:1788872805.223898:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872805.226074:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872805.226169:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311184896 00000100:00100000:0.0:1788872805.226179:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311184896 00000100:00100000:0.0:1788872805.226254:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2121 00000100:00100000:0.0:1788872805.226264:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:70375:x1875765311184896:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:0.0:1788872805.226297:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872805.226369:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:70375:x1875765311184896:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 107us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872805.226378:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2121 00000100:00080000:2.0:1788872805.227193:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872805.232130:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872805.232404:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311185024 00000100:00100000:0.0:1788872805.232415:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311185024 00000100:00100000:1.0:1788872805.232651:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2122 00000100:00100000:1.0:1788872805.232666:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:70375:x1875765311185024:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:1.0:1788872805.232709:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872805.232810:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:70375:x1875765311185024:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 147us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872805.232819:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2122 00000100:00080000:2.0:1788872805.232950:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872805.297338:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872805.298684:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311185280 00000100:00100000:0.0:1788872805.298697:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311185280 00000100:00100000:0.0:1788872805.298783:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1289 00000100:00100000:0.0:1788872805.298794:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70391:x1875765311185280:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:0.0:1788872805.298814:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872805.298841:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dab25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fafc2 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.298922:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dab2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.298937:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dab2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.298950:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dab2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.298964:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dab33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.298970:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dab33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.298977:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dab33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299084:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dab2c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299092:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dab2c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299116:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dab2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299123:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dab2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299129:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872805.299134:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dab2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299141:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dab2c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299154:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1f7a800) 00010000:00010000:0.0:1788872805.299158:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872805.299162:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dab2c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299169:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dab2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299191:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dab33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299197:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dab33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299202:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dab33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299207:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872805.299216:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dab33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299223:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dab33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299232:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a8ca102500) 00010000:00010000:0.0:1788872805.299234:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872805.299237:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dab33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299242:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dab33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299275:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dab25 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafc2 expref: 9 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299286:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1f7a800) 00010000:00010000:0.0:1788872805.299288:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788872805.299291:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dab25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafc2 expref: 9 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872805.299301:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8400, rc 0) 00000100:00100000:0.0:1788872805.299370:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70391:x1875765311185280:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 578us (2046us total) trans 0 rc 301/301 00000100:00100000:0.0:1788872805.299378:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1289 00000100:00100000:3.0:1788872805.302961:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872805.303080:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311185408 00000100:00100000:1.0:1788872805.303091:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311185408 00000100:00100000:1.0:1788872805.303158:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1290 00000100:00100000:1.0:1788872805.303169:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70391:x1875765311185408:12345-192.168.204.39@tcp:34:lfs.0 00010000:00010000:1.0:1788872805.303257:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303275:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303286:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303301:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303309:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303316:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303396:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab48 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303405:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab48 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303412:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab48 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872805.303470:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1788872805.303475:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788872805.303505:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab48 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303521:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab3a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303533:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab3a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303540:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303587:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303595:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872805.303599:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303607:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab3a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303621:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1f7a800) 00010000:00010000:1.0:1788872805.303624:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872805.303628:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab3a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303634:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303647:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303653:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303658:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303671:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9cc00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872805.303674:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303681:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303689:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a9e7bf4600) 00010000:00010000:1.0:1788872805.303691:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872805.303694:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303700:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303714:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab48 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303720:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab48 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303725:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab48 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303741:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872805.303745:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab48 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303750:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab48 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303767:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1f7a400) 00010000:00010000:1.0:1788872805.303770:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872805.303773:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab48 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.303778:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab48 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872805.303855:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70391:x1875765311185408:12345-192.168.204.39@tcp:34:lfs.0 Request processed in 687us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872805.303864:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1290 00000100:00100000:0.0:1788872805.324176:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872805.324335:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311185664 00000100:00100000:3.0:1788872805.324345:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311185664 00000100:00100000:3.0:1788872805.324407:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1291 00000100:00100000:3.0:1788872805.324417:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70395:x1875765311185664:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872805.324439:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872805.324460:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dab4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fafc9 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324759:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324788:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324800:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324816:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dab5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324823:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dab5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324830:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dab5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324919:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab56 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324927:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab56 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324933:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324940:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324946:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872805.324950:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324957:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab56 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324975:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1f7a800) 00010000:00010000:3.0:1788872805.324978:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872805.324983:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab56 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.324989:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dab56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.325016:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dab5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.325022:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dab5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.325027:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dab5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.325032:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872805.325035:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dab5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.325040:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dab5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.325047:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a9d1f7a200) 00010000:00010000:3.0:1788872805.325050:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872805.325052:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dab5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.325059:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dab5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.325103:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dab4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafc9 expref: 9 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.325114:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1f7a800) 00010000:00010000:3.0:1788872805.325116:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788872805.325120:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dab4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafc9 expref: 9 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.325129:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3400, rc 0) 00000100:00100000:3.0:1788872805.325194:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70395:x1875765311185664:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 777us (1026us total) trans 0 rc 301/301 00000100:00100000:3.0:1788872805.325201:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1291 00000100:00100000:0.0:1788872805.328616:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872805.328809:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311185792 00000100:00100000:3.0:1788872805.328819:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311185792 00000100:00100000:3.0:1788872805.328881:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1292 00000100:00100000:3.0:1788872805.328892:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70395:x1875765311185792:12345-192.168.204.39@tcp:34:lfs.0 00010000:00010000:3.0:1788872805.328978:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dab64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329003:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dab64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329014:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dab64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329029:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dab6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329057:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dab6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329064:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dab6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329134:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dab72 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329142:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dab72 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329147:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dab72 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872805.329192:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:3.0:1788872805.329197:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872805.329367:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dab72 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329383:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dab64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329390:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dab64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329395:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dab64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329401:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dab64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329415:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872805.329419:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dab64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329426:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dab64 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329438:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1f7a800) 00010000:00010000:3.0:1788872805.329441:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872805.329446:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dab64 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329453:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dab64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329468:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dab6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329474:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dab6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329480:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dab6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329485:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872805.329488:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dab6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329494:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dab6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329515:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a9d1f7a100) 00010000:00010000:3.0:1788872805.329517:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872805.329520:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dab6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329527:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dab6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329543:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dab72 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329577:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dab72 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329584:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dab72 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329588:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872805.329656:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dab72 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329663:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dab72 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329672:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1f7a400) 00010000:00010000:3.0:1788872805.329677:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872805.329679:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dab72 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872805.329685:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dab72 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872805.329773:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70395:x1875765311185792:12345-192.168.204.39@tcp:34:lfs.0 Request processed in 882us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872805.329781:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1292 00000100:00100000:2.0:1788872805.364295:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872805.364809:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311186048 00000100:00100000:1.0:1788872805.364821:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311186048 00000100:00100000:1.0:1788872805.364887:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1293 00000100:00100000:1.0:1788872805.364898:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70400:x1875765311186048:12345-192.168.204.39@tcp:101:md5sum.0 00010000:00010000:1.0:1788872805.364921:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872805.364945:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fafd0 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365027:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365043:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365054:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365067:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365083:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365090:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365198:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dab8e lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365206:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dab8e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365213:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dab8e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872805.365222:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00010000:00010000:1.0:1788872805.365316:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab80 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365323:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab80 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365329:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365336:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365341:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9cc00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872805.365345:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365363:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab80 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365375:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1f7a800) 00010000:00010000:1.0:1788872805.365378:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872805.365382:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab80 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365389:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dab80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365402:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365408:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365431:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365437:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872805.365440:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365447:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365453:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff98a9e7bf4600) 00010000:00010000:1.0:1788872805.365456:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872805.365459:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365473:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dab87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365527:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dab79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafd0 expref: 11 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365541:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dab8e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafd0 expref: 10 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872805.365610:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1f7a400) 00010000:00010000:1.0:1788872805.365613:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872805.365615:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d400, rc 0) 00000100:00100000:1.0:1788872805.365671:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:70400:x1875765311186048:12345-192.168.204.39@tcp:101:md5sum.0 Request processed in 774us (1387us total) trans 115964116993 rc 0/0 00000100:00100000:1.0:1788872805.365679:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1293 00000100:00100000:0.0:1788872805.390680:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872805.390898:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311186176 00000100:00100000:3.0:1788872805.390909:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311186176 00002000:00100000:3.0:1788872805.390962:0:24855:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x322:0x0] (0->32767) req@ffff98a9df5a6a00 x1875765311186176/t0(0) o3->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:731/0 lens 488/0 e 0 to 0 dl 1788872816 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872805.390974:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9df5a6a00 with x1875765311186176 ext(0->32767) 00002000:00010000:3.0:1788872805.390979:0:24855:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9df5a6a00 00000100:00100000:3.0:1788872805.391027:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1005 00000100:00100000:3.0:1788872805.391039:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311186176:12345-192.168.204.39@tcp:3:md5sum.0 00000100:00100000:3.0:1788872805.393083:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311186176:12345-192.168.204.39@tcp:3:md5sum.0 Request processed in 2034us (2400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872805.393097:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1005 00002000:00100000:3.0:1788872805.393109:0:24855:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x322:0x0] (0->32767) req@ffff98a9df5a6a00 x1875765311186176/t0(0) o3->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:731/0 lens 488/440 e 0 to 0 dl 1788872816 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872805.393118:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9df5a6a00 with x1875765311186176 ext(0->32767) 00002000:00010000:3.0:1788872805.393124:0:24855:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9df5a6a00 00000100:00100000:2.0:1788872805.416774:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872805.416821:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872805.417132:0:25437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311186304 00000100:00100000:3.0:1788872805.417144:0:25437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311186304 00002000:00100000:3.0:1788872805.417190:0:25437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x322:0x0] (32768->1048575) req@ffff98a9fa5f4700 x1875765311186304/t0(0) o3->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:731/0 lens 488/0 e 0 to 0 dl 1788872816 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872805.417200:0:25437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9fa5f4700 with x1875765311186304 ext(32768->1048575) 00002000:00010000:3.0:1788872805.417206:0:25437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9fa5f4700 00000100:00100000:3.0:1788872805.417268:0:25437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311186432 00000100:00100000:3.0:1788872805.417271:0:25437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311186432 00002000:00100000:3.0:1788872805.417290:0:25437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x322:0x0] (1048576->2097151) req@ffff98a9fa5f5880 x1875765311186432/t0(0) o3->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:731/0 lens 488/0 e 0 to 0 dl 1788872816 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872805.417297:0:25437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9fa5f5880 with x1875765311186432 ext(1048576->2097151) 00002000:00010000:3.0:1788872805.417301:0:25437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98a9fa5f5880 00000100:00100000:3.0:1788872805.417329:0:25437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1006 00000100:00100000:3.0:1788872805.417338:0:25437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311186304:12345-192.168.204.39@tcp:3:md5sum.0 00000100:00100000:1.0:1788872805.417686:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1007 00000100:00100000:1.0:1788872805.417698:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311186432:12345-192.168.204.39@tcp:3:md5sum.0 00000100:00100000:1.0:1788872805.445059:0:25437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311186304:12345-192.168.204.39@tcp:3:md5sum.0 Request processed in 27708us (28281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872805.445073:0:25437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1006 00002000:00100000:1.0:1788872805.445085:0:25437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x322:0x0] (32768->1048575) req@ffff98a9fa5f4700 x1875765311186304/t0(0) o3->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:731/0 lens 488/440 e 0 to 0 dl 1788872816 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872805.445095:0:25437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9fa5f4700 with x1875765311186304 ext(32768->1048575) 00002000:00010000:1.0:1788872805.445101:0:25437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9fa5f4700 00000100:00100000:1.0:1788872805.464039:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311186432:12345-192.168.204.39@tcp:3:md5sum.0 Request processed in 46327us (47200us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788872805.464075:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1007 00002000:00100000:1.0:1788872805.464089:0:24856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x322:0x0] (1048576->2097151) req@ffff98a9fa5f5880 x1875765311186432/t0(0) o3->2a005fe2-2a3d-4ca6-8402-a633d5d16eb3@192.168.204.39@tcp:731/0 lens 488/440 e 0 to 0 dl 1788872816 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872805.464099:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9fa5f5880 with x1875765311186432 ext(1048576->2097151) 00002000:00010000:1.0:1788872805.464106:0:24856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98a9fa5f5880 00000100:00100000:0.0:1788872805.488494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872805.488699:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311186688 00000100:00100000:3.0:1788872805.488710:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311186688 00000100:00100000:3.0:1788872805.488773:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 229 00000100:00100000:3.0:1788872805.488783:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:70400:x1875765311186688:12345-192.168.204.39@tcp:35:md5sum.0 00000100:00100000:3.0:1788872805.489092:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:70400:x1875765311186688:12345-192.168.204.39@tcp:35:md5sum.0 Request processed in 309us (615us total) trans 115964116994 rc 0/0 00000100:00100000:3.0:1788872805.489099:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 229 00010000:00010000:1.0:1788872805.688744:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872806.592132:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872806.592160:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327749632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872806.592258:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872806.592318:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327749632 00000100:00100000:3.0:1788872806.592327:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327749632 00000100:00100000:3.0:1788872806.592383:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:3.0:1788872806.592392:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327749632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788872806.592435:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:3.0:1788872806.592508:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327749632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872806.592535:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00000100:00100000:3.0:1788872806.595303:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327749632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872806.598870:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327749760:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.598965:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872806.599023:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef9e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327750272:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.599059:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872806.599081:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327750784:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.599102:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872806.599126:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788872806.599132:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327749888:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.599152:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872806.599170:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef9e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327750400:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.599195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872806.599398:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327749760 00000100:00100000:1.0:1788872806.599406:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327749760 00000100:00100000:1.0:1788872806.599667:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788872806.599677:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327749760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872806.599743:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327749760:12345-0@lo:400:kworker.0 Request processed in 67us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872806.599751:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788872806.599939:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327750144:0@lo:400:kworker.0 00000100:00100000:2.0:1788872806.599972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872806.600009:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327750656:0@lo:400:kworker.0 00000100:00100000:1.0:1788872806.600361:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327750272 00000100:00100000:1.0:1788872806.600367:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327750272 00000100:00100000:1.0:1788872806.600417:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327750784 00000100:00100000:1.0:1788872806.600421:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327750784 00000100:00100000:1.0:1788872806.600440:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327749888 00000100:00100000:1.0:1788872806.600442:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327749888 00000100:00100000:1.0:1788872806.600455:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327750144 00000100:00100000:3.0:1788872806.600747:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327750912:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.600791:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1788872806.600800:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327750272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.600849:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327750272:12345-0@lo:400:kworker.0 Request processed in 50us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872806.600856:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1788872806.600873:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1788872806.600879:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327750784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.600906:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327750784:12345-0@lo:400:kworker.0 Request processed in 27us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872806.600931:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1788872806.600945:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1788872806.600950:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327749888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.600981:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327749888:12345-0@lo:400:kworker.0 Request processed in 30us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872806.600987:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1788872806.601024:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327750400 00000100:00100000:3.0:1788872806.601028:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327750400 00000100:00100000:3.0:1788872806.601057:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:3.0:1788872806.601062:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327750400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.601096:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327750400:12345-0@lo:400:kworker.0 Request processed in 34us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872806.601102:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00100000:3.0:1788872806.601131:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327750016:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.601157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872806.601175:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327750528:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.601201:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327750016 00000100:00100000:3.0:1788872806.601204:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327750016 00000100:00100000:1.0:1788872806.601309:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327750144 00000100:00100000:1.0:1788872806.601338:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1788872806.601344:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327750144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872806.601379:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327750144:12345-0@lo:400:kworker.0 Request processed in 35us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872806.601385:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00080000:0.0:1788872806.601657:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872806.601662:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872806.602374:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872806.602417:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327751168:0@lo:400:kworker.0 00000100:00100000:2.0:1788872806.602453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872806.602693:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327750144:0@lo:400:kworker.0 00000100:00100000:0.0:1788872806.603095:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327750656 00000100:00100000:0.0:1788872806.603101:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327750656 00000100:00100000:0.0:1788872806.603150:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:0.0:1788872806.603158:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327750656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872806.603303:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327750656:12345-0@lo:400:kworker.0 Request processed in 144us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872806.603310:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00080000:0.0:1788872806.603331:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872806.603402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872806.603441:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327751040:0@lo:400:kworker.0 00000100:00100000:1.0:1788872806.603515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872806.604084:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327750528 00000100:00100000:0.0:1788872806.604090:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327750528 00000100:00100000:3.0:1788872806.604143:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327751168 00000100:00100000:3.0:1788872806.604148:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327751168 00000100:00100000:3.0:1788872806.604172:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:3.0:1788872806.604180:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327750016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.604240:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327750016:12345-0@lo:400:kworker.0 Request processed in 61us (3082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872806.604246:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:3.0:1788872806.604268:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:3.0:1788872806.604274:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327751168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.604304:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327751168:12345-0@lo:400:kworker.0 Request processed in 31us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872806.604309:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:3.0:1788872806.604354:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327750016:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.604378:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872806.604410:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327749760:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.604423:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef9e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327750272:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.604434:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327750784:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.604468:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327749888:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.604481:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef9e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327750400:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.604512:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327751040 00000100:00100000:3.0:1788872806.604516:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327751040 00000100:00080000:1.0:1788872806.605337:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872806.605343:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872806.605346:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872806.606180:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327750912 00000100:00100000:2.0:1788872806.606190:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327750912 00000100:00100000:2.0:1788872806.606260:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634 00000100:00100000:2.0:1788872806.606270:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327750912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872806.606357:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327750912:12345-0@lo:400:kworker.0 Request processed in 89us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872806.606371:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634 00000100:00080000:2.0:1788872806.606395:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872806.606430:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327750656:0@lo:400:kworker.0 00000100:00100000:2.0:1788872806.606443:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327751168:0@lo:400:kworker.0 00000100:00100000:2.0:1788872806.606496:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327750912:0@lo:400:kworker.0 00000100:00100000:0.0:1788872806.615798:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:0.0:1788872806.615817:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327750528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872806.615949:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327750528:12345-0@lo:400:kworker.0 Request processed in 140us (12547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872806.615956:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:0.0:1788872806.616030:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327750528:0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.616950:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:3.0:1788872806.616963:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327751040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872806.617039:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327751040:12345-0@lo:400:kworker.0 Request processed in 79us (13524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872806.617047:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00100000:0.0:1788872806.617147:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327751040:0@lo:400:kworker.0 00000100:00100000:0.0:1788872806.667811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872806.667868:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872806.667895:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872806.667915:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872806.667940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872806.667971:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311187200 00000100:00100000:0.0:1788872806.667981:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311187200 00000100:00100000:0.0:1788872806.668025:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311187328 00000100:00100000:0.0:1788872806.668040:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311187328 00000100:00100000:0.0:1788872806.668065:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2637 00000100:00100000:0.0:1788872806.668075:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311187200:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872806.668138:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2638 00000100:00100000:1.0:1788872806.668149:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311187328:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872806.668150:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2404:x1875765311187200:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872806.668157:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2637 00000100:00100000:1.0:1788872806.668177:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311187328:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 32us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872806.668179:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311186816 00000100:00100000:0.0:1788872806.668181:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311186816 00000100:00100000:1.0:1788872806.668183:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2638 00000100:00100000:0.0:1788872806.668206:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 78 00000100:00100000:0.0:1788872806.668212:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311186816:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872806.668236:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311186816:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872806.668242:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 78 00000100:00100000:0.0:1788872806.668270:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311186944 00000100:00100000:0.0:1788872806.668274:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311186944 00000100:00100000:0.0:1788872806.668308:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311187072 00000100:00100000:0.0:1788872806.668311:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311187072 00000100:00100000:0.0:1788872806.668338:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1318 00000100:00100000:0.0:1788872806.668345:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2404:x1875765311186944:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872806.668375:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1319 00000100:00100000:0.0:1788872806.668377:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2404:x1875765311186944:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 34us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872806.668383:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef77a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311187072:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872806.668383:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1318 00000100:00100000:1.0:1788872806.668410:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef77a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2404:x1875765311187072:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872806.668417:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1319 00010000:00010000:1.0:1788872806.713648:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872807.097911:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327751296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872807.097994:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872807.100988:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327751296 00000100:00100000:0.0:1788872807.101005:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327751296 00000100:00100000:0.0:1788872807.101067:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:0.0:1788872807.101079:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327751296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872807.101135:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872807.101242:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327751296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (3247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872807.101250:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00100000:0.0:1788872807.101305:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327751296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872807.101614:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327751424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872807.101659:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872807.102005:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327751424 00000100:00100000:1.0:1788872807.102016:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327751424 00000100:00100000:1.0:1788872807.102110:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:1.0:1788872807.102119:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327751424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872807.102166:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872807.102239:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327751424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872807.102259:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00100000:1.0:1788872807.102300:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327751424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872807.106209:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788872807.106237:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327751552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872807.106331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872807.106390:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327751552 00000100:00100000:3.0:1788872807.106397:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327751552 00000100:00100000:3.0:1788872807.106458:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:3.0:1788872807.106468:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327751552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872807.106504:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445105664 avail 1298866176 00000100:00100000:3.0:1788872807.106568:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327751552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872807.106576:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00100000:3.0:1788872807.106620:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327751552:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788872807.737950:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872808.120834:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872808.120856:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327751680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872808.120925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872808.121013:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327751680 00000100:00100000:0.0:1788872808.121022:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327751680 00000100:00100000:0.0:1788872808.121078:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:0.0:1788872808.121086:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327751680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872808.121107:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872808.121148:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327751680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872808.121155:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:0.0:1788872808.121201:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327751680:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788872808.121289:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872808.121483:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872808.121495:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327751808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872808.121527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872808.121654:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327751808 00000100:00100000:1.0:1788872808.121659:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327751808 00000100:00100000:1.0:1788872808.121712:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:1.0:1788872808.121721:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327751808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872808.121734:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872808.121775:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327751808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872808.121781:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00100000:1.0:1788872808.121815:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327751808:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788872808.121907:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788872808.760754:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872809.792687:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788872810.706233:0:91001:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00010000:00010000:1.0:1788872810.808777:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872811.704978:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327751936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872811.705058:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327752192:0@lo:400:kworker.0 00000100:00100000:0.0:1788872811.705092:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872811.705098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872811.705189:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327751936 00000100:00100000:2.0:1788872811.705198:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327751936 00000100:00100000:2.0:1788872811.705277:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:2.0:1788872811.705287:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327751936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872811.705327:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872811.705457:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327752320:0@lo:400:kworker.0 00000100:00100000:3.0:1788872811.708709:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327752704:0@lo:400:kworker.0 00000100:00100000:3.0:1788872811.708789:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872811.708896:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327753216:0@lo:400:kworker.0 00000100:00100000:3.0:1788872811.708922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872811.708996:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788872811.709005:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327752064:0@lo:400:kworker.0 00000100:00100000:3.0:1788872811.709038:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872811.709079:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327752576:0@lo:400:kworker.0 00000100:00100000:3.0:1788872811.709124:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872811.709152:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327753088:0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.709272:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327752192 00000100:00100000:2.0:1788872811.709281:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327752192 00000100:00100000:2.0:1788872811.709338:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327752576 00000100:00100000:2.0:1788872811.709341:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327752576 00000100:00100000:2.0:1788872811.709362:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1788872811.709370:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327752192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872811.709430:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327752064 00000100:00100000:0.0:1788872811.709435:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327752064 00000100:00100000:0.0:1788872811.709466:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788872811.709473:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327752064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.709726:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327752192:12345-0@lo:400:kworker.0 Request processed in 356us (4625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872811.709734:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1788872811.709752:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1788872811.709759:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327752576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.709785:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327752576:12345-0@lo:400:kworker.0 Request processed in 28us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872811.709791:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1788872811.709824:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327751936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4539us (4731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872811.709840:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:2.0:1788872811.709857:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327752704 00000100:00100000:2.0:1788872811.709861:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327752704 00000100:00100000:2.0:1788872811.709874:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327753216 00000100:00100000:2.0:1788872811.709876:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327753216 00000100:00100000:2.0:1788872811.709887:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:2.0:1788872811.709892:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327752704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.709922:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327752704:12345-0@lo:400:kworker.0 Request processed in 30us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872811.709927:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00100000:2.0:1788872811.709937:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:2.0:1788872811.709942:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327753216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.709965:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327753216:12345-0@lo:400:kworker.0 Request processed in 23us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872811.709971:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00000100:00080000:2.0:1788872811.710009:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872811.710013:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788872811.713514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872811.713544:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327752064:12345-0@lo:400:kworker.0 Request processed in 4069us (4502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872811.713582:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327752832:0@lo:400:kworker.0 00000100:00100000:0.0:1788872811.713590:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788872811.713680:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872811.713753:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327751936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872811.713777:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327753344:0@lo:400:kworker.0 00000100:00100000:0.0:1788872811.713779:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327752448:0@lo:400:kworker.0 00000100:00100000:1.0:1788872811.713801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872811.713801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872811.713823:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327752960:0@lo:400:kworker.0 00000100:00100000:1.0:1788872811.713844:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327752832 00000100:00100000:0.0:1788872811.713847:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872811.713850:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327752832 00000100:00100000:0.0:1788872811.713869:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327753344 00000100:00100000:0.0:1788872811.713872:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327753344 00000100:00100000:1.0:1788872811.713897:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327752960 00000100:00100000:1.0:1788872811.713906:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327752960 00000100:00100000:2.0:1788872811.713943:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327752320 00000100:00100000:2.0:1788872811.713949:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327752320 00000100:00100000:2.0:1788872811.713976:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327752448 00000100:00100000:2.0:1788872811.713978:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327752448 00000100:00100000:2.0:1788872811.713995:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1788872811.714002:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327752320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.714063:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327752320:12345-0@lo:400:kworker.0 Request processed in 62us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872811.714070:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1788872811.714082:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1788872811.714095:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327752448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.714124:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327752448:12345-0@lo:400:kworker.0 Request processed in 30us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872811.714130:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1788872811.714296:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1788872811.714302:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640 00000100:00100000:0.0:1788872811.714303:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327752832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872811.714308:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327753344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872811.714340:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327753344:12345-0@lo:400:kworker.0 Request processed in 32us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872811.714346:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640 00000100:00100000:2.0:1788872811.714353:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641 00000100:00100000:2.0:1788872811.714370:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327752960:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788872811.714370:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872811.714374:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872811.714377:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872811.714379:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872811.714399:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327752960:12345-0@lo:400:kworker.0 Request processed in 31us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872811.714401:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327752320:0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.714405:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641 00000100:00100000:1.0:1788872811.714410:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327752832:0@lo:400:kworker.0 00000100:00100000:1.0:1788872811.714419:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327753344:0@lo:400:kworker.0 00000100:00100000:0.0:1788872811.715319:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327752832:12345-0@lo:400:kworker.0 Request processed in 1012us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872811.715328:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:0.0:1788872811.715465:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327752960:0@lo:400:kworker.0 00000100:00100000:0.0:1788872811.715477:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327753472:0@lo:400:kworker.0 00000100:00100000:0.0:1788872811.715520:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872811.715595:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327752448:0@lo:400:kworker.0 00000100:00100000:1.0:1788872811.715677:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327753472 00000100:00100000:1.0:1788872811.715684:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327753472 00000100:00100000:1.0:1788872811.715740:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:1.0:1788872811.715749:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327753472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872811.715793:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327753472:12345-0@lo:400:kworker.0 Request processed in 46us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872811.715800:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00080000:2.0:1788872811.715870:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872811.715997:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327753472:0@lo:400:kworker.0 00000100:00100000:3.0:1788872811.716297:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872811.716358:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327753600:0@lo:400:kworker.0 00000100:00100000:3.0:1788872811.716391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872811.716420:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327752192:0@lo:400:kworker.0 00000100:00100000:3.0:1788872811.716447:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327752704:0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.716452:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327753088 00000100:00100000:2.0:1788872811.716458:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327753088 00000100:00100000:3.0:1788872811.716464:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327753216:0@lo:400:kworker.0 00000100:00100000:3.0:1788872811.716490:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327752064:0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.716501:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327753600 00000100:00100000:3.0:1788872811.716505:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327752576:0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.716506:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327753600 00000100:00100000:2.0:1788872811.716533:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1788872811.716543:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327753088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.716624:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327753088:12345-0@lo:400:kworker.0 Request processed in 84us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872811.716631:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1788872811.716645:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1788872811.716650:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327753600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872811.716676:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327753600:12345-0@lo:400:kworker.0 Request processed in 26us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872811.716682:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:3.0:1788872811.716771:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327753088:0@lo:400:kworker.0 00000100:00100000:3.0:1788872811.716782:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327753600:0@lo:400:kworker.0 00000100:00100000:1.0:1788872811.790205:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872811.790412:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311187456 00000100:00100000:3.0:1788872811.790424:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311187456 00000100:00100000:3.0:1788872811.790486:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 80 00000100:00100000:3.0:1788872811.790497:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311187456:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872811.790635:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2404:x1875765311187456:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 138us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872811.790643:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 80 00000100:00100000:0.0:1788872811.812022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872811.812081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872811.812120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872811.812164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872811.812203:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311187840 00000100:00100000:0.0:1788872811.812230:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311187840 00000100:00100000:0.0:1788872811.812289:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311187968 00000100:00100000:0.0:1788872811.812292:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311187968 00000100:00100000:0.0:1788872811.812321:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2643 00000100:00100000:0.0:1788872811.812331:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311187840:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872811.812418:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2405:x1875765311187840:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 88us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872811.812425:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2643 00000100:00100000:0.0:1788872811.812441:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2644 00000100:00100000:0.0:1788872811.812448:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311187968:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872811.812472:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311187968:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872811.812478:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2644 00000100:00080000:0.0:1788872811.812504:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872811.812507:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872811.813750:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311187584 00000100:00100000:2.0:1788872811.813760:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311187584 00000100:00100000:2.0:1788872811.813823:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311187712 00000100:00100000:2.0:1788872811.813839:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311187712 00000100:00100000:2.0:1788872811.813873:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1326 00000100:00100000:2.0:1788872811.813883:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:2405:x1875765311187584:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872811.813946:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:2405:x1875765311187584:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 65us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872811.813954:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1326 00000100:00100000:2.0:1788872811.813972:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1327 00000100:00100000:2.0:1788872811.813977:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311187712:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872811.814017:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2405:x1875765311187712:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 40us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872811.814022:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1327 00000100:00080000:0.0:1788872811.814204:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872811.814208:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788872811.832877:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872812.217231:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872812.217255:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872812.217256:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327753728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872812.217264:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327753856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872812.217403:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872812.217414:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327753984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872812.220436:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872812.223872:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327753856 00000100:00100000:3.0:1788872812.223887:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327753856 00000100:00100000:3.0:1788872812.223982:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:3.0:1788872812.223995:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327753856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788872812.224029:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872812.224112:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327753856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (3681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872812.224119:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00100000:1.0:1788872812.224330:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872812.224455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872812.224543:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327753856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872812.224861:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327753728 00000100:00100000:3.0:1788872812.224867:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327753728 00000100:00100000:3.0:1788872812.224901:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:3.0:1788872812.224908:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327753728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872812.224931:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872812.224975:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327753728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872812.224982:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:2.0:1788872812.225396:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327753984 00000100:00100000:2.0:1788872812.225401:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327753984 00000100:00100000:2.0:1788872812.225442:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00100000:2.0:1788872812.225449:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327753984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872812.225471:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445105664 avail 1298866176 00000100:00100000:2.0:1788872812.225828:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875765327753984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872812.225836:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00000100:00100000:1.0:1788872812.225952:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327753984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872812.226056:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327753728:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788872812.767803:0:91829:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 09:06:51 (1788872811) 00010000:00010000:1.0:1788872812.856670:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872813.111681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872813.111823:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311188224 00000100:00100000:1.0:1788872813.111834:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311188224 00000100:00100000:1.0:1788872813.111910:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1294 00000100:00100000:1.0:1788872813.111929:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:70974:x1875765311188224:12345-192.168.204.39@tcp:36:mkdir.0 00000100:00100000:1.0:1788872813.112045:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3851180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:66190:1875765327754112:0@lo:900:mdt00_000.0 00000100:00100000:1.0:1788872813.112093:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872813.112131:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c3851540 going to sleep for 11 seconds 00000100:00080000:0.0:1788872813.112195:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872813.112196:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327754112 00000100:00100000:3.0:1788872813.112201:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327754112 00000100:00100000:3.0:1788872813.112241:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788872813.112250:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9dc0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:66190:x1875765327754112:12345-0@lo:900:mdt00_000.0 00000100:00100000:3.0:1788872813.112318:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9dc0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:66190:x1875765327754112:12345-0@lo:900:mdt00_000.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872813.112324:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788872813.112471:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3851180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:66190:1875765327754112:0@lo:900:mdt00_000.0 00000100:00100000:2.0:1788872813.112536:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327754240:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872813.112614:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872813.112652:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef228a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872813.112689:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327754240 00000100:00100000:3.0:1788872813.112695:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327754240 00000100:00100000:0.0:1788872813.112812:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:0.0:1788872813.112822:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66190:x1875765327754240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788872813.112906:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66190:x1875765327754240:12345-0@lo:1000:mdt00_000.0 Request processed in 87us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872813.112922:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:2.0:1788872813.113183:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327754240:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872813.113239:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327754368:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872813.113263:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872813.113288:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef228a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872813.113410:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327754368 00000100:00100000:3.0:1788872813.113414:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327754368 00000100:00100000:3.0:1788872813.113450:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:3.0:1788872813.113457:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66190:x1875765327754368:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788872813.113654:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66190:x1875765327754368:12345-0@lo:1000:mdt00_000.0 Request processed in 197us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872813.113662:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00100000:1.0:1788872813.114604:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327754368:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872813.114666:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3853100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327754496:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872813.114703:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872813.114733:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7382540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872813.114946:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327754496 00000100:00100000:2.0:1788872813.114952:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327754496 00000100:00100000:2.0:1788872813.114997:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:2.0:1788872813.115004:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66190:x1875765327754496:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872813.115097:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66190:x1875765327754496:12345-0@lo:1000:mdt00_000.0 Request processed in 93us (392us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788872813.115104:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00100000:1.0:1788872813.115243:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3853100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327754496:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788872813.115297:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.115308:0:66190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.115318:0:66190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872813.115329:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3853100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327754624:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1788872813.115364:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872813.115385:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7382c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872813.115501:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327754624 00000100:00100000:3.0:1788872813.115505:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327754624 00000100:00100000:3.0:1788872813.115536:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:3.0:1788872813.115542:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66190:x1875765327754624:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788872813.115573:0:30614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872813.115599:0:30614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01daba3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dab9c expref: -99 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872813.115624:0:30614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dab1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafbb expref: 8 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872813.115633:0:30614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01daba3 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dab9c expref: 7 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872813.115655:0:30614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dab1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafbb expref: 8 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872813.115668:0:30614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dab1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafbb expref: 8 pid: 66979 timeout: 3850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872813.115678:0:30614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:30614:1875765327754752:192.168.204.39@tcp:104: 00000100:00100000:3.0:1788872813.115740:0:30614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c4fe1000 going to sleep for 11 seconds 00000100:00100000:0.0:1788872813.124117:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872813.124264:0:30614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:30614:1875765327754752:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788872813.124314:0:30614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01daba3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dab9c expref: 7 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872813.124327:0:30614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1f7a800) 00010000:00010000:3.0:1788872813.124330:0:30614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872813.124345:0:30614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01daba3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dab9c expref: 7 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872813.124357:0:30614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3400, rc 0) 00000100:00100000:3.0:1788872813.124419:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66190:x1875765327754624:12345-0@lo:101:mdt00_000.0 Request processed in 8877us (9054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872813.124428:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00000100:00100000:1.0:1788872813.124612:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3853100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327754624:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1788872813.124631:0:66190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.124642:0:66190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872813.125045:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311188352 00000100:00100000:2.0:1788872813.125054:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311188352 00010000:00010000:2.0:1788872813.125101:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dab1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafbb expref: 9 pid: 66979 timeout: 3850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872813.125140:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2560 00000100:00100000:2.0:1788872813.125151:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:2407:x1875765311188352:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788872813.125170:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872813.125178:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dab1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafbb expref: 9 pid: 66979 timeout: 3850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.125191:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dab1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafbb expref: 9 pid: 66979 timeout: 3850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.125216:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dab1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafbb expref: 9 pid: 66979 timeout: 3850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.125240:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1f7a800) 00010000:00010000:2.0:1788872813.125245:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01daba3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dab9c expref: 6 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.125255:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01daba3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xe4e6e89fb01dab9c expref: 6 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.125264:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01daba3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xe4e6e89fb01dab9c expref: 6 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.125297:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01daba3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dab9c expref: 6 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872813.125312:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1875765327754880:0@lo:105: 00000100:00080000:0.0:1788872813.125486:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788872813.125603:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872813.126080:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef228d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872813.129184:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327754880 00000100:00100000:0.0:1788872813.129201:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327754880 00000100:00100000:0.0:1788872813.129268:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788872813.129277:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6506:x1875765327754880:12345-0@lo:105: 00010000:00010000:0.0:1788872813.129294:0:13343:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.129306:0:13343:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.129315:0:13343:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.129325:0:13343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.129333:0:13343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.129350:0:13343:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.129418:0:13343:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff98a8c4f9c200) 00000100:00100000:0.0:1788872813.129532:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6506:x1875765327754880:12345-0@lo:105: Request processed in 255us (3980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872813.129539:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788872813.129663:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1875765327754880:0@lo:105: 00010000:00010000:3.0:1788872813.129679:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872813.129733:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2407:x1875765311188352:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 4582us (5624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872813.129741:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2560 00010000:00010000:2.0:1788872813.131731:0:66190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.131750:0:66190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788872813.131783:0:66190:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788872813.131839:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.131848:0:66190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.131876:0:66190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872813.131903:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755008:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1788872813.131972:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872813.132142:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327755008 00000100:00100000:3.0:1788872813.132150:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327755008 00000100:00100000:3.0:1788872813.132203:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:3.0:1788872813.132211:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66190:x1875765327755008:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788872813.132225:0:23717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872813.132240:0:23717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dabb1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dabaa expref: -99 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872813.132264:0:23717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dabb1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dabaa expref: 8 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872813.132290:0:23717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dabb1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dabaa expref: 8 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872813.132298:0:23717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff98a9d1f7ab00) 00010000:00010000:3.0:1788872813.132300:0:23717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872813.132304:0:23717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3c00, rc 0) 00000100:00100000:3.0:1788872813.139117:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755008:12345-0@lo:101:mdt00_000.0 Request processed in 6898us (7135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872813.139131:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00000100:00100000:2.0:1788872813.140460:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef228480 going to sleep for 11 seconds 00000100:00100000:2.0:1788872813.140503:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755008:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788872813.140530:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dabb1 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.140544:0:66190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dabb1 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788872813.140596:0:66190:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1788872813.140664:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755136:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872813.140736:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872813.140763:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef228d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872813.140897:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327755136 00000100:00100000:3.0:1788872813.140903:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327755136 00000100:00100000:3.0:1788872813.141163:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:3.0:1788872813.141173:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788872813.141266:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755136:12345-0@lo:1000:mdt00_000.0 Request processed in 95us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872813.141274:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:1.0:1788872813.141373:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755136:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872813.141423:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755264:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872813.141454:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872813.141479:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7382540 going to sleep for 11 seconds 00000100:00100000:0.0:1788872813.141607:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327755264 00000100:00100000:0.0:1788872813.141612:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327755264 00000100:00100000:0.0:1788872813.141646:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1788872813.141653:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788872813.141765:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755264:12345-0@lo:1000:mdt00_000.0 Request processed in 112us (309us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788872813.141772:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:1.0:1788872813.141899:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755264:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872813.141985:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755392:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872813.142134:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872813.142162:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7382540 going to sleep for 11 seconds 00000100:00100000:0.0:1788872813.142212:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327755392 00000100:00100000:0.0:1788872813.142217:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327755392 00000100:00100000:0.0:1788872813.142249:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:0.0:1788872813.142256:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755392:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788872813.142312:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755392:12345-0@lo:1000:mdt00_000.0 Request processed in 57us (178us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788872813.142319:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00000100:00100000:1.0:1788872813.142448:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755392:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872813.142494:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755520:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872813.142517:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872813.142538:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7382540 going to sleep for 11 seconds 00000100:00100000:0.0:1788872813.142616:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327755520 00000100:00100000:0.0:1788872813.142620:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327755520 00000100:00100000:0.0:1788872813.142647:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:0.0:1788872813.142653:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788872813.142715:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755520:12345-0@lo:1000:mdt00_000.0 Request processed in 61us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872813.142722:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00000100:00100000:1.0:1788872813.142881:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755520:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872813.142971:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755648:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872813.142994:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872813.143148:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7382540 going to sleep for 11 seconds 00000100:00100000:0.0:1788872813.149632:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327755648 00000100:00100000:0.0:1788872813.149655:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327755648 00000100:00100000:0.0:1788872813.150507:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:0.0:1788872813.150523:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788872813.150740:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755648:12345-0@lo:1000:mdt00_000.0 Request processed in 222us (7743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872813.150748:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00000100:00100000:1.0:1788872813.150921:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755648:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872813.151026:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755776:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872813.151066:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872813.151097:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7382540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872813.151343:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327755776 00000100:00100000:2.0:1788872813.151349:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327755776 00000100:00100000:2.0:1788872813.151382:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:2.0:1788872813.151389:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755776:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872813.151435:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66190:x1875765327755776:12345-0@lo:1000:mdt00_000.0 Request processed in 47us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872813.151441:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00000100:00100000:1.0:1788872813.151671:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327755776:0@lo:1000:mdt00_000.0 00000040:00080000:1.0:1788872813.152425:0:66190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].2, 1000 off35920 00000040:00080000:1.0:1788872813.152494:0:66190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x2:0x0].2, 1152 off36272 00000004:00080000:1.0:1788872813.152500:0:66190:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98a8c7382c00 with version 9 00000004:00080000:2.0:1788872813.152597:0:75625:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98a8c5c4f240 version 9 rpc_version 9 00000020:00100000:2.0:1788872813.152623:0:75625:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788872813.152643:0:75625:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98a9fa5f4a80 x1875765327756032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872813.152661:0:75625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f4a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327756032:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788872813.152703:0:75625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872813.152738:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef228a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872813.152801:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327756032 00000100:00100000:0.0:1788872813.152806:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327756032 00000100:00100000:0.0:1788872813.152848:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:0.0:1788872813.152856:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75625:x1875765327756032:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788872813.161444:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75625:x1875765327756032:12345-0@lo:1000:osp_up0-1.0 Request processed in 8580us (8731us total) trans 115964116995 rc 0/0 00000100:00100000:0.0:1788872813.161458:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00100000:2.0:1788872813.161614:0:75625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f4a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327756032:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1788872813.161738:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dabb8 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.161756:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dabb8 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.161770:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dabb8 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872813.161790:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8eb323e reply state 00000000ee211585 transno 77309411439 ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dabb8 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.161801:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dabb8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.161808:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:1.0:1788872813.161811:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872813.161814:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788872813.161820:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00080000:1.0:1788872813.161827:0:66190:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788872813.161837:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.161860:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.161867:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.161892:0:66190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788872813.161898:0:66190:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788872813.161903:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dabb1 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.161910:0:66190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dabb1 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872813.162073:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70974:x1875765311188224:12345-192.168.204.39@tcp:36:mkdir.0 Request processed in 50145us (50399us total) trans 77309411439 rc 0/0 00000100:00100000:1.0:1788872813.162080:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1294 00010000:00010000:2.0:1788872813.162134:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872813.162141:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.162150:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c200 already unused, calling callback (ffffffffc19e46f0) 00010000:00010000:2.0:1788872813.162156:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872813.162164:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.162200:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.162207:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788872813.162253:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327756160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872813.162296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788872813.162688:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.162698:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c4f9c200/0xe4e6e89fb01dab9c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01daba3 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.162716:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872813.162724:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872813.162726:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872813.162745:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327756160 00000100:00100000:2.0:1788872813.162751:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327756160 00000100:00100000:2.0:1788872813.162794:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:2.0:1788872813.162802:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3646:x1875765327756160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872813.162814:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872813.162830:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01daba3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01dab9c expref: 9 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.162842:0:26198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1f7a800) 00010000:00010000:2.0:1788872813.162849:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872813.164247:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+8:3646:x1875765327756160:12345-0@lo:103:ldlm_bl.0 Request processed in 1438us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872813.164259:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1788872813.166193:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327756160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872813.199636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872813.199759:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311188480 00000100:00100000:2.0:1788872813.199770:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311188480 00000100:00100000:2.0:1788872813.199844:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1295 00000100:00100000:2.0:1788872813.199856:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70979:x1875765311188480:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788872813.199877:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872813.199904:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5be00/0xe4e6e89fb01dabbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fafd7 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.199966:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a400/0xe4e6e89fb01dabc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.199980:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a400/0xe4e6e89fb01dabc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.200014:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a400/0xe4e6e89fb01dabc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872813.200061:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788872813.200065:0:66192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788872813.200086:0:66192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a400/0xe4e6e89fb01dabc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.200113:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5be00/0xe4e6e89fb01dabbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafd7 expref: 10 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.200130:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a400/0xe4e6e89fb01dabc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafd7 expref: 9 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.200138:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c1358300) 00010000:00010000:2.0:1788872813.200141:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788872813.200144:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5c5a400, rc 0) 00000100:00100000:2.0:1788872813.200209:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:70979:x1875765311188480:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 356us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872813.200216:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1295 00000100:00100000:0.0:1788872813.212764:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872813.212875:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311188608 00000100:00100000:2.0:1788872813.212885:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311188608 00000100:00100000:2.0:1788872813.212949:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1296 00000100:00100000:2.0:1788872813.212960:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:70979:x1875765311188608:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788872813.212979:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872813.213000:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5be00/0xe4e6e89fb01dabcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fafde expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.213085:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a600/0xe4e6e89fb01dabd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.213100:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a600/0xe4e6e89fb01dabd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.213110:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a600/0xe4e6e89fb01dabd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.213122:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.213132:0:66193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dabb1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dabaa expref: 7 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.213140:0:66193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.213172:0:66193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dabb1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dabaa expref: 7 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872813.213188:0:66193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66193:1875765327756288:0@lo:104: 00000100:00100000:2.0:1788872813.213234:0:66193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872813.213273:0:66193:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef228a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872813.218960:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327756288 00000100:00100000:3.0:1788872813.218981:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327756288 00000100:00100000:3.0:1788872813.219120:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788872813.219132:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66193:x1875765327756288:12345-0@lo:104: 00010000:00010000:3.0:1788872813.219150:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dabb1 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872813.219268:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788872813.219275:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66193:x1875765327756288:12345-0@lo:104: Request processed in 146us (6040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872813.219299:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788872813.219606:0:66193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66193:1875765327756288:0@lo:104: 00010000:00010000:2.0:1788872813.219630:0:66193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.219837:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872813.219846:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dabb1 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.219855:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5a800 already unused, calling callback (ffffffffc19e46f0) 00010000:00010000:1.0:1788872813.219868:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dabb1 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872813.219889:0:20230:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dabb1 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.219929:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dabb1 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.219936:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872813.219970:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dabb1 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.219977:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5a800/0xe4e6e89fb01dabaa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dabb1 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.219995:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872813.219996:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872813.219998:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872813.220006:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872813.220018:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327756416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872813.220061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872813.220096:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327756416 00000100:00100000:1.0:1788872813.220101:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327756416 00010000:00010000:1.0:1788872813.220121:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dabb1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xe4e6e89fb01dabaa expref: 8 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872813.220143:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1788872813.220150:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3851180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3646:x1875765327756416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872813.220170:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1788872813.223059:0:91001:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116995 is committed 00010000:00010000:2.0:1788872813.229774:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dabb1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dabaa expref: 7 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.229825:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff98a9d1f7ab00) 00010000:00010000:2.0:1788872813.229833:0:7929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.229843:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.229852:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.229938:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872813.230076:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3851180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327756416:12345-0@lo:103:ldlm_bl.0 Request processed in 9924us (10012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872813.230086:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1788872813.230221:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327756416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872813.230276:0:66193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.230286:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872813.230898:0:66193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66193:1875765327756544:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788872813.230953:0:66193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872813.231039:0:66193:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa5ace40 going to sleep for 11 seconds 00000100:00100000:2.0:1788872813.231119:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327756544 00000100:00100000:2.0:1788872813.231126:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327756544 00000100:00100000:2.0:1788872813.231204:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:2.0:1788872813.231213:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66193:x1875765327756544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788872813.231292:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66193:x1875765327756544:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872813.231299:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00100000:0.0:1788872813.231369:0:66193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66193:1875765327756544:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788872813.231417:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01dabe2 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231429:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01dabe2 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231453:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01dabe2 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872813.231477:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01dabe2 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231491:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a600/0xe4e6e89fb01dabd4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231498:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a600/0xe4e6e89fb01dabd4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231505:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a600/0xe4e6e89fb01dabd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231512:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a600/0xe4e6e89fb01dabd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231518:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5a600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872813.231522:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a600/0xe4e6e89fb01dabd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231530:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a600/0xe4e6e89fb01dabd4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231541:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c1358300) 00010000:00010000:0.0:1788872813.231545:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872813.231565:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a600/0xe4e6e89fb01dabd4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231584:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a600/0xe4e6e89fb01dabd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231604:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231611:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231618:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231623:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5b200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872813.231626:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231633:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231642:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff98a9d1f7ab00) 00010000:00010000:0.0:1788872813.231645:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872813.231648:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231654:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b200/0xe4e6e89fb01dabdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231689:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5be00/0xe4e6e89fb01dabcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafde expref: 11 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231703:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01dabe2 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafde expref: 10 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.231723:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a8ca102a00) 00010000:00010000:0.0:1788872813.231725:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788872813.231728:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8200, rc 0) 00000100:00100000:0.0:1788872813.231779:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:70979:x1875765311188608:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 18820us (19023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872813.231786:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1296 00000100:00100000:3.0:1788872813.235167:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872813.237162:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311188736 00000100:00100000:2.0:1788872813.237179:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311188736 00000100:00100000:2.0:1788872813.237257:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1297 00000100:00100000:2.0:1788872813.237269:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:70979:x1875765311188736:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788872813.237294:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872813.237320:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dabe9 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fafe5 expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.237394:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b000/0xe4e6e89fb01dabf0 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.237408:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b000/0xe4e6e89fb01dabf0 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.237420:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b000/0xe4e6e89fb01dabf0 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872813.237471:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1788872813.237475:0:83669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788872813.237510:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dabe9 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafe5 expref: 10 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.237531:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b000/0xe4e6e89fb01dabf0 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafe5 expref: 9 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.237539:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:2.0:1788872813.237542:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1788872813.237546:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5c5b000, rc 0) 00000100:00100000:2.0:1788872813.237650:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:70979:x1875765311188736:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 383us (2500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872813.237657:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1297 00000100:00100000:2.0:1788872813.241746:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327756672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872813.241845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872813.241927:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327756800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872813.241961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872813.242206:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327756672 00000100:00100000:1.0:1788872813.242216:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327756672 00000100:00100000:3.0:1788872813.242274:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327756800 00000100:00100000:3.0:1788872813.242289:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327756800 00000100:00100000:1.0:1788872813.242302:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1788872813.242317:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327756672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872813.242345:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872813.242369:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:3.0:1788872813.242384:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327756800:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872813.242409:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327756672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (559us total) trans 0 rc 0/0 00002000:00000024:3.0:1788872813.242414:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872813.242424:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:3.0:1788872813.242527:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327756800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872813.242535:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00100000:1.0:1788872813.246434:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327756800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872813.246615:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327756672:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788872813.246776:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872813.246784:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872813.248281:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872813.248364:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311188864 00000100:00100000:2.0:1788872813.248399:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311188864 00000100:00100000:2.0:1788872813.248475:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1298 00000100:00100000:2.0:1788872813.248486:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:70979:x1875765311188864:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788872813.248508:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872813.248532:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dabf7 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fafec expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248660:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ae00/0xe4e6e89fb01dabfe lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248675:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ae00/0xe4e6e89fb01dabfe lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248687:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ae00/0xe4e6e89fb01dabfe lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248752:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac05 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248759:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac05 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248765:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac05 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248817:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ae00/0xe4e6e89fb01dabfe lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248824:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ae00/0xe4e6e89fb01dabfe lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248830:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ae00/0xe4e6e89fb01dabfe lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248843:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ae00/0xe4e6e89fb01dabfe lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248849:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5ae00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872813.248852:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ae00/0xe4e6e89fb01dabfe lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248860:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ae00/0xe4e6e89fb01dabfe lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248872:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:2.0:1788872813.248875:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872813.248878:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ae00/0xe4e6e89fb01dabfe lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248884:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ae00/0xe4e6e89fb01dabfe lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248899:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac05 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248904:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac05 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248909:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac05 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248913:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5bc00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872813.248916:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac05 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248932:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac05 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248939:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff98a9c1358800) 00010000:00010000:2.0:1788872813.248941:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872813.248943:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac05 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248948:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac05 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248986:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dabf7 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafec expref: 10 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.248996:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:2.0:1788872813.248999:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872813.249002:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dabf7 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafec expref: 10 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.249012:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5c5a200, rc 0) 00000100:00100000:2.0:1788872813.249085:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:70979:x1875765311188864:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 601us (817us total) trans 0 rc 301/301 00000100:00100000:2.0:1788872813.249092:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1298 00000100:00100000:0.0:1788872813.254914:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872813.255786:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311188992 00000100:00100000:1.0:1788872813.255798:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311188992 00000100:00100000:1.0:1788872813.255866:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1299 00000100:00100000:1.0:1788872813.255888:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:70979:x1875765311188992:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:1.0:1788872813.255909:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872813.255935:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dac0c lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faff3 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256016:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dac13 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256032:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dac13 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256043:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dac13 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256073:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dac1a lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256082:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dac1a lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256088:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dac1a lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256127:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dac13 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256134:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dac13 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256140:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dac13 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256146:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dac13 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256151:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872813.256155:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dac13 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256162:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dac13 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256174:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:1.0:1788872813.256177:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872813.256181:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dac13 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256195:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dac13 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256210:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dac1a lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256216:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dac1a lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256221:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dac1a lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256225:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9cc00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872813.256228:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dac1a lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256233:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dac1a lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256240:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff98a9d14a2900) 00010000:00010000:1.0:1788872813.256243:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872813.256245:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dac1a lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256251:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01dac1a lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256284:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dac0c lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faff3 expref: 10 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256306:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:1.0:1788872813.256308:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872813.256311:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c200/0xe4e6e89fb01dac0c lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faff3 expref: 10 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.256320:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c200, rc 0) 00000100:00100000:1.0:1788872813.256683:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:70979:x1875765311188992:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 807us (1779us total) trans 0 rc 301/301 00000100:00100000:1.0:1788872813.256691:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1299 00000100:00100000:3.0:1788872813.263206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872813.263304:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311189120 00000100:00100000:2.0:1788872813.263322:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311189120 00000100:00100000:2.0:1788872813.263411:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1300 00000100:00100000:2.0:1788872813.263423:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+9:70979:x1875765311189120:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788872813.263468:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872813.263497:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828faffa expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.263634:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ba00/0xe4e6e89fb01dac28 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.263650:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ba00/0xe4e6e89fb01dac28 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.263661:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ba00/0xe4e6e89fb01dac28 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872813.263709:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1788872813.263713:0:83669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788872813.263730:0:83669:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ba00/0xe4e6e89fb01dac28 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.263761:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faffa expref: 11 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.263788:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ba00/0xe4e6e89fb01dac28 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faffa expref: 10 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.263797:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:2.0:1788872813.263800:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788872813.263804:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5c5ba00, rc 0) 00000100:00100000:2.0:1788872813.263870:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:70979:x1875765311189120:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 450us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872813.263894:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1300 00000100:00100000:2.0:1788872813.269653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872813.269856:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311189376 00000100:00100000:3.0:1788872813.269874:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311189376 00000100:00100000:3.0:1788872813.269952:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1301 00000100:00100000:3.0:1788872813.269965:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:70979:x1875765311189376:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872813.270164:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872813.270204:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dac2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb001 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872813.270359:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1788872813.271244:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dac2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb001 expref: 12 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872813.271268:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d1f7a500) 00010000:00010000:3.0:1788872813.271271:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788872813.271298:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dac2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb001 expref: 12 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872813.271328:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3000, rc 0) 00000100:00100000:3.0:1788872813.272104:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:70979:x1875765311189376:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 2132us (2463us total) trans 77309411440 rc 301/301 00000100:00100000:3.0:1788872813.272117:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1301 00000100:00100000:0.0:1788872813.278471:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872813.280728:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311189632 00000100:00100000:2.0:1788872813.280750:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311189632 00000100:00100000:2.0:1788872813.280862:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1302 00000100:00100000:2.0:1788872813.280876:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:70979:x1875765311189632:12345-192.168.204.39@tcp:36:lfs.0 00010000:00010000:2.0:1788872813.280973:0:66193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872813.281281:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ba00/0xe4e6e89fb01dac28 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faffa expref: 11 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.281315:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:2.0:1788872813.281323:0:66193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872813.281541:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac3d lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.281631:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac3d lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.281646:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac3d lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.281666:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dac44 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.281673:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dac44 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.281679:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dac44 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282711:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac4b lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282748:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac4b lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282760:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac4b lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872813.282783:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000495f5b5e reply state 00000000e9254c08 transno 77309411441 ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac4b lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282797:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac4b lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282804:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a9c1358800) 00010000:00010000:2.0:1788872813.282807:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872813.282811:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788872813.282819:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1788872813.282830:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac3d lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282838:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac3d lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282846:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac3d lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282853:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac3d lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282861:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5aa00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872813.282866:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac3d lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282886:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac3d lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282898:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:2.0:1788872813.282901:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872813.282905:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac3d lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282912:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01dac3d lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872813.282928:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000495f5b5e reply state 00000000e9254c08 transno 77309411441 ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dac44 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282937:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dac44 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.282943:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff98a9c1358200) 00010000:00010000:2.0:1788872813.282946:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872813.282948:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788872813.283156:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:70979:x1875765311189632:12345-192.168.204.39@tcp:36:lfs.0 Request processed in 2278us (4696us total) trans 77309411441 rc 0/0 00000100:00100000:2.0:1788872813.283177:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1302 00000100:00100000:0.0:1788872813.297656:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872813.297756:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311189888 00000100:00100000:3.0:1788872813.297765:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311189888 00000100:00100000:3.0:1788872813.297821:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 230 00000100:00100000:3.0:1788872813.297832:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+12:70979:x1875765311189888:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:3.0:1788872813.298191:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:70979:x1875765311189888:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 243us (428us total) trans 77309411442 rc 0/0 00000100:00100000:3.0:1788872813.298203:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 230 00000100:00100000:3.0:1788872813.357101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872813.357155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872813.357188:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872813.357237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872813.357347:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311190016 00000100:00100000:0.0:1788872813.357361:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311190016 00000100:00100000:0.0:1788872813.357438:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311190272 00000100:00100000:0.0:1788872813.357441:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311190272 00000100:00100000:0.0:1788872813.357464:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311190144 00000100:00100000:0.0:1788872813.357466:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311190144 00000100:00100000:0.0:1788872813.357505:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 721 00000100:00100000:0.0:1788872813.357517:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+12:2405:x1875765311190016:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788872813.357539:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872813.357616:0:26197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01da903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafa6 expref: 12 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.357639:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872813.357727:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+11:2405:x1875765311190016:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 212us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872813.357736:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 721 00000100:00100000:0.0:1788872813.357757:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 722 00000100:00100000:0.0:1788872813.357763:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+10:2405:x1875765311190272:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788872813.357771:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872813.357781:0:26197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01da90a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafad expref: 10 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.357791:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872813.357809:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+9:2405:x1875765311190272:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 46us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872813.357816:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 722 00000100:00100000:0.0:1788872813.357827:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 723 00000100:00100000:0.0:1788872813.357833:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+8:2405:x1875765311190144:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788872813.357841:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872813.357851:0:26197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5441200/0xe4e6e89fb01da8fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf9f expref: 8 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.357860:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872813.357876:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+7:2405:x1875765311190144:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 43us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872813.357882:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 723 00000100:00100000:0.0:1788872813.357902:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311190528 00000100:00100000:0.0:1788872813.357906:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311190528 00000100:00100000:0.0:1788872813.357949:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5976 00000100:00100000:0.0:1788872813.357955:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+6:2403:x1875765311190528:12345-192.168.204.39@tcp:9:umount.0 00000020:00000080:0.0:1788872813.357992:0:26191:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da528 00000020:00010000:0.0:1788872813.358000:0:26191:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9c8f56800: total 0 00000100:00080000:0.0:1788872813.358005:0:26191:0:(import.c:65:import_set_state_nolock()) ffff98a9c8f55000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788872813.358070:0:26191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:0.0:1788872813.358231:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+4:2403:x1875765311190528:12345-192.168.204.39@tcp:9:umount.0 Request processed in 275us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872813.358239:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5976 00000020:00010000:0.0:1788872813.358261:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9c8f56800: total 0 00010000:00010000:0.0:1788872813.358266:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872813.358289:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9c8f56800, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1788872813.358325:0:6509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x322:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1788872813.358330:0:6509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x322:0x0] updating lvb atime from disk: 0 -> 1788872755 00002000:00010000:0.0:1788872813.358333:0:6509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x322:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:0.0:1788872813.358354:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcfefe2d/0xe4e6e89fb01da671 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf7c expref: 3 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.358385:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9c8f56800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788872813.358395:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872813.358397:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872813.358399:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788872813.358416:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872813.376967:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872813.377395:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311190912 00000100:00100000:3.0:1788872813.377411:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311190912 00000100:00100000:3.0:1788872813.377640:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5977 00000100:00100000:3.0:1788872813.377654:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+7:2403:x1875765311190912:12345-192.168.204.39@tcp:9:umount.0 00000020:00000080:3.0:1788872813.377707:0:26199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da521 00000020:00010000:3.0:1788872813.377718:0:26199:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9c73d2000: total 0 00000100:00080000:3.0:1788872813.377723:0:26199:0:(import.c:65:import_set_state_nolock()) ffff98a9c73d7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788872813.377788:0:26199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:3.0:1788872813.378001:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+5:2403:x1875765311190912:12345-192.168.204.39@tcp:9:umount.0 Request processed in 349us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872813.378026:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5977 00000020:00010000:2.0:1788872813.381801:0:14981:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9c73d2000: total 0 00010000:00010000:2.0:1788872813.381918:0:14981:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9c73d2000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788872813.382002:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01da66a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf75 expref: 4 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.382052:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f88eb5a/0xe4e6e89fb01da678 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf83 expref: 3 pid: 14545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.382093:0:14981:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9c73d2000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788872813.382108:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872813.382110:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872813.382113:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788872813.383433:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872813.409309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872813.409453:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311191424 00000100:00100000:2.0:1788872813.409469:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311191424 00000100:00100000:2.0:1788872813.409601:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1303 00000100:00100000:2.0:1788872813.409613:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+10:2403:x1875765311191424:12345-192.168.204.39@tcp:39:umount.0 00000020:00000080:2.0:1788872813.409668:0:83669:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da77b 00000020:00010000:2.0:1788872813.409697:0:83669:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9ef255000: total 0 00000100:00080000:2.0:1788872813.409702:0:83669:0:(import.c:65:import_set_state_nolock()) ffff98a9c4c3b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788872813.409730:0:83669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116995 00000100:00100000:2.0:1788872813.409942:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+8:2403:x1875765311191424:12345-192.168.204.39@tcp:39:umount.0 Request processed in 330us (649us total) trans 115964116996 rc 0/0 00000100:00100000:2.0:1788872813.409950:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1303 00000020:00010000:1.0:1788872813.410203:0:6508:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9ef255000: total 0 00010000:00010000:1.0:1788872813.410282:0:6508:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9ef255000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1788872813.410324:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1f7a400) 00010000:00010000:1.0:1788872813.410329:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872813.410338:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dab8e lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafd0 expref: 7 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.410365:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a8ca102a00) 00010000:00010000:1.0:1788872813.410368:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788872813.410373:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8200/0xe4e6e89fb01dabe2 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafde expref: 6 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.410394:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff98a9d1f7a400) 00010000:00010000:1.0:1788872813.410397:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788872813.410400:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01da965 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828faf6e expref: 5 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.410446:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c1358300) 00010000:00010000:1.0:1788872813.410449:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788872813.410453:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5a400/0xe4e6e89fb01dabc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafd7 expref: 4 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.410468:0:6508:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9ef255000, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1788872813.410483:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872813.410486:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872813.410488:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872813.438234:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872813.438756:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311191680 00000100:00100000:0.0:1788872813.438775:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311191680 00000100:00100000:0.0:1788872813.438873:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1304 00000100:00100000:0.0:1788872813.438887:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+13:2403:x1875765311191680:12345-192.168.204.39@tcp:39:umount.0 00000020:00000080:0.0:1788872813.438989:0:66979:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d54e7 00000020:00010000:0.0:1788872813.439012:0:66979:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9f0924000: total 0 00000100:00080000:0.0:1788872813.439018:0:66979:0:(import.c:65:import_set_state_nolock()) ffff98a9faa59800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788872813.439095:0:66979:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411442 00000100:00100000:0.0:1788872813.439680:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a005fe2-2a3d-4ca6-8402-a633d5d16eb3+11:2403:x1875765311191680:12345-192.168.204.39@tcp:39:umount.0 Request processed in 792us (1457us total) trans 77309411443 rc 0/0 00000100:00100000:0.0:1788872813.439691:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1304 00010000:00010000:0.0:1788872813.439732:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dac44 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439744:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dac44 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439753:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dac44 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439760:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5a200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872813.439765:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dac44 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439774:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dac44 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439794:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff98a9c1358200) 00010000:00010000:0.0:1788872813.439797:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872813.439802:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dac44 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439809:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5a200/0xe4e6e89fb01dac44 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439853:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac4b lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439860:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac4b lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439867:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac4b lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439871:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5bc00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872813.439874:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac4b lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439880:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac4b lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439886:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a9c1358800) 00010000:00010000:0.0:1788872813.439888:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872813.439891:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac4b lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.439896:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5bc00/0xe4e6e89fb01dac4b lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1788872813.440255:0:20230:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9f0924000: total 0 00010000:00010000:1.0:1788872813.440330:0:20230:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9f0924000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788872813.440370:0:20230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:1.0:1788872813.440374:0:20230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1788872813.440382:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b000/0xe4e6e89fb01dabf0 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafe5 expref: 9 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872813.440398:0:20230:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9f0924000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788872813.440413:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872813.440415:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872813.440417:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872813.440711:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dabb8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.440720:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dabb8 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.440726:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dabb8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.440731:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ce00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872813.440735:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dabb8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.440757:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dabb8 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.440768:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9e7bf4500) 00010000:00010000:2.0:1788872813.440770:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872813.440774:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dabb8 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872813.440780:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dabb8 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872813.557134:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872813.557454:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311191936 00000100:00100000:3.0:1788872813.557468:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311191936 00000100:00100000:3.0:1788872813.557596:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 81 00000100:00100000:3.0:1788872813.557609:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+7:2403:x1875765311191936:12345-192.168.204.39@tcp:251:umount.0 00000020:00000080:3.0:1788872813.557908:0:91005:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da831 00000020:00010000:3.0:1788872813.557919:0:91005:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a8c5111800: total 0 00000100:00080000:3.0:1788872813.557925:0:91005:0:(import.c:65:import_set_state_nolock()) ffff98a8c5115800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788872813.558092:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a09bb38-f574-4ce9-b65f-ec6facc58f7e+3:2403:x1875765311191936:12345-192.168.204.39@tcp:251:umount.0 Request processed in 485us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872813.558102:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 81 00000020:00010000:0.0:1788872813.558803:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a8c5111800: total 0 00010000:00010000:0.0:1788872813.558812:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872813.558893:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a8c5111800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788872813.558943:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5441400/0xe4e6e89fb01da911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fafb4 expref: 2 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872813.558963:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a8c5111800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788872813.559007:0:6509:0:(genops.c:906:class_export_put()) final put ffff98a8c5111800/8a09bb38-f574-4ce9-b65f-ec6facc58f7e 00010000:00010000:0.0:1788872813.559029:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872813.559031:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872813.559033:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788872813.559674:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c5111800/8a09bb38-f574-4ce9-b65f-ec6facc58f7e for MGS 00000020:00000080:2.0:1788872813.559733:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c5115800 for MGS 00010000:00010000:2.0:1788872813.880856:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872814.894588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872814.894673:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311192064 00000100:00100000:2.0:1788872814.894686:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311192064 00000100:00100000:2.0:1788872814.894739:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 82 00000100:00100000:2.0:1788872814.894747:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2403:x1875765311192064:12345-192.168.204.39@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788872814.894780:0:91008:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp t0 exp 0000000000000000 cur 3752 last 0 00000020:00000080:2.0:1788872814.894810:0:91008:0:(genops.c:1406:class_connect()) connect: client c67645b7-2296-4087-92b1-886500c47477, cookie 0xe4e6e89fb01dac52 00000100:00080000:2.0:1788872814.894860:0:91008:0:(import.c:65:import_set_state_nolock()) ffff98a9c45cb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872814.894926:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+5:2403:x1875765311192064:12345-192.168.204.39@tcp:250:mount.lustre.0 Request processed in 178us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872814.894934:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 82 00010000:00010000:1.0:1788872814.904716:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872814.931949:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872814.932224:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311192192 00000100:00100000:1.0:1788872814.932235:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311192192 00000100:00100000:1.0:1788872814.932306:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 83 00000100:00100000:1.0:1788872814.932320:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+5:71007:x1875765311192192:12345-192.168.204.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788872814.932420:0:91007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872814.932460:0:91007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01dac59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb016 expref: -99 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872814.932492:0:91007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01dac59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb016 expref: 6 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872814.932505:0:91007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01dac59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb016 expref: 6 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872814.932516:0:91007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c800, rc 0) 00000100:00100000:1.0:1788872814.932611:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+6:71007:x1875765311192192:12345-192.168.204.39@tcp:101:mount.lustre.0 Request processed in 295us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872814.932618:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 83 00000100:00100000:3.0:1788872814.936737:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872814.936853:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311192320 00000100:00100000:1.0:1788872814.936866:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311192320 00000100:00100000:1.0:1788872814.936930:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 84 00000100:00100000:1.0:1788872814.936942:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+6:71007:x1875765311192320:12345-192.168.204.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788872814.937183:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+6:71007:x1875765311192320:12345-192.168.204.39@tcp:501:mount.lustre.0 Request processed in 242us (457us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788872814.937191:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 84 00000100:00100000:3.0:1788872814.941475:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872814.942641:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311192448 00000100:00100000:1.0:1788872814.942654:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311192448 00000100:00100000:1.0:1788872814.942709:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 85 00000100:00100000:1.0:1788872814.942719:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+6:71007:x1875765311192448:12345-192.168.204.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788872814.942736:0:91012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872814.942754:0:91012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dac60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb01d expref: -99 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872814.942803:0:91012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dac60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb01d expref: 7 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872814.942816:0:91012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dac60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb01d expref: 7 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872814.942825:0:91012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d000, rc 0) 00000100:00100000:1.0:1788872814.942900:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+7:71007:x1875765311192448:12345-192.168.204.39@tcp:101:mount.lustre.0 Request processed in 183us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872814.942907:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 85 00000100:00100000:1.0:1788872814.955709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872814.959226:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311192576 00000100:00100000:2.0:1788872814.959243:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311192576 00000100:00100000:2.0:1788872814.959422:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 86 00000100:00100000:2.0:1788872814.959448:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+7:71007:x1875765311192576:12345-192.168.204.39@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788872814.959649:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+8:71007:x1875765311192576:12345-192.168.204.39@tcp:501:mount.lustre.0 Request processed in 202us (3947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872814.959656:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 86 00000100:00100000:2.0:1788872814.963210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872814.963344:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311192704 00000100:00100000:1.0:1788872814.963354:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311192704 00000100:00100000:1.0:1788872814.963452:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 87 00000100:00100000:1.0:1788872814.963464:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+8:71007:x1875765311192704:12345-192.168.204.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788872814.963673:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+8:71007:x1875765311192704:12345-192.168.204.39@tcp:503:mount.lustre.0 Request processed in 210us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872814.963682:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 87 00000100:00100000:3.0:1788872814.997995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872814.998268:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311192832 00000100:00100000:1.0:1788872814.998278:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311192832 00000100:00100000:1.0:1788872814.998346:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 88 00000100:00100000:1.0:1788872814.998357:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+8:71025:x1875765311192832:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788872814.998609:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+8:71025:x1875765311192832:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 253us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872814.998618:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 88 00000100:00100000:1.0:1788872815.060902:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872815.061256:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311192960 00000100:00100000:2.0:1788872815.061267:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311192960 00000100:00100000:2.0:1788872815.061330:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 89 00000100:00100000:2.0:1788872815.061340:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+8:71025:x1875765311192960:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788872815.064247:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+8:71025:x1875765311192960:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 2898us (3345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872815.064263:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 89 00000100:00100000:0.0:1788872815.075162:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872815.076322:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311193088 00000100:00100000:1.0:1788872815.076338:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311193088 00000100:00100000:1.0:1788872815.076423:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 90 00000100:00100000:1.0:1788872815.076434:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+8:71025:x1875765311193088:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788872815.076669:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+8:71025:x1875765311193088:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 236us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872815.076677:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 90 00000100:00100000:1.0:1788872815.100714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872815.102969:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311193216 00000100:00100000:2.0:1788872815.102996:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311193216 00000100:00100000:2.0:1788872815.103269:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 91 00000100:00100000:2.0:1788872815.103281:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+8:71007:x1875765311193216:12345-192.168.204.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788872815.103299:0:91008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872815.103319:0:91008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5c5a000/0xe4e6e89fb01dac67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb04e expref: -99 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872815.103351:0:91008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5c5a000/0xe4e6e89fb01dac67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb04e expref: 9 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872815.103363:0:91008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5c5a000/0xe4e6e89fb01dac67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb04e expref: 9 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872815.103373:0:91008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5c5a000, rc 0) 00000100:00100000:2.0:1788872815.103451:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71007:x1875765311193216:12345-192.168.204.39@tcp:101:mount.lustre.0 Request processed in 172us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872815.103458:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 91 00000100:00100000:2.0:1788872815.107705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872815.107808:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311193344 00000100:00100000:3.0:1788872815.107819:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311193344 00000100:00100000:3.0:1788872815.107883:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 92 00000100:00100000:3.0:1788872815.107895:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+9:71007:x1875765311193344:12345-192.168.204.39@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788872815.107922:0:91011:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788872815.107947:0:91011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788872815.107951:0:91011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788872815.107972:0:91011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788872815.107975:0:91011:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788872815.107978:0:91011:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:3.0:1788872815.116473:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+9:71007:x1875765311193344:12345-192.168.204.39@tcp:256:mount.lustre.0 Request processed in 8565us (8764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872815.116489:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 92 00000100:00100000:2.0:1788872815.122767:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872815.122919:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311193472 00000100:00100000:3.0:1788872815.122930:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311193472 00000100:00100000:3.0:1788872815.123003:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 93 00000100:00100000:3.0:1788872815.123015:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c654b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+9:71007:x1875765311193472:12345-192.168.204.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788872815.123044:0:91007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872815.123066:0:91007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d2200/0xe4e6e89fb01dac6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb055 expref: -99 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872815.123100:0:91007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d2200/0xe4e6e89fb01dac6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb055 expref: 10 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872815.123112:0:91007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d2200/0xe4e6e89fb01dac6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb055 expref: 10 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872815.123122:0:91007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2200, rc 0) 00000100:00100000:3.0:1788872815.123188:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c654b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:71007:x1875765311193472:12345-192.168.204.39@tcp:101:mount.lustre.0 Request processed in 175us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872815.123195:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 93 00000100:00100000:2.0:1788872815.137612:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872815.137754:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311193600 00000100:00100000:1.0:1788872815.137766:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311193600 00000100:00100000:1.0:1788872815.137826:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 94 00000100:00100000:1.0:1788872815.137836:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c654bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:71007:x1875765311193600:12345-192.168.204.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788872815.138004:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c654bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:71007:x1875765311193600:12345-192.168.204.39@tcp:501:mount.lustre.0 Request processed in 168us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872815.138012:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 94 00000100:00100000:2.0:1788872815.143128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872815.143211:0:91011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311193728 00000100:00100000:3.0:1788872815.143222:0:91011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311193728 00000100:00100000:3.0:1788872815.143820:0:91011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 95 00000100:00100000:3.0:1788872815.143841:0:91011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:71007:x1875765311193728:12345-192.168.204.39@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788872815.144061:0:91011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:71007:x1875765311193728:12345-192.168.204.39@tcp:503:mount.lustre.0 Request processed in 227us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872815.144069:0:91011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 95 00000100:00100000:2.0:1788872815.152057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872815.152507:0:91012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311193856 00000100:00100000:0.0:1788872815.152518:0:91012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311193856 00000100:00100000:0.0:1788872815.152610:0:91012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 96 00000100:00100000:0.0:1788872815.152620:0:91012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c654a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+10:71030:x1875765311193856:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788872815.152784:0:91012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c654a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+10:71030:x1875765311193856:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 165us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872815.152792:0:91012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 96 00000100:00100000:2.0:1788872815.164716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872815.168644:0:91005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311193984 00000100:00100000:3.0:1788872815.168662:0:91005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311193984 00000100:00100000:0.0:1788872815.175854:0:91005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 97 00000100:00100000:0.0:1788872815.175870:0:91005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c654a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:71030:x1875765311193984:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788872815.176054:0:91005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c654a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:71030:x1875765311193984:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 186us (11348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872815.176063:0:91005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 97 00000100:00100000:0.0:1788872815.181014:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872815.181128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872815.187584:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311194112 00000100:00100000:1.0:1788872815.187600:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311194112 00000100:00100000:1.0:1788872815.187745:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311194368 00000100:00100000:1.0:1788872815.187749:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311194368 00000100:00100000:2.0:1788872815.187832:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1305 00000100:00100000:2.0:1788872815.187842:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875765311194112:12345-192.168.204.39@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788872815.187878:0:66193:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp t0 exp 0000000000000000 cur 3752 last 0 00000020:00000080:2.0:1788872815.187936:0:66193:0:(genops.c:1406:class_connect()) connect: client 0804304d-5904-48ad-87f2-bcbc7642a62a, cookie 0xe4e6e89fb01dac75 00000004:00100000:2.0:1788872815.187966:0:66193:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788872815.188095:0:66193:0:(import.c:65:import_set_state_nolock()) ffff98a8c679f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872815.188186:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311194112:12345-192.168.204.39@tcp:38:mount.lustre.0 Request processed in 343us (7181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872815.188194:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1305 00000100:00100000:2.0:1788872815.188212:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1306 00000100:00100000:2.0:1788872815.188217:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875765311194368:12345-192.168.204.39@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788872815.188232:0:66193:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp t0 exp 0000000000000000 cur 3752 last 0 00000020:00000080:2.0:1788872815.188263:0:66193:0:(genops.c:1406:class_connect()) connect: client 0804304d-5904-48ad-87f2-bcbc7642a62a, cookie 0xe4e6e89fb01dac7c 00000004:00100000:2.0:1788872815.188275:0:66193:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788872815.191828:0:66193:0:(import.c:65:import_set_state_nolock()) ffff98a8c679a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872815.191914:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311194368:12345-192.168.204.39@tcp:38:mount.lustre.0 Request processed in 3692us (10783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872815.191925:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1306 00000100:00100000:1.0:1788872815.201891:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872815.202516:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311194496 00000100:00100000:0.0:1788872815.202527:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311194496 00000100:00100000:0.0:1788872815.202657:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1307 00000100:00100000:0.0:1788872815.202669:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+6:0:x1875765311194496:12345-192.168.204.39@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788872815.202708:0:66979:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1788872815.202787:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+6:0:x1875765311194496:12345-192.168.204.39@tcp:41:mount.lustre.0 Request processed in 120us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872815.202812:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1307 00000100:00080000:2.0:1788872815.202941:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872815.214690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872815.214735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872815.214827:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311194240 00000100:00100000:1.0:1788872815.214837:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311194240 00000100:00100000:1.0:1788872815.214914:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311194624 00000100:00100000:1.0:1788872815.214918:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311194624 00000100:00100000:1.0:1788872815.214943:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1308 00000100:00100000:1.0:1788872815.214953:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+7:0:x1875765311194240:12345-192.168.204.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788872815.215010:0:68674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445101568 avail 1298862080 00000100:00100000:1.0:1788872815.215093:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+7:0:x1875765311194240:12345-192.168.204.39@tcp:41:mount.lustre.0 Request processed in 140us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872815.215101:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1308 00000100:00100000:1.0:1788872815.215121:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1309 00000100:00100000:1.0:1788872815.215127:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71007:x1875765311194624:12345-192.168.204.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788872815.215140:0:68674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445101568 avail 1298862080 00000100:00100000:1.0:1788872815.215165:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71007:x1875765311194624:12345-192.168.204.39@tcp:41:mount.lustre.0 Request processed in 37us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872815.215171:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1309 00000100:00080000:2.0:1788872815.215366:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788872815.219138:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872815.225575:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311194752 00000100:00100000:0.0:1788872815.225591:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311194752 00000100:00100000:1.0:1788872815.229381:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1310 00000100:00100000:1.0:1788872815.229405:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71007:x1875765311194752:12345-192.168.204.39@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788872815.229525:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71007:x1875765311194752:12345-192.168.204.39@tcp:40:mount.lustre.0 Request processed in 130us (10397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872815.229533:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1310 00000100:00100000:0.0:1788872815.235495:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872815.235581:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872815.235590:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311194880 00000100:00100000:3.0:1788872815.235600:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311194880 00000100:00100000:3.0:1788872815.235640:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311195008 00000100:00100000:3.0:1788872815.235643:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311195008 00000100:00100000:3.0:1788872815.235661:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5978 00000100:00100000:3.0:1788872815.235670:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2403:x1875765311194880:12345-192.168.204.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788872815.235707:0:26183:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp t0 exp 0000000000000000 cur 3752 last 0 00000100:00100000:0.0:1788872815.235822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872815.235887:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5979 00000100:00100000:2.0:1788872815.235894:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2403:x1875765311195008:12345-192.168.204.39@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788872815.235912:0:26186:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp t0 exp 0000000000000000 cur 3752 last 0 00000020:00000080:2.0:1788872815.235944:0:26186:0:(genops.c:1406:class_connect()) connect: client 0804304d-5904-48ad-87f2-bcbc7642a62a, cookie 0xe4e6e89fb01dac8a 00002000:00100000:2.0:1788872815.235958:0:26186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0804304d-5904-48ad-87f2-bcbc7642a62a/ffff98a8c679f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788872815.235981:0:26186:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788872815.236087:0:26186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788872815.236118:0:26186:0:(import.c:65:import_set_state_nolock()) ffff98a8c679e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872815.236200:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311195008:12345-192.168.204.39@tcp:8:mount.lustre.0 Request processed in 303us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872815.236209:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5979 00000020:00000080:3.0:1788872815.239638:0:26183:0:(genops.c:1406:class_connect()) connect: client 0804304d-5904-48ad-87f2-bcbc7642a62a, cookie 0xe4e6e89fb01dac83 00002000:00100000:3.0:1788872815.239660:0:26183:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0804304d-5904-48ad-87f2-bcbc7642a62a/ffff98a9ef0a8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788872815.239685:0:26183:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788872815.239779:0:26183:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788872815.239820:0:26183:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0aa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872815.239891:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311194880:12345-192.168.204.39@tcp:8:mount.lustre.0 Request processed in 4219us (5357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872815.239902:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5978 00000100:00100000:2.0:1788872815.240988:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311195136 00000100:00100000:2.0:1788872815.240998:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311195136 00000100:00100000:2.0:1788872815.241059:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 12 00000100:00100000:2.0:1788872815.241069:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71007:x1875765311195136:12345-192.168.204.39@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788872815.241120:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71007:x1875765311195136:12345-192.168.204.39@tcp:900:mount.lustre.0 Request processed in 52us (5297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872815.241128:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 12 00000100:00100000:0.0:1788872815.251300:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872815.253209:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311195264 00000100:00100000:2.0:1788872815.253223:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311195264 00000100:00100000:2.0:1788872815.253645:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 231 00000100:00100000:2.0:1788872815.253657:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71007:x1875765311195264:12345-192.168.204.39@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788872815.253751:0:66194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788872815.253856:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71007:x1875765311195264:12345-192.168.204.39@tcp:33:mount.lustre.0 Request processed in 200us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872815.253877:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 231 00010000:00010000:1.0:1788872815.930199:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872816.825306:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327756928:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825387:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825436:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327757440:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825485:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327757952:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825582:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327758464:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825632:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788872816.825637:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327757056:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825658:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825674:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327757568:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825696:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825711:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327758080:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825730:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825755:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327757312:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825777:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825793:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327757824:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825817:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825835:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327758336:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825855:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825872:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788872816.825878:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327757184:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825898:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825914:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327757696:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825950:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327758208:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.825971:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872816.825998:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327757440 00000100:00100000:1.0:1788872816.826005:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327757440 00000100:00100000:1.0:1788872816.826051:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327757952 00000100:00100000:1.0:1788872816.826060:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327757952 00000100:00100000:1.0:1788872816.826077:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327758464 00000100:00100000:1.0:1788872816.826079:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327758464 00000100:00100000:1.0:1788872816.826087:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327757056 00000100:00100000:1.0:1788872816.826089:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327757056 00000100:00100000:1.0:1788872816.826099:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327757312 00000100:00100000:1.0:1788872816.826102:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327757312 00000100:00100000:1.0:1788872816.826112:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327757184 00000100:00100000:1.0:1788872816.826114:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327757184 00000100:00100000:1.0:1788872816.826128:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1788872816.826136:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327757440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826191:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327757440:12345-0@lo:400:kworker.0 Request processed in 55us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872816.826198:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1788872816.826214:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1788872816.826220:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327757952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826247:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327757952:12345-0@lo:400:kworker.0 Request processed in 28us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872816.826253:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1788872816.826264:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1788872816.826269:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327758464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826296:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327758464:12345-0@lo:400:kworker.0 Request processed in 26us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872816.826301:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1788872816.826312:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1788872816.826318:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327757056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826344:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327757056:12345-0@lo:400:kworker.0 Request processed in 27us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872816.826356:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1788872816.826369:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1788872816.826375:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327757312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826407:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327757312:12345-0@lo:400:kworker.0 Request processed in 33us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872816.826413:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1788872816.826425:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1788872816.826431:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327757184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826458:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327757184:12345-0@lo:400:kworker.0 Request processed in 28us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872816.826464:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1788872816.826483:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327757824 00000100:00100000:1.0:1788872816.826487:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327757824 00000100:00100000:1.0:1788872816.826524:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327758336 00000100:00100000:1.0:1788872816.826527:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327758336 00000100:00100000:1.0:1788872816.826543:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327757696 00000100:00100000:1.0:1788872816.826545:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327757696 00000100:00100000:1.0:1788872816.826587:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327758208 00000100:00100000:1.0:1788872816.826590:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327758208 00000100:00100000:1.0:1788872816.826608:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645 00000100:00100000:1.0:1788872816.826615:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327757824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826645:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327757824:12345-0@lo:400:kworker.0 Request processed in 30us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872816.826651:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645 00000100:00100000:1.0:1788872816.826662:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646 00000100:00100000:1.0:1788872816.826668:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327758336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826705:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327758336:12345-0@lo:400:kworker.0 Request processed in 37us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872816.826720:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646 00000100:00100000:1.0:1788872816.826731:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647 00000100:00100000:1.0:1788872816.826738:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327757696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826765:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327757696:12345-0@lo:400:kworker.0 Request processed in 28us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872816.826770:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647 00000100:00100000:1.0:1788872816.826781:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648 00000100:00100000:1.0:1788872816.826786:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327758208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826812:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327758208:12345-0@lo:400:kworker.0 Request processed in 25us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872816.826817:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648 00000100:00100000:1.0:1788872816.826869:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327757184:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826880:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327757696:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826887:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327758208:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826896:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327757312:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826905:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327757824:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826913:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327758336:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826982:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327757056:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.826993:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327757440:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.827001:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327757952:0@lo:400:kworker.0 00000100:00100000:1.0:1788872816.827021:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327758464:0@lo:400:kworker.0 00000100:00100000:3.0:1788872816.827220:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327757568 00000100:00100000:3.0:1788872816.827225:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327757568 00000100:00100000:3.0:1788872816.827272:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327758080 00000100:00100000:3.0:1788872816.827276:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327758080 00000100:00100000:3.0:1788872816.827294:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00000100:00100000:3.0:1788872816.827301:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327757568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872816.827358:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327757568:12345-0@lo:400:kworker.0 Request processed in 57us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872816.827365:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00000100:00100000:3.0:1788872816.827379:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:3.0:1788872816.827384:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327758080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872816.827412:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327758080:12345-0@lo:400:kworker.0 Request processed in 28us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872816.827418:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00100000:3.0:1788872816.827452:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000004:00080000:3.0:1788872816.827458:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116995 committed transno 115964116995 00000100:00100000:3.0:1788872816.827478:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327757568:0@lo:400:kworker.0 00000100:00100000:3.0:1788872816.827489:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327758080:0@lo:400:kworker.0 00000100:00100000:2.0:1788872816.827649:0:91007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327756928 00000100:00100000:2.0:1788872816.827655:0:91007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327756928 00000100:00100000:2.0:1788872816.827683:0:91007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788872816.827689:0:91007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c654a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327756928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872816.827728:0:91007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c654a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327756928:12345-0@lo:400:kworker.0 Request processed in 39us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872816.827735:0:91007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1788872816.827773:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872816.827778:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872816.827780:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788872816.827783:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872816.828478:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327756928:0@lo:400:kworker.0 00000100:00100000:0.0:1788872816.829083:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327758592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872816.829134:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872816.829223:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327758592 00000100:00100000:3.0:1788872816.829229:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327758592 00000100:00100000:3.0:1788872816.829277:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:3.0:1788872816.829284:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327758592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788872816.829315:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1788872816.829365:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327758592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872816.829372:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00000100:00100000:0.0:1788872816.829515:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327758592:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788872816.952959:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872817.252064:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872817.252144:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311195392 00000100:00100000:1.0:1788872817.252156:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311195392 00000100:00100000:1.0:1788872817.252252:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1311 00000100:00100000:1.0:1788872817.252263:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71073:x1875765311195392:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:1.0:1788872817.252284:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872817.252310:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d200/0xe4e6e89fb01dac91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb086 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788872817.252612:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788872817.253125:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dac98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872817.253146:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dac98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872817.253160:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dac98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872817.253217:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788872817.253221:0:68674:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788872817.253242:0:68674:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dac98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872817.253270:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d200/0xe4e6e89fb01dac91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb086 expref: 8 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872817.253288:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dac98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb086 expref: 7 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872817.253315:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d14a2200) 00010000:00010000:1.0:1788872817.253318:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788872817.253321:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9ca00, rc 0) 00000100:00100000:1.0:1788872817.253396:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+7:71073:x1875765311195392:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 1134us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872817.253471:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1311 00000100:00100000:1.0:1788872817.258079:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872817.258160:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311195520 00000100:00100000:3.0:1788872817.258170:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311195520 00000100:00100000:3.0:1788872817.258237:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1312 00000100:00100000:3.0:1788872817.258258:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:71073:x1875765311195520:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872817.258321:0:83669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445101568 avail 1298862080 00000100:00100000:3.0:1788872817.258405:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:71073:x1875765311195520:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 158us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872817.258413:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1312 00000100:00100000:0.0:1788872817.261868:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872817.262044:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311195648 00000100:00100000:3.0:1788872817.262054:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311195648 00000100:00100000:3.0:1788872817.262179:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1313 00000100:00100000:3.0:1788872817.262190:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71073:x1875765311195648:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872817.262231:0:66192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1788872817.262327:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71073:x1875765311195648:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 138us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872817.262334:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1313 00000100:00080000:0.0:1788872817.262387:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872817.268819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872817.268921:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311195776 00000100:00100000:3.0:1788872817.268931:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311195776 00000100:00100000:3.0:1788872817.269106:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2131 00000100:00100000:3.0:1788872817.269117:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71073:x1875765311195776:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872817.269156:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872817.269233:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71073:x1875765311195776:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 117us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872817.269241:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2131 00000100:00100000:1.0:1788872817.272429:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872817.272528:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311195904 00000100:00100000:3.0:1788872817.272538:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311195904 00000100:00080000:0.0:1788872817.272674:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872817.272679:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872817.272828:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2132 00000100:00100000:3.0:1788872817.272840:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71073:x1875765311195904:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872817.272879:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872817.272969:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71073:x1875765311195904:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 131us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872817.272976:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2132 00000100:00100000:1.0:1788872817.337034:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327758848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872817.337107:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872817.337158:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872817.337166:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327758720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872817.337191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872817.337440:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327758848 00000100:00100000:0.0:1788872817.337451:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327758848 00000100:00100000:0.0:1788872817.337508:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327758720 00000100:00100000:0.0:1788872817.337511:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327758720 00000100:00100000:0.0:1788872817.337537:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:0.0:1788872817.337546:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327758848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872817.337594:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872817.337659:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327758848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872817.337686:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00100000:0.0:1788872817.337702:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:0.0:1788872817.337708:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327758720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872817.337719:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872817.337749:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327758720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872817.337755:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00100000:0.0:1788872817.337801:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327758720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872817.337814:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327758848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872817.338042:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872817.338053:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327758976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872817.338085:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872817.338167:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327758976 00000100:00100000:2.0:1788872817.338172:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327758976 00000100:00100000:2.0:1788872817.338210:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:2.0:1788872817.338216:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327758976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872817.338235:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445101568 avail 1298862080 00000100:00100000:2.0:1788872817.338301:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327758976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872817.338308:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00000100:00100000:3.0:1788872817.338492:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327758976:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788872817.977232:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872818.342871:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872818.342947:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311196032 00000100:00100000:3.0:1788872818.342957:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311196032 00000100:00100000:3.0:1788872818.343033:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1314 00000100:00100000:3.0:1788872818.343044:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+7:71107:x1875765311196032:12345-192.168.204.39@tcp:101:cp.0 00010000:00010000:3.0:1788872818.343065:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872818.343088:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dac9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb08d expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343155:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01daca6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343169:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01daca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343180:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01daca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343194:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343201:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343207:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343282:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dacb4 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343290:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dacb4 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343296:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dacb4 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872818.343331:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dacb4 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343345:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01daca6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343352:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01daca6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343358:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01daca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343365:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01daca6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343371:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872818.343375:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01daca6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343383:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01daca6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343396:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d14a2200) 00010000:00010000:3.0:1788872818.343405:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872818.343410:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01daca6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343417:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01daca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343433:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343438:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343444:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343450:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872818.343453:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343459:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343466:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff98a9d1f7a500) 00010000:00010000:3.0:1788872818.343469:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872818.343472:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343490:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343520:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dac9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb08d expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343544:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dacb4 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb08d expref: 8 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.343574:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9d1f7a400) 00010000:00010000:3.0:1788872818.343576:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788872818.343578:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3600, rc 0) 00000100:00100000:3.0:1788872818.343641:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71107:x1875765311196032:12345-192.168.204.39@tcp:101:cp.0 Request processed in 599us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872818.343648:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1314 00000100:00100000:2.0:1788872818.348644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872818.351714:0:66204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311196160 00000100:00100000:3.0:1788872818.351729:0:66204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311196160 00000100:00100000:3.0:1788872818.351794:0:66204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 13 00000100:00100000:3.0:1788872818.351804:0:66204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71107:x1875765311196160:12345-192.168.204.39@tcp:900:cp.0 00000100:00100000:3.0:1788872818.351891:0:66204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71107:x1875765311196160:12345-192.168.204.39@tcp:900:cp.0 Request processed in 89us (3256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872818.351899:0:66204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 13 00000100:00100000:0.0:1788872818.355307:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872818.355657:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311196288 00000100:00100000:3.0:1788872818.355668:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311196288 00000100:00100000:3.0:1788872818.355736:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1315 00000100:00100000:3.0:1788872818.355746:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+6:71107:x1875765311196288:12345-192.168.204.39@tcp:101:cp.0 00010000:00010000:3.0:1788872818.355778:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872818.355803:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dacbb lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb094 expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.355876:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dacc2 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.355906:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dacc2 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.355919:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dacc2 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872818.355962:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1788872818.355966:0:83669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788872818.356034:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dacbb lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb094 expref: 8 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.356058:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dacc2 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb094 expref: 7 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.356066:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9d1f7ab00) 00010000:00010000:3.0:1788872818.356069:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1788872818.356072:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2c00, rc 0) 00000100:00100000:3.0:1788872818.356134:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:71107:x1875765311196288:12345-192.168.204.39@tcp:101:cp.0 Request processed in 388us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872818.356140:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1315 00000100:00100000:1.0:1788872818.360298:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872818.360384:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311196416 00000100:00100000:0.0:1788872818.360395:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311196416 00000100:00100000:0.0:1788872818.360496:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1316 00000100:00100000:0.0:1788872818.360508:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+7:71107:x1875765311196416:12345-192.168.204.39@tcp:101:cp.0 00010000:00010000:0.0:1788872818.360531:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872818.361768:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dacc9 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb09b expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872818.361789:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327759104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872818.361843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788872818.361843:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01dacd0 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.361856:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01dacd0 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.361874:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01dacd0 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872818.361889:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327759232:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788872818.361890:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dacd7 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.361897:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dacd7 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.361904:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dacd7 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872818.361921:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872818.361954:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327759104 00010000:00010000:0.0:1788872818.361987:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dacde lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362082:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dacde lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362090:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dacde lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872818.362128:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00000004:00200000:0.0:1788872818.362132:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788872818.362154:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dacde lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362169:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01dacd0 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362176:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01dacd0 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362191:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01dacd0 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362198:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01dacd0 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362204:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872818.362209:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01dacd0 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362216:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01dacd0 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362228:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9d1f7ab00) 00010000:00010000:0.0:1788872818.362232:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872818.362236:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01dacd0 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362243:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9200/0xe4e6e89fb01dacd0 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362255:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dacd7 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362261:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dacd7 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362266:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dacd7 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362271:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872818.362281:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dacd7 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362287:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dacd7 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362295:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff98a8ca102500) 00010000:00010000:0.0:1788872818.362298:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872818.362301:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dacd7 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362307:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dacd7 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362339:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dacc9 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb09b expref: 9 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362352:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dacde lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb09b expref: 8 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872818.362359:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a8ca102100) 00010000:00010000:0.0:1788872818.362361:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788872818.362364:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9a00, rc 0) 00000100:00100000:0.0:1788872818.362412:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71107:x1875765311196416:12345-192.168.204.39@tcp:101:cp.0 Request processed in 1906us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872818.362420:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1316 00000100:00100000:2.0:1788872818.363064:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327759104 00000100:00100000:2.0:1788872818.363116:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327759232 00000100:00100000:2.0:1788872818.363120:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327759232 00000100:00100000:2.0:1788872818.363144:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:2.0:1788872818.363397:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327759104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872818.363421:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872818.363571:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327759104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 419us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872818.363579:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00100000:2.0:1788872818.363597:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:2.0:1788872818.363604:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327759232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872818.363615:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872818.363649:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327759232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872818.363655:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:2.0:1788872818.363706:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327759232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872818.363757:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327759104:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788872818.363812:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872818.363816:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872818.367133:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872818.367522:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311196544 00000100:00100000:3.0:1788872818.367533:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311196544 00000100:00100000:3.0:1788872818.367614:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1317 00000100:00100000:3.0:1788872818.367625:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71107:x1875765311196544:12345-192.168.204.39@tcp:101:cp.0 00010000:00010000:3.0:1788872818.367645:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872818.367665:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dace5 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0a2 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.367875:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dacec lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.367889:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dacec lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.367900:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dacec lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.367913:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacf3 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.367920:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacf3 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.367926:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacf3 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.367967:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dacec lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.367975:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dacec lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.367982:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dacec lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.367989:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dacec lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.367995:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872818.368006:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dacec lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368014:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dacec lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368027:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a8ca102100) 00010000:00010000:3.0:1788872818.368030:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872818.368034:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dacec lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368040:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dacec lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368053:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacf3 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368059:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacf3 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368065:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacf3 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368069:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872818.368072:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacf3 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368077:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacf3 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368085:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xb1bed465 (ffff98a9d1f7a500) 00010000:00010000:3.0:1788872818.368087:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872818.368096:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacf3 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368103:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dacf3 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368139:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dace5 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0a2 expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368150:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a8ca102100) 00010000:00010000:3.0:1788872818.368153:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872818.368156:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dace5 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0a2 expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.368165:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3200, rc 0) 00000100:00100000:3.0:1788872818.368232:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71107:x1875765311196544:12345-192.168.204.39@tcp:101:cp.0 Request processed in 609us (1107us total) trans 0 rc 301/301 00000100:00100000:3.0:1788872818.368240:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1317 00000100:00100000:0.0:1788872818.374092:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872818.374172:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311196672 00000100:00100000:3.0:1788872818.374182:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311196672 00000100:00100000:3.0:1788872818.374239:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1318 00000100:00100000:3.0:1788872818.374251:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71107:x1875765311196672:12345-192.168.204.39@tcp:101:cp.0 00010000:00010000:3.0:1788872818.374272:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872818.374295:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dacfa lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0a9 expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.374372:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dad01 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.374400:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dad01 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.374413:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dad01 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.374429:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dad08 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.374437:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dad08 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.374444:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dad08 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.374495:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dad01 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.374503:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dad01 lrc: 2/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.374510:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dad01 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.374517:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872818.374521:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dad01 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.374528:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dad01 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.374541:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a8ca102100) 00010000:00010000:3.0:1788872818.375072:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872818.375079:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dad01 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.375086:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dad01 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.375100:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dad08 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.375107:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dad08 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.375112:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dad08 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.375117:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872818.375119:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dad08 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.375125:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dad08 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.375134:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xb1bed465 (ffff98a9d1f7a800) 00010000:00010000:3.0:1788872818.375137:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872818.375139:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dad08 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.375144:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dad08 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.375183:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dacfa lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0a9 expref: 9 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.375202:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a8ca102100) 00010000:00010000:3.0:1788872818.375205:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872818.375209:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dacfa lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0a9 expref: 9 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872818.375218:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3800, rc 0) 00000100:00100000:0.0:1788872818.379111:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71107:x1875765311196672:12345-192.168.204.39@tcp:101:cp.0 Request processed in 4851us (5014us total) trans 0 rc 301/301 00000100:00100000:0.0:1788872818.379132:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1318 00000100:00100000:1.0:1788872818.388401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872818.390270:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311196800 00000100:00100000:3.0:1788872818.390283:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311196800 00000100:00100000:3.0:1788872818.390359:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 13 00000100:00100000:3.0:1788872818.390370:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71107:x1875765311196800:12345-192.168.204.39@tcp:700:cp.0 00000020:02000000:3.0:1788872818.390385:0:66202:0:(tgt_handler.c:884:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:3.0:1788872818.397116:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71107:x1875765311196800:12345-192.168.204.39@tcp:700:cp.0 Request processed in 6735us (8711us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872818.397133:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 13 00000001:00100000:1.0:1788872818.877480:0:91001:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000001:00100000:1.0:1788872818.877493:0:91001:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00080000:1.0:1788872818.877501:0:91001:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116996 is committed 00000020:00000080:1.0:1788872818.877508:0:91001:0:(genops.c:906:class_export_put()) final put ffff98a9ef255000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00100000:0.0:1788872818.877664:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000001:00100000:0.0:1788872818.877683:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:0.0:1788872818.877686:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a9c73d2000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:2.0:1788872818.877837:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef255000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-MDT0000 00000020:00000080:2.0:1788872818.877909:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c73d2000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-OST0000 00000020:00000080:2.0:1788872818.877934:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c4c3b000 for lustre-MDT0000 00000020:00000080:2.0:1788872818.877939:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c73d7800 for lustre-OST0000 00000001:00100000:0.0:1788872818.878347:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000001:00100000:0.0:1788872818.878356:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:0.0:1788872818.878359:0:9516:0:(genops.c:906:class_export_put()) final put ffff98a9c8f56800/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00000080:1.0:1788872818.878434:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c8f56800/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-OST0001 00000020:00000080:1.0:1788872818.878484:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c8f55000 for lustre-OST0001 00000001:00100000:0.0:1788872818.879885:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000001:00100000:0.0:1788872818.879898:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000001:00080000:0.0:1788872818.879905:0:75620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411443 is committed 00000020:00000080:0.0:1788872818.879918:0:75620:0:(genops.c:906:class_export_put()) final put ffff98a9f0924000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 00000020:00080000:0.0:1788872818.879945:0:75620:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98a8c7382d80 refcount 2 committed 0 result 0 batchid 73014444090 00000020:00080000:0.0:1788872818.879950:0:75620:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98a9f829c600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98a8c7382c00 00000020:00080000:0.0:1788872818.879954:0:75620:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000090a1:0x2:0x0].2 00000020:00080000:0.0:1788872818.879956:0:75620:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98a9f829cc00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98a9c56e0200 00000020:00080000:0.0:1788872818.879959:0:75620:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].2 00000020:00080000:3.0:1788872818.880017:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444090 committed batchid 73014444089 00000020:00080000:3.0:1788872818.880093:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444089 00000020:00000080:2.0:1788872818.880166:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f0924000/2a005fe2-2a3d-4ca6-8402-a633d5d16eb3 for lustre-MDT0001 00000020:00000080:2.0:1788872818.880233:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9faa59800 for lustre-MDT0001 00010000:00010000:1.0:1788872819.000748:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872820.025643:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872820.494130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872820.494177:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872820.494219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872820.494245:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872820.494268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872820.494300:0:91008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311196928 00000100:00100000:0.0:1788872820.494312:0:91008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311196928 00000100:00100000:3.0:1788872820.494333:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311197056 00000100:00100000:3.0:1788872820.494340:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311197056 00000100:00100000:0.0:1788872820.494374:0:91008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 99 00000100:00100000:0.0:1788872820.494389:0:91008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311196928:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872820.494402:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311197184 00000100:00100000:3.0:1788872820.494407:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311197184 00000100:00100000:3.0:1788872820.494445:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1334 00000100:00100000:3.0:1788872820.494454:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311197056:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872820.494498:0:91008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311196928:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 112us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872820.494499:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311197056:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 44us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872820.494517:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1334 00000100:00100000:0.0:1788872820.494517:0:91008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 99 00000100:00100000:3.0:1788872820.494546:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1335 00000100:00100000:3.0:1788872820.494588:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311197184:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872820.494597:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311197312 00000100:00100000:0.0:1788872820.494603:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311197312 00000100:00100000:3.0:1788872820.494623:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311197184:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 36us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872820.494629:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1335 00000100:00100000:0.0:1788872820.494640:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311197440 00000100:00100000:0.0:1788872820.494643:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311197440 00000100:00080000:3.0:1788872820.494655:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872820.494660:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872820.494664:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872820.494667:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872820.494672:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2649 00000100:00100000:0.0:1788872820.494681:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311197312:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872820.494698:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2650 00000100:00100000:3.0:1788872820.494708:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311197440:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872820.494718:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311197312:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 36us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872820.494725:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2649 00000100:00100000:3.0:1788872820.494750:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311197440:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 42us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872820.494758:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2650 00010000:00010000:0.0:1788872821.049232:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788872821.209671:0:92023:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788872821.209729:0:92023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.209745:0:92023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.209754:0:92023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.209762:0:92023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.209798:0:92023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788872821.209820:0:92023:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788872821.209850:0:92023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788872821.209854:0:92023:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788872821.209860:0:92023:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788872821.209888:0:92023:0:(import.c:65:import_set_state_nolock()) ffff98a9c9892800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788872821.210069:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872821.210076:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.210084:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872821.210088:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.210097:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872821.210103:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872821.210109:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788872821.210111:0:14981:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788872821.210113:0:14981:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788872821.210141:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.210148:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872821.210177:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.210185:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5440000/0xe4e6e89fb01da80e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da815 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.210197:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872821.210199:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872821.210201:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872821.210209:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872821.210236:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327759488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872821.210305:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.210363:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327759488 00000100:00100000:2.0:1788872821.210369:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327759488 00000100:00100000:2.0:1788872821.210416:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1788872821.210436:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327759488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872821.210451:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872821.210468:0:26197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01da815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da80e expref: 24 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.210479:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872821.210514:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3644:x1875765327759488:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872821.210521:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1788872821.210589:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327759488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872821.212979:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327759360:0@lo:39:umount.0 00000100:00100000:0.0:1788872821.213063:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872821.213651:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327759360 00000100:00100000:3.0:1788872821.213661:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327759360 00000100:00100000:3.0:1788872821.213727:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:3.0:1788872821.213737:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875765327759360:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788872821.213782:0:66190:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da92d 00000100:00080000:3.0:1788872821.213793:0:66190:0:(import.c:65:import_set_state_nolock()) ffff98a9fa737000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788872821.213883:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1875765327759360:12345-0@lo:39:umount.0 Request processed in 146us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872821.213890:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000020:00000080:3.0:1788872821.213900:0:66190:0:(genops.c:906:class_export_put()) final put ffff98a9fa732000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788872821.214156:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9fa732000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788872821.214215:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9fa737000 for lustre-MDT0000 00010000:00010000:1.0:1788872821.214226:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788872821.216984:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9c9892800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788872821.217007:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327759360:0@lo:39:umount.0 00000100:00080000:3.0:1788872821.221038:0:92023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788872821.221047:0:92023:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788872821.221055:0:92023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788872821.221962:0:92023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.221977:0:92023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.221983:0:92023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.221990:0:92023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222029:0:92023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872821.222036:0:92023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222043:0:92023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222050:0:92023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222055:0:92023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222068:0:92023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788872821.222074:0:92023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222081:0:92023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222086:0:92023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222091:0:92023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222100:0:92023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788872821.222105:0:92023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222117:0:92023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222123:0:92023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222130:0:92023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872821.222151:0:92023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788872821.222155:0:92023:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788872821.222186:0:92023:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788872821.222192:0:92023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1788872821.222196:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788872821.222202:0:92023:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1788872821.222473:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788872821.222482:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.222489:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872821.222493:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.222501:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872821.222516:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872821.222521:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788872821.222523:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788872821.222526:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788872821.222587:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.222594:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872821.222612:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.222963:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01da727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da72e expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.222979:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788872821.222982:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.222988:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872821.222991:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.222998:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872821.223005:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872821.223021:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788872821.223024:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788872821.223026:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788872821.223041:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223048:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872821.223056:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223062:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5440200/0xe4e6e89fb01da838 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da83f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223073:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872821.223076:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223082:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aea00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872821.223084:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223091:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872821.223097:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872821.223102:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788872821.223104:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788872821.223106:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788872821.223127:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223133:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872821.223149:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223156:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c58aea00/0xe4e6e89fb01da800 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da807 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223165:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872821.223168:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223173:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872821.223175:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223180:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872821.223185:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872821.223190:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788872821.223192:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788872821.223194:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788872821.223205:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223210:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872821.223214:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223226:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01da719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01da720 expref: -99 pid: 91000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872821.223234:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872821.223236:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872821.223238:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872821.223246:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872821.223264:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327760000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872821.223333:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.224414:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327759616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872821.224482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.224539:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872821.224570:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327759744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872821.224594:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.224633:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327760000 00000100:00100000:2.0:1788872821.224641:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327760000 00000100:00100000:2.0:1788872821.224688:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327759616 00000100:00100000:2.0:1788872821.224692:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327759616 00000100:00100000:2.0:1788872821.224710:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327759744 00000100:00100000:2.0:1788872821.224713:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327759744 00000100:00100000:2.0:1788872821.224734:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1788872821.224743:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3645:x1875765327760000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872821.224767:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872821.224785:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52aec00/0xe4e6e89fb01da720 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da719 expref: 25 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.224800:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872821.224833:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327760000:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872821.224841:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1788872821.224862:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1788872821.224868:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3646:x1875765327759616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872821.224875:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872821.224885:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01da72e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da727 expref: 23 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.224893:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872821.224918:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3646:x1875765327759616:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872821.224924:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1788872821.224974:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1788872821.224980:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3646:x1875765327759744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872821.224989:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872821.224999:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8cc3e7600/0xe4e6e89fb01da83f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da838 expref: 21 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.225007:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872821.225029:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3646:x1875765327759744:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872821.225045:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00010000:00010000:2.0:1788872821.225075:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872821.225089:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327759872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872821.225116:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.225150:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327759872 00000100:00100000:2.0:1788872821.225153:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327759872 00000100:00100000:2.0:1788872821.225177:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1788872821.225183:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3644:x1875765327759872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872821.225190:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872821.225199:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c58ae200/0xe4e6e89fb01da807 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da800 expref: 20 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.225208:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872821.225233:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:3644:x1875765327759872:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872821.225239:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1788872821.225270:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327759744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872821.225279:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327759616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872821.225304:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327759872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872821.226186:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1788872821.227025:0:92023:0:(mdt_handler.c:8248:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:3.0:1788872821.227678:0:92023:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1788872821.227690:0:92023:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a8c6798800 0804304d-5904-48ad-87f2-bcbc7642a62a 192.168.204.39@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788872821.227698:0:92023:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a8c5113000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788872821.227703:0:92023:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9cb5ee000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788872821.227707:0:92023:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9cb5e8800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788872821.227711:0:92023:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9ef256800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 115964116995 stale:0 00000020:00080000:3.0:1788872821.227716:0:92023:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff98a8c3408000) has exports, disconnecting them 00000020:00080000:3.0:1788872821.227721:0:92023:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.39@tcp (ffff98a8c6798800), last request at 1788872820 00000020:00000080:3.0:1788872821.227729:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dac75 00000100:00100000:0.0:1788872821.227821:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327760000:0@lo:103:ldlm_bl.0 00000020:00010000:3.0:1788872821.227925:0:92023:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a8c6798800: total 0 00000100:00080000:3.0:1788872821.227944:0:92023:0:(import.c:65:import_set_state_nolock()) ffff98a8c679f800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788872821.228048:0:92023:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a8c6798800): rc 0 00000020:00080000:3.0:1788872821.228053:0:92023:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a8c5113000), last request at 1788872791 00000020:00000080:3.0:1788872821.228056:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da926 00000100:00080000:3.0:1788872821.228060:0:92023:0:(import.c:65:import_set_state_nolock()) ffff98a8c5116800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788872821.228073:0:92023:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a8c5113000): rc 0 00000020:00000080:3.0:1788872821.228076:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a8c5113000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788872821.228088:0:92023:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9cb5ee000), last request at 1788872816 00000020:00000080:3.0:1788872821.228091:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da91f 00000100:00080000:3.0:1788872821.228094:0:92023:0:(import.c:65:import_set_state_nolock()) ffff98a9cb5ed800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788872821.228108:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c5113000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00010000:1.0:1788872821.228156:0:20230:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a8c6798800: total 1 00000020:00000080:3.0:1788872821.228166:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c5116800 for lustre-MDT0000 00000020:00080000:3.0:1788872821.228181:0:92023:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9cb5ee000): rc 0 00000020:00000080:3.0:1788872821.228183:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9cb5ee000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788872821.228198:0:92023:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9cb5e8800), last request at 1788872816 00010000:00010000:1.0:1788872821.228214:0:20230:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a8c6798800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788872821.228249:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dacb4 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb08d expref: 3 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872821.228275:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dac98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb086 expref: 2 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872821.228289:0:20230:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a8c6798800, canceled 2 locks, left on hash table 0. 00000020:00000080:3.0:1788872821.229046:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da918 00000100:00080000:3.0:1788872821.229063:0:92023:0:(import.c:65:import_set_state_nolock()) ffff98a9cb5ea800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788872821.229084:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb5ee000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788872821.229117:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9cb5ed800 for lustre-MDT0000 00000020:00080000:3.0:1788872821.229148:0:92023:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9cb5e8800): rc 0 00000020:00000080:3.0:1788872821.229150:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9cb5e8800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788872821.229158:0:92023:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9ef256800), last request at 1788872785 00000020:00000080:3.0:1788872821.229162:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da782 00000100:00080000:3.0:1788872821.229169:0:92023:0:(import.c:65:import_set_state_nolock()) ffff98a9fa733800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788872821.229177:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb5e8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788872821.229202:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9cb5ea800 for lustre-MDT0000 00000020:00080000:3.0:1788872821.229211:0:92023:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9ef256800): rc 0 00000020:00000080:3.0:1788872821.229213:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9ef256800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:3.0:1788872821.229232:0:92023:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb002c2023ae0 00000020:00000080:3.0:1788872821.229245:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef256800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788872821.229276:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9fa733800 for lustre-MDT0000 00000100:00080000:3.0:1788872821.229295:0:92023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788872821.229299:0:92023:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788872821.231545:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788872821.232282:0:92023:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788872821.232319:0:92023:0:(import.c:65:import_set_state_nolock()) ffff98a9ff638000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788872821.232467:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327760128:0@lo:39:umount.0 00000100:00080000:3.0:1788872821.232528:0:92023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788872821.232533:0:92023:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969453 gen 3 00000100:00100000:0.0:1788872821.232543:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872821.232629:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327760128 00000004:00080000:3.0:1788872821.232638:0:92023:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:0.0:1788872821.232638:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327760128 00000100:00100000:0.0:1788872821.232699:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00080000:3.0:1788872821.232709:0:92023:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788872821.232709:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327760128:12345-0@lo:39:umount.0 00000100:00080000:3.0:1788872821.232724:0:92023:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe95000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788872821.232737:0:92023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788872821.232740:0:92023:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 3 00000020:00000080:0.0:1788872821.232744:0:23717:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da7b3 00000004:00080000:3.0:1788872821.232752:0:92023:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00080000:0.0:1788872821.232754:0:23717:0:(import.c:65:import_set_state_nolock()) ffff98a9ff60d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788872821.232777:0:23717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411443 00000100:00080000:3.0:1788872821.232950:0:92023:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788872821.232962:0:92023:0:(import.c:65:import_set_state_nolock()) ffff98a8c6774000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788872821.233012:0:92023:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98a8c3408000) has no exports 00010000:00010000:3.0:1788872821.233054:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872821.233499:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3643:x1875765327760128:12345-0@lo:39:umount.0 Request processed in 790us (955us total) trans 77309411444 rc 0/0 00000100:00100000:0.0:1788872821.233509:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00100000:0.0:1788872821.233711:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327760256:0@lo:9:umount.0 00000100:00100000:0.0:1788872821.233743:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872821.233786:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327760384:0@lo:9:umount.0 00000100:00100000:0.0:1788872821.233810:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788872821.235582:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ff638000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788872821.235600:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327760128:0@lo:39:umount.0 00000100:00100000:0.0:1788872821.235644:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327760256 00000100:00100000:0.0:1788872821.235652:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327760256 00000100:00100000:0.0:1788872821.235728:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327760384 00000100:00100000:0.0:1788872821.235732:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327760384 00000100:00100000:0.0:1788872821.235762:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5980 00000100:00100000:0.0:1788872821.235773:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327760256:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788872821.235814:0:26191:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da7dd 00000100:00080000:0.0:1788872821.235822:0:26191:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5c000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788872821.235995:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872821.236000:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872821.236057:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5981 00000100:00100000:2.0:1788872821.236067:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327760384:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788872821.236082:0:26199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da7eb 00000001:00000004:0.0:1788872821.236084:0:26191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969453 00000100:00080000:2.0:1788872821.236097:0:26199:0:(import.c:65:import_set_state_nolock()) ffff98a9e99ae000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788872821.236126:0:26199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:0.0:1788872821.238094:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:3643:x1875765327760256:12345-0@lo:9:umount.0 Request processed in 2313us (4340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872821.238107:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5980 00010000:00010000:0.0:1788872821.238155:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872821.238162:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788872821.238800:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe95000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788872821.238818:0:3643:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:3.0:1788872821.238821:0:3643:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872821.238825:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327760256:0@lo:9:umount.0 00010000:00010000:0.0:1788872821.240644:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872821.241402:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+2:3643:x1875765327760384:12345-0@lo:9:umount.0 Request processed in 5328us (7582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872821.241429:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5981 00000020:00080000:0.0:1788872821.242825:0:92023:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98a8c3408000) has no exports 00000100:00080000:3.0:1788872821.243904:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c6774000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788872821.243971:0:3643:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:3.0:1788872821.249360:0:3643:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872821.249382:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327760384:0@lo:9:umount.0 00000020:00000080:1.0:1788872821.284247:0:20230:0:(genops.c:906:class_export_put()) final put ffff98a8c6798800/0804304d-5904-48ad-87f2-bcbc7642a62a 00000020:00000080:2.0:1788872821.285513:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c6798800/0804304d-5904-48ad-87f2-bcbc7642a62a for lustre-MDT0000 00000020:00000080:2.0:1788872821.285597:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c679f800 for lustre-MDT0000 00010000:00010000:2.0:1788872821.285609:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872821.285611:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872821.285614:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788872821.319162:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da797 00000020:00000080:0.0:1788872821.319191:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9c73c7800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788872821.319218:0:92023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788872821.319244:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c73c7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788872821.319305:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872821.319320:0:92023:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788872821.319324:0:92023:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98a9e999b380) has no exports 00000020:00000080:2.0:1788872821.319873:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da790 00000020:00000080:2.0:1788872821.319881:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9e99ac000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788872821.319943:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872821.319953:0:92023:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788872821.319957:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9e99a8800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788872821.319959:0:92023:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788872821.319967:0:92023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788872821.320179:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ac000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788872821.320923:0:92023:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a8c5089ae0 - data ffff98a9e90acca8/ffff98a9fa8a8400 00000020:01000000:2.0:1788872821.321061:0:92023:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9faa35f60 - data ffff98a9c6cf6948/ffff98a8ca10f000 00000100:00080000:1.0:1788872821.381169:0:92023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788872821.381177:0:92023:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788872821.381192:0:92023:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98a8c38b6a00 x1875765327760128/t77309411444(77309411444) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872831 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872821.381218:0:92023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788872821.383193:0:92023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788872821.383201:0:92023:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969453 gen 4 00000004:00080000:1.0:1788872821.383227:0:92023:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872821.383230:0:92023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788872821.384957:0:91020:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788872821.384965:0:91020:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:3.0:1788872821.384978:0:91020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:1.0:1788872821.385980:0:92023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788872821.385986:0:92023:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 4 00000004:00080000:1.0:1788872821.386050:0:92023:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872821.386053:0:92023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788872821.387801:0:91022:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788872821.387808:0:91022:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:2.0:1788872821.387819:0:91022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:1.0:1788872821.389522:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da743 00000020:00000080:1.0:1788872821.389533:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a8c37f7000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788872821.390048:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c37f7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788872821.390441:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da758 00000020:00000080:1.0:1788872821.390460:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9ef251000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788872821.390509:0:92023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788872821.390515:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872821.390527:0:92023:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788872821.390532:0:92023:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff98a8c340b380) has no exports 00000004:01000000:1.0:1788872821.390713:0:92023:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788872821.390722:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da7e4 00000020:00000080:1.0:1788872821.390727:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9e99ab800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872821.391408:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef251000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788872821.391509:0:92023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788872821.391515:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872821.391525:0:92023:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788872821.391528:0:92023:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff98a9e99999c0) has no exports 00000020:00000080:1.0:1788872821.391535:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da7d6 00000020:00000080:1.0:1788872821.391540:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9ff63b000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788872821.391920:0:92023:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788872821.391925:0:92023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788872821.391929:0:92023:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 5 00000004:00080000:1.0:1788872821.391937:0:92023:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872821.391940:0:92023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788872821.391971:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872821.391979:0:92023:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872821.391985:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da7c8 00000020:00000080:1.0:1788872821.391990:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9df8f2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788872821.391994:0:92023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788872821.391997:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872821.392001:0:92023:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788872821.392004:0:92023:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff98a9f6714d40) has no exports 00000020:00000080:1.0:1788872821.392008:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da7c1 00000020:00000080:1.0:1788872821.392011:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9cb582800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788872821.392319:0:92023:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788872821.392323:0:92023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788872821.392325:0:92023:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969453 gen 5 00000004:00080000:1.0:1788872821.392338:0:92023:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872821.392340:0:92023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788872821.392363:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872821.392369:0:92023:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788872821.392381:0:92023:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788872821.392385:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da7ac 00000020:00000080:1.0:1788872821.392389:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9ff63d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788872821.392393:0:92023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788872821.392396:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872821.392401:0:92023:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788872821.392403:0:92023:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff98a9f6713380) has no exports 00000020:00000080:1.0:1788872821.392406:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da7a5 00000020:00000080:1.0:1788872821.392409:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9ff63e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788872821.395288:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ab800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788872821.395307:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff63b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788872821.395314:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c6774000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788872821.395324:0:82775:0:(genops.c:906:class_export_put()) final put ffff98a9e98d3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872821.395327:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e98d3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788872821.395334:0:82775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872821.395436:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9df8f2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788872821.395442:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb582800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788872821.395446:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9dfe95000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788872821.395450:0:82775:0:(genops.c:906:class_export_put()) final put ffff98a9ff63a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872821.395452:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff63a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788872821.395455:0:82775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872821.395489:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff63d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788872821.395495:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff63e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788872821.413892:0:92023:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788872821.413902:0:92023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788872821.413906:0:92023:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788872821.413914:0:92023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788872821.414012:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872821.414029:0:92023:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872821.414065:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872821.414070:0:92023:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872821.414076:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a8c37f2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872821.414081:0:92023:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c37f2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788872821.414090:0:92023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872821.414204:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da75f 00000020:00000080:1.0:1788872821.414211:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9ef253800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788872821.414701:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ff638000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788872821.414712:0:82775:0:(genops.c:906:class_export_put()) final put ffff98a9ff63d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872821.414714:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff63d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788872821.414723:0:82775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788872821.414980:0:92023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788872821.414986:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872821.414994:0:92023:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788872821.414999:0:92023:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff98a8c1cf8000) has no exports 00000020:00000080:1.0:1788872821.415022:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872821.415027:0:92023:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788872821.415044:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da766 00000020:00000080:1.0:1788872821.415050:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9ef254000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788872821.415057:0:92023:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a8c394c000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788872821.415061:0:92023:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a8c394c000 3 00000020:01000004:1.0:1788872821.415064:0:92023:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a8c394c000 from lustre-MDT0000 00000020:00000080:1.0:1788872821.415082:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872821.415087:0:92023:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788872821.415090:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a8c37f1800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788872821.415092:0:92023:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c37f1800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788872821.415100:0:92023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788872821.415139:0:92023:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788872821.415143:0:92023:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788872821.415147:0:92023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788872821.415149:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872821.415152:0:92023:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788872821.415160:0:92023:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98a9c45ca800 c67645b7-2296-4087-92b1-886500c47477 192.168.204.39@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872821.415167:0:92023:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98a9ff60b800 f2e885a0-f180-4b85-9f87-6a01e20afd1a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872821.415171:0:92023:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff98a9fa794d40) has exports, disconnecting them 00000020:00080000:1.0:1788872821.415175:0:92023:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.39@tcp (ffff98a9c45ca800), last request at 1788872814 00000020:00000080:1.0:1788872821.415191:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dac52 00000020:00010000:1.0:1788872821.415196:0:92023:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9c45ca800: total 2 00000100:00080000:1.0:1788872821.415200:0:92023:0:(import.c:65:import_set_state_nolock()) ffff98a9c45cb800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788872821.415224:0:92023:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a9c45ca800): rc 0 00000020:00080000:1.0:1788872821.415228:0:92023:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98a9ff60b800), last request at 1788872785 00000020:00000080:1.0:1788872821.415235:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da70b 00000020:00010000:1.0:1788872821.415238:0:92023:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9ff60b800: total 2 00000100:00080000:1.0:1788872821.415241:0:92023:0:(import.c:65:import_set_state_nolock()) ffff98a9ff609800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788872821.415256:0:92023:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9ff60b800): rc 0 00000020:00080000:1.0:1788872821.415260:0:92023:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff98a9fa794d40) has no exports 00000100:00100000:3.0:1788872821.415364:0:91011:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff98a8c76f0400:91011] 3 exiting: rc = 0 00000020:00000080:3.0:1788872821.415469:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef253800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788872821.415474:0:82775:0:(genops.c:906:class_export_put()) final put ffff98a9faa5c000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788872821.415476:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9faa5c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788872821.415479:0:82775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788872821.415519:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef254000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788872821.415587:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9c45ca800: total 0 00010000:00010000:2.0:1788872821.415635:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9c45ca800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1788872821.415671:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5c5a000/0xe4e6e89fb01dac67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb04e expref: 5 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.415688:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dac60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb01d expref: 4 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.415716:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01dac59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb016 expref: 3 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.415727:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d2200/0xe4e6e89fb01dac6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb055 expref: 2 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.415734:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9c45ca800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1788872821.415756:0:6509:0:(genops.c:906:class_export_put()) final put ffff98a9c45ca800/c67645b7-2296-4087-92b1-886500c47477 00000020:00010000:2.0:1788872821.415768:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9ff60b800: total 1 00010000:00010000:2.0:1788872821.415786:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9ff60b800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788872821.415801:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c58ae400/0xe4e6e89fb01da893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da88c expref: 14 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.415811:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8cc3e7400/0xe4e6e89fb01da8f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da8ee expref: 13 pid: 91007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.415821:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5441c00/0xe4e6e89fb01da885 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da87e expref: 12 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.415831:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c58afc00/0xe4e6e89fb01da8a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da89a expref: 11 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.415854:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01da8af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da8a8 expref: 10 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.415995:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52af200/0xe4e6e89fb01da8bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da8b6 expref: 9 pid: 91008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.416011:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8cc3e6000/0xe4e6e89fb01da84d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da846 expref: 8 pid: 91011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.416030:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5440600/0xe4e6e89fb01da8cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da8c4 expref: 7 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.416041:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52ae000/0xe4e6e89fb01da85b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da854 expref: 6 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.416055:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8cc3e7a00/0xe4e6e89fb01da8e7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da8e0 expref: 5 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.416066:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9f5440400/0xe4e6e89fb01da877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da870 expref: 4 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.416077:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8cc3e6600/0xe4e6e89fb01da8d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da8d2 expref: 3 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.416090:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01da869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01da862 expref: 2 pid: 91012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872821.416099:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9ff60b800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788872821.416114:0:6509:0:(genops.c:906:class_export_put()) final put ffff98a9ff60b800/f2e885a0-f180-4b85-9f87-6a01e20afd1a 00010000:00010000:2.0:1788872821.416119:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872821.416121:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872821.416123:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872821.416157:0:91007:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98a8c3960e00:91007] 1 exiting: rc = 0 00000020:00000080:3.0:1788872821.416248:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c45ca800/c67645b7-2296-4087-92b1-886500c47477 for MGS 00000020:00000080:3.0:1788872821.416280:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff60b800/f2e885a0-f180-4b85-9f87-6a01e20afd1a for MGS 00000020:00000080:3.0:1788872821.416295:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c45cb800 for MGS 00000020:00000080:3.0:1788872821.416301:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ff609800 for MGS 00000100:00100000:1.0:1788872821.416446:0:91012:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff98a8c711ac00:91012] 4 exiting: rc = 0 00010000:00010000:1.0:1788872821.416511:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872821.418747:0:91008:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98a8c3960400:91008] 2 exiting: rc = 0 00000100:00100000:0.0:1788872821.418972:0:91005:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98a8c3961000:91005] 0 exiting: rc = 1 00000100:00100000:3.0:1788872821.419427:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419437:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419446:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419451:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419457:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419463:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419468:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419472:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419478:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419483:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419488:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419494:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419500:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419505:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419511:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419517:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419522:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419528:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419534:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419541:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419688:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419698:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419703:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419708:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419726:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419732:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419738:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419744:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419749:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419755:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419761:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419766:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419771:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419776:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419783:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419788:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419794:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419801:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419805:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419810:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419815:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419820:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419826:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419831:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419836:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419955:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419961:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419968:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419974:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419980:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419986:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419991:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.419996:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.420001:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.420006:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.420011:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.420017:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.420022:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.420028:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.420042:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.420048:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.420053:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.420058:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788872821.420063:0:92023:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788872821.422178:0:92023:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a8c50894e0 - data ffff98a9e9180438/ffff98a9df482c00 00000020:01000000:3.0:1788872821.422298:0:92023:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a8c65b7cc0 - data ffff98a9c6c6a6c0/ffff98a9e9bfa400 00000020:00000080:3.0:1788872821.422771:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da704 00000020:00000080:3.0:1788872821.422781:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a8c3948000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788872821.422796:0:92023:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a8c394c000 from MGS, refs=2 00000020:01000004:3.0:1788872821.422800:0:92023:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a8c394c000 2 00000020:01000004:3.0:1788872821.422804:0:92023:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a8c394c000 from MGS 00000020:00000080:3.0:1788872821.422824:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872821.422832:0:92023:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788872821.422834:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a8c2797800/MGS 00000020:00000080:3.0:1788872821.422837:0:92023:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c2797800/MGS for MGS 00000020:01000000:3.0:1788872821.422843:0:92023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788872821.422994:0:92023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788872821.422998:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872821.423007:0:92023:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788872821.423014:0:92023:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98a9efadb800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788872821.423020:0:92023:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff98a8c72e99c0) has exports, disconnecting them 00000020:00080000:3.0:1788872821.423024:0:92023:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98a9efadb800), last request at 1788872785 00000020:00000080:3.0:1788872821.423028:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da823 00000020:00080000:3.0:1788872821.423038:0:92023:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9efadb800): rc 0 00000020:00000080:3.0:1788872821.423042:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a9efadb800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788872821.423807:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c3948000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788872821.423818:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9efadb800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788872821.424604:0:92023:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788872821.424609:0:92023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788872821.424624:0:92023:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788872821.424630:0:92023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788872821.424751:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872821.424763:0:92023:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788872821.424769:0:92023:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a8c394c000 1 00000020:00000080:2.0:1788872821.424774:0:92023:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01da6f6 00000020:00000080:2.0:1788872821.424782:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a8c2796800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788872821.424787:0:92023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788872821.424791:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872821.424795:0:92023:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788872821.424799:0:92023:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff98a9f67119c0) has no exports 00000020:00000080:1.0:1788872821.429747:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c9892800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788872821.429766:0:86506:0:(genops.c:906:class_export_put()) final put ffff98a9e99ad800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788872821.429770:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ad800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788872821.429779:0:86506:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788872821.429948:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c2796800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788872821.491000:0:92023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872821.491015:0:92023:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788872821.491021:0:92023:0:(genops.c:906:class_export_put()) final put ffff98a8c394b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788872821.491026:0:92023:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c394b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788872821.491039:0:92023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788872821.491169:0:92023:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98a8c3949000 00000020:02000400:2.0:1788872821.491232:0:92023:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788872821.945107:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327760512:0@lo:400:kworker.0 00000400:00000100:2.0:1788872821.945170:0:3646:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327760512 offset 0 length 224: 4 00000100:00100000:2.0:1788872821.945217:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327761024:0@lo:400:kworker.0 00000100:00100000:2.0:1788872821.945253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.945277:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327761536:0@lo:400:kworker.0 00000100:00100000:2.0:1788872821.945300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.945323:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788872821.945330:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327760640:0@lo:400:kworker.0 00000100:00100000:2.0:1788872821.945354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.945369:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327761152:0@lo:400:kworker.0 00000100:00100000:2.0:1788872821.945426:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.945459:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327760768:0@lo:400:kworker.0 00000100:00100000:2.0:1788872821.945481:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.945496:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327761280:0@lo:400:kworker.0 00000100:00100000:2.0:1788872821.945523:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.945541:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788872821.945546:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327760896:0@lo:400:kworker.0 00000100:00100000:2.0:1788872821.945587:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.945615:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327761408:0@lo:400:kworker.0 00000100:00100000:2.0:1788872821.945638:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872821.945670:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327761024 00000100:00100000:2.0:1788872821.945679:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327761024 00000100:00100000:2.0:1788872821.945733:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327761536 00000100:00100000:2.0:1788872821.945737:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327761536 00000100:00100000:2.0:1788872821.945748:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327760640 00000100:00100000:2.0:1788872821.945750:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327760640 00000100:00100000:2.0:1788872821.945756:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327760768 00000100:00100000:2.0:1788872821.945758:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327760768 00000100:00100000:2.0:1788872821.945773:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327760896 00000100:00100000:2.0:1788872821.945775:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327760896 00000100:00100000:2.0:1788872821.945786:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:2.0:1788872821.945795:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327761024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872821.945818:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1788872821.945825:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327760768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872821.945845:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327761024:12345-0@lo:400:kworker.0 Request processed in 52us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872821.945852:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:3.0:1788872821.945860:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327760768:12345-0@lo:400:kworker.0 Request processed in 36us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872821.945870:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1788872821.945874:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875765327761536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872821.945875:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000020:00080000:2.0:1788872821.945888:0:66193:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788872821.945908:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1788872821.945912:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875765327760640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872821.945914:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875765327761536:12345-0@lo:400:kworker.0 Request processed in 38us (613us total) trans 0 rc -107/-107 00000020:00080000:3.0:1788872821.945918:0:66192:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788872821.945920:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1788872821.945931:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1788872821.945934:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875765327760896:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788872821.945939:0:66193:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788872821.945940:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875765327760640:12345-0@lo:400:kworker.0 Request processed in 27us (586us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788872821.945946:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1788872821.945957:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875765327760896:12345-0@lo:400:kworker.0 Request processed in 20us (369us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788872821.945962:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00080000:3.0:1788872821.945968:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872821.945978:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327761152 00000100:00100000:2.0:1788872821.945981:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327761152 00000100:00100000:3.0:1788872821.946017:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327761280 00000100:00100000:3.0:1788872821.946021:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327761280 00000100:00100000:2.0:1788872821.946459:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:2.0:1788872821.946465:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1875765327761152:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788872821.946471:0:8447:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788872821.946503:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1875765327761152:12345-0@lo:400:kworker.0 Request processed in 37us (1077us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788872821.946509:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00080000:2.0:1788872821.946546:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788872821.946579:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788872821.946583:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788872821.946588:0:3644:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872821.946593:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3728 00000100:00080000:2.0:1788872821.946598:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872821.946622:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c49f8700 x1875765327761664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872821.946655:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327760896:0@lo:400:kworker.0 00000100:00100000:2.0:1788872821.946673:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327760768:0@lo:400:kworker.0 00000100:00080000:2.0:1788872821.946706:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788872821.946709:0:3646:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788872821.946712:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788872821.946715:0:3646:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872821.946718:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3728 00000100:00080000:2.0:1788872821.946722:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872821.946736:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c49fb480 x1875765327761792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872821.946747:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327760640:0@lo:400:kworker.0 00000100:00080000:2.0:1788872821.946758:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788872821.946760:0:3646:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788872821.946763:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788872821.946767:0:3646:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872821.946770:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3728 00000100:00080000:2.0:1788872821.946774:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872821.946785:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c49fad80 x1875765327761920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872821.946793:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327761152:0@lo:400:kworker.0 00000100:00100000:2.0:1788872821.946806:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327761024:0@lo:400:kworker.0 00000100:00080000:2.0:1788872821.946823:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788872821.946826:0:3646:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788872821.946828:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788872821.946831:0:3646:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872821.946834:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3728 00000100:00080000:2.0:1788872821.946837:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872821.946849:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c49f9c00 x1875765327762048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872821.946859:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327761536:0@lo:400:kworker.0 00000100:00100000:3.0:1788872821.947272:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327761408 00000100:00100000:3.0:1788872821.947280:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327761408 00000100:00100000:3.0:1788872821.947367:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:3.0:1788872821.947376:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327761280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872821.947439:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327761280:12345-0@lo:400:kworker.0 Request processed in 64us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872821.947446:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00100000:3.0:1788872821.947460:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652 00000100:00100000:3.0:1788872821.947467:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327761408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872821.947687:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327761408:12345-0@lo:400:kworker.0 Request processed in 220us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872821.947693:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652 00000100:00100000:0.0:1788872821.947697:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327761664:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788872821.947713:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872821.947717:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872821.950838:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327761408:0@lo:400:kworker.0 00000100:00100000:3.0:1788872821.951020:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327761280:0@lo:400:kworker.0 00000100:00100000:3.0:1788872821.951234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872821.951297:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327761792:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788872821.951327:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872821.951356:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327761920:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788872821.951380:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872821.951396:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327762048:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788872821.951429:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872821.951460:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327761664 00000100:00100000:3.0:1788872821.951466:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327761664 00000100:00100000:3.0:1788872821.951498:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327761792 00000100:00100000:3.0:1788872821.951501:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327761792 00000100:00100000:3.0:1788872821.951515:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327762048 00000100:00100000:3.0:1788872821.951517:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327762048 00000100:00100000:3.0:1788872821.951533:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:3.0:1788872821.951539:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327761664:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788872821.951586:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872821.951623:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327761664:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 82us (389us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872821.951629:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:3.0:1788872821.951644:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:3.0:1788872821.951648:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327761792:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788872821.951658:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872821.951682:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327761792:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 31us (354us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872821.951687:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:3.0:1788872821.951699:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:3.0:1788872821.951703:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327762048:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788872821.951720:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872821.951744:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327762048:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 39us (314us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872821.951750:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00080000:3.0:1788872821.951785:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872821.951790:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872821.951793:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327762048:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788872821.951814:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872821.951817:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872821.951820:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327761664:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788872821.951826:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872821.951829:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872821.951831:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327761792:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788872821.952030:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327761920 00000100:00100000:0.0:1788872821.952035:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327761920 00000100:00100000:0.0:1788872821.952074:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:0.0:1788872821.952079:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327761920:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788872821.952090:0:23717:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872821.952155:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327761920:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 74us (772us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872821.952161:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00000100:00080000:3.0:1788872821.952343:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872821.952348:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872821.952351:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327761920:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1788872822.078125:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872823.097187:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872823.482976:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872823.483005:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327762176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872823.483092:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872823.484054:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327762176 00000100:00100000:2.0:1788872823.484065:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327762176 00000100:00100000:2.0:1788872823.484269:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:2.0:1788872823.484283:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327762176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872823.484321:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872823.484405:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327762176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872823.484413:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00080000:2.0:1788872823.484453:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872823.484577:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327762176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872823.484850:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327762304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872823.484893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872823.485244:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327762304 00000100:00100000:1.0:1788872823.485249:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327762304 00000100:00100000:1.0:1788872823.485334:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138 00000100:00100000:1.0:1788872823.485341:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efcca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327762304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872823.485363:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872823.485425:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efcca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327762304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872823.485434:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138 00000100:00100000:3.0:1788872823.489062:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327762304:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788872823.492077:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788872824.121346:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788872825.020876:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788872825.020893:0:75620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411444 is committed 00000020:00000080:3.0:1788872825.020899:0:75620:0:(genops.c:906:class_export_put()) final put ffff98a9ff60a800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:3.0:1788872825.020933:0:75620:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444090 batchid updated 00000020:00080000:0.0:1788872825.021050:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000004:00080000:0.0:1788872825.021115:0:75640:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98a9c5d10840 with version 10 00000020:00080000:0.0:1788872825.021138:0:75640:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444090 cancel update log [0x2000090a1:0x2:0x0].2: rc = 0 00000020:00080000:0.0:1788872825.021213:0:75640:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444090 cancel update log [0x2400088d0:0x2:0x0].2: rc = 0 00000020:00080000:0.0:1788872825.021222:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000020:00000080:2.0:1788872825.021251:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff60a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788872825.021337:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ff60d000 for lustre-MDT0001 00000004:00080000:3.0:1788872825.021704:0:75625:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98a8c5c4f240 version 10 rpc_version 10 00000020:00100000:3.0:1788872825.021739:0:75625:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788872825.021752:0:75625:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98a8c38b7480 x1875765327762560/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872825.021776:0:75625:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff98a8c38b7480 x1875765327762560/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872825.021785:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788872825.145374:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788872825.610536:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311197568 offset 0 length 224: 4 00000100:00100000:3.0:1788872825.610634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872825.610687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872825.610723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872825.610757:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872825.610787:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311197824 00000100:00100000:3.0:1788872825.610797:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311197824 00000100:00100000:3.0:1788872825.610874:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311197696 00000100:00100000:3.0:1788872825.610878:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311197696 00000100:00100000:3.0:1788872825.610896:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1338 00000100:00100000:3.0:1788872825.610907:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311197824:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872825.610977:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311197824:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 72us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872825.610985:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1338 00000100:00100000:3.0:1788872825.611001:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1326 00000100:00100000:3.0:1788872825.611006:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2405:x1875765311197696:12345-192.168.204.39@tcp:400:kworker.0 00000020:00080000:3.0:1788872825.611013:0:83669:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.39@tcp 00000100:00100000:3.0:1788872825.611035:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2405:x1875765311197696:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (311us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788872825.611059:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1326 00000100:00100000:1.0:1788872825.611947:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311198080 00000100:00100000:1.0:1788872825.611956:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311198080 00000100:00100000:2.0:1788872825.612007:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311197952 00000100:00100000:1.0:1788872825.612014:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2653 00000100:00100000:2.0:1788872825.612016:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311197952 00000100:00100000:1.0:1788872825.612025:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311198080:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872825.612066:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2654 00000100:00100000:1.0:1788872825.612075:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311198080:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 52us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872825.612078:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311197952:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872825.612113:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311197952:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 39us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872825.612121:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2654 00000100:00080000:2.0:1788872825.612157:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872825.612161:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872825.612164:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872825.612712:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2653 00000100:00100000:3.0:1788872825.622724:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872825.623380:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311198208 00000100:00100000:0.0:1788872825.623394:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311198208 00000100:00100000:0.0:1788872825.623464:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1327 00000100:00100000:0.0:1788872825.623475:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875765311198208:12345-192.168.204.39@tcp:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788872825.623507:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872825.623658:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875765311198208:12345-192.168.204.39@tcp:38:ptlrpcd_00_01.0 Request processed in 182us (945us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872825.623666:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1327 00000100:00100000:3.0:1788872826.041781:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788872826.168974:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872827.064664:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00000100:00080000:0.0:1788872827.069004:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872827.069015:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872827.069018:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872827.069027:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3759 00000100:00080000:0.0:1788872827.069046:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788872827.069055:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872827.069081:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3b49f80 x1875765327762816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872827.069114:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872827.069118:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872827.069119:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872827.069123:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3759 00000100:00080000:0.0:1788872827.069126:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788872827.069129:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872827.069141:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3b4ad80 x1875765327763072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872827.069157:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872827.069160:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872827.069162:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872827.069165:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3759 00000100:00080000:0.0:1788872827.069168:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788872827.069172:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872827.069184:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3b49880 x1875765327763328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872827.069207:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872827.069210:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872827.069212:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872827.069215:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3759 00000100:00080000:0.0:1788872827.069235:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788872827.069239:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872827.069255:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3b48380 x1875765327763712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872827.069272:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327762688:0@lo:400:kworker.0 00000100:00100000:0.0:1788872827.069301:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327763456:0@lo:400:kworker.0 00000400:00000100:3.0:1788872827.069339:0:3645:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327762688 offset 0 length 224: 4 00000100:00100000:2.0:1788872827.069416:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327762944:0@lo:400:kworker.0 00000100:00100000:0.0:1788872827.069480:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872827.069602:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327763456 00000100:00100000:0.0:1788872827.069611:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327763456 00000100:00100000:0.0:1788872827.069685:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1788872827.069695:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327763456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872827.069775:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327763456:12345-0@lo:400:kworker.0 Request processed in 81us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872827.069782:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1788872827.069837:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327763456:0@lo:400:kworker.0 00000100:00080000:0.0:1788872827.070013:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872827.070032:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327762816:0@lo:38:kworker.0 00000100:00100000:0.0:1788872827.070063:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872827.070086:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327763072:0@lo:38:kworker.0 00000100:00100000:0.0:1788872827.070106:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872827.070123:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327763328:0@lo:38:kworker.0 00000100:00100000:0.0:1788872827.070144:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872827.070166:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327763712:0@lo:38:kworker.0 00000100:00100000:0.0:1788872827.070187:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872827.070227:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327762816 00000100:00100000:0.0:1788872827.070231:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327762816 00000100:00100000:0.0:1788872827.070262:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327763072 00000100:00100000:0.0:1788872827.070266:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327763072 00000100:00100000:0.0:1788872827.070281:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327763712 00000100:00100000:0.0:1788872827.070284:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327763712 00000100:00100000:0.0:1788872827.070297:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1788872827.070313:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327762816:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872827.070333:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872827.070371:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327762816:12345-0@lo:38:kworker.0 Request processed in 68us (307us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872827.070378:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00080000:0.0:1788872827.070440:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872827.070445:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872827.070447:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327762816:0@lo:38:kworker.0 00000100:00100000:0.0:1788872827.070466:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1788872827.070469:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327763072:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872827.070478:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872827.070527:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327763072:12345-0@lo:38:kworker.0 Request processed in 56us (420us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872827.070533:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1788872827.070544:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1788872827.070577:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327763712:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872827.070587:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872827.070612:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327763712:12345-0@lo:38:kworker.0 Request processed in 63us (424us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872827.070617:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00080000:0.0:1788872827.070638:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872827.070647:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872827.070650:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327763072:0@lo:38:kworker.0 00000100:00080000:0.0:1788872827.070660:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872827.070663:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872827.070666:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327763712:0@lo:38:kworker.0 00000100:00100000:0.0:1788872827.070748:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327763328 00000100:00100000:0.0:1788872827.070752:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327763328 00000100:00100000:0.0:1788872827.070772:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:0.0:1788872827.070776:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327763328:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872827.070785:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872827.070816:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327763328:12345-0@lo:38:kworker.0 Request processed in 39us (671us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872827.070821:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00080000:0.0:1788872827.070845:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872827.070849:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872827.070851:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327763328:0@lo:38:kworker.0 00000100:00100000:1.0:1788872827.075078:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327763200:0@lo:400:kworker.0 00000100:00100000:1.0:1788872827.075170:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872827.075600:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327763200 00000100:00100000:0.0:1788872827.075609:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327763200 00000100:00100000:0.0:1788872827.076377:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1788872827.076389:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327763200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872827.076492:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327763200:12345-0@lo:400:kworker.0 Request processed in 104us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872827.076500:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00080000:0.0:1788872827.076524:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872827.077117:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327763200:0@lo:400:kworker.0 00000001:00100000:1.0:1788872827.077252:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872827.077271:0:9516:0:(genops.c:906:class_export_put()) final put ffff98a9e99ab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788872827.077364:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ab000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788872827.077426:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e99ae000 for lustre-OST0001 00000001:00100000:1.0:1788872827.077909:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872827.077914:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a9dfe94000/lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788872827.077931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872827.077943:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327763584:0@lo:400:kworker.0 00000100:00100000:1.0:1788872827.077967:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327762944 00000100:00100000:1.0:1788872827.077975:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327762944 00000100:00100000:3.0:1788872827.077986:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872827.078027:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327763584 00000100:00100000:3.0:1788872827.078032:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327763584 00000100:00100000:1.0:1788872827.078042:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1788872827.078054:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327762944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872827.078070:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:3.0:1788872827.078080:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327763584:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788872827.078123:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872827.078128:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872827.078133:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327762944:12345-0@lo:400:kworker.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872827.078142:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:2.0:1788872827.078153:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327762944:0@lo:400:kworker.0 00000100:00100000:2.0:1788872827.078198:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327763584:0@lo:400:kworker.0 00000020:00000080:0.0:1788872827.078245:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9dfe94000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788872827.078278:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c1f5c000 for lustre-OST0000 00000100:00100000:3.0:1788872827.078398:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327763584:12345-0@lo:400:kworker.0 Request processed in 56us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872827.078408:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00010000:00010000:2.0:1788872827.192825:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872828.088679:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788872828.216794:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872828.600807:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327763968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872828.600873:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327763840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872828.600894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872828.600932:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872828.600964:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327763968 00000100:00100000:2.0:1788872828.600972:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327763968 00000100:00100000:2.0:1788872828.601034:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327763840 00000100:00100000:2.0:1788872828.601037:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327763840 00000100:00100000:2.0:1788872828.601078:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1788872828.601218:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327763968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872828.601247:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872828.601301:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327763968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872828.603187:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:3.0:1788872828.603297:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327763840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872828.603336:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872828.603422:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327763840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 150us (2489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872828.603431:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:3.0:1788872828.603506:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327763968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872828.603669:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327763840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872828.614083:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:3.0:1788872829.112680:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788872829.240795:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872830.136862:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788872830.264726:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788872830.730410:0:3639:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311198336 offset 0 length 224: 4 00000100:00100000:3.0:1788872830.733317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872830.733371:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872830.733494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872830.733531:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872830.733620:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311198848 00000100:00100000:2.0:1788872830.733633:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311198720 00000100:00100000:3.0:1788872830.733636:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311198848 00000100:00100000:2.0:1788872830.733653:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311198720 00000100:00100000:1.0:1788872830.737358:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311198464 00000100:00100000:1.0:1788872830.737380:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311198464 00000100:00100000:1.0:1788872830.737458:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311198592 00000100:00100000:1.0:1788872830.737462:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311198592 00000100:00100000:1.0:1788872830.737531:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1341 00000100:00100000:1.0:1788872830.737546:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2407:x1875765311198592:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872830.738117:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2407:x1875765311198592:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 572us (4742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872830.738127:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1341 00000100:00100000:1.0:1788872830.738153:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1331 00000100:00100000:1.0:1788872830.738158:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311198464:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:1.0:1788872830.738187:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872830.738221:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311198464:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 61us (4921us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872830.738228:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1331 00000100:00080000:0.0:1788872830.738584:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872830.738591:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872830.738594:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872830.744183:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2657 00000100:00100000:2.0:1788872830.744216:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311198848:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872830.744327:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2658 00000100:00100000:0.0:1788872830.744353:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311198720:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872830.744478:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311198720:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 136us (10944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872830.744486:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2658 00000100:00100000:2.0:1788872830.744540:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311198848:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 340us (11043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872830.744574:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2657 00000100:00100000:2.0:1788872831.165458:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788872831.288836:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872832.184778:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00000100:00080000:1.0:1788872832.185852:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872832.185859:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872832.185864:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872832.185874:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3764 00000100:00080000:1.0:1788872832.185881:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788872832.185890:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872832.185919:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8ca10b480 x1875765327764224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872832.185947:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872832.185951:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872832.185953:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872832.185967:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3764 00000100:00080000:1.0:1788872832.185970:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788872832.185973:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872832.185985:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8ca10b100 x1875765327764480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872832.186020:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872832.186023:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872832.186025:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872832.186029:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3764 00000100:00080000:1.0:1788872832.186032:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788872832.186037:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872832.186050:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3851c00 x1875765327764736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872832.186074:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872832.186096:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872832.186098:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872832.186102:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3764 00000100:00080000:1.0:1788872832.186104:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788872832.186108:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872832.186122:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9c12ac380 x1875765327765120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872832.186423:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327764608:0@lo:400:kworker.0 00000100:00100000:3.0:1788872832.186589:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327764864:0@lo:400:kworker.0 00000100:00100000:3.0:1788872832.186673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872832.187024:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327764096:0@lo:400:kworker.0 00000100:00100000:2.0:1788872832.187056:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327764352:0@lo:400:kworker.0 00000400:00000100:0.0:1788872832.187058:0:3644:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327764096 offset 0 length 224: 4 00000100:00100000:0.0:1788872832.187180:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327764992:0@lo:400:kworker.0 00000100:00100000:3.0:1788872832.194058:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327764224:0@lo:38:kworker.0 00000100:00100000:2.0:1788872832.194292:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872832.194396:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327764352 00000100:00100000:2.0:1788872832.194407:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327764352 00000100:00100000:2.0:1788872832.194492:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:2.0:1788872832.194506:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327764352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872832.194617:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327764352:12345-0@lo:400:kworker.0 Request processed in 116us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872832.194626:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1788872832.197759:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872832.197875:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327764608 00000100:00100000:1.0:1788872832.197887:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327764608 00000100:00080000:2.0:1788872832.198513:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872832.204747:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872832.204862:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327764864 00000100:00100000:0.0:1788872832.204875:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327764864 00000100:00100000:0.0:1788872832.204977:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327764992 00000100:00100000:0.0:1788872832.204981:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327764992 00000100:00100000:0.0:1788872832.205012:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:0.0:1788872832.205025:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327764864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872832.205126:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327764864:12345-0@lo:400:kworker.0 Request processed in 104us (18452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872832.205134:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:0.0:1788872832.205173:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:0.0:1788872832.205180:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327764992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872832.205232:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327764992:12345-0@lo:400:kworker.0 Request processed in 51us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872832.205240:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:0.0:1788872832.205303:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327764992:0@lo:400:kworker.0 00000100:00100000:3.0:1788872832.206063:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327764864:0@lo:400:kworker.0 00000100:00100000:3.0:1788872832.206114:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872832.206165:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327764480:0@lo:38:kworker.0 00000100:00100000:3.0:1788872832.206219:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872832.206243:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327764736:0@lo:38:kworker.0 00000100:00100000:3.0:1788872832.206276:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872832.206298:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327765120:0@lo:38:kworker.0 00000100:00100000:3.0:1788872832.206322:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872832.206619:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327764224 00000100:00100000:0.0:1788872832.206627:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327764224 00000100:00100000:0.0:1788872832.206660:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327764480 00000100:00100000:0.0:1788872832.206663:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327764480 00000100:00100000:0.0:1788872832.206676:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327765120 00000100:00100000:0.0:1788872832.206679:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327765120 00000100:00100000:0.0:1788872832.206692:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1788872832.206698:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327764224:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872832.206725:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872832.206801:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327764224:12345-0@lo:38:kworker.0 Request processed in 101us (686us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872832.206808:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1788872832.206823:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:0.0:1788872832.206827:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327764480:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872832.206836:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872832.206863:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327764480:12345-0@lo:38:kworker.0 Request processed in 35us (644us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872832.206869:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:0.0:1788872832.206879:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:0.0:1788872832.206883:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327765120:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872832.206908:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872832.206934:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327765120:12345-0@lo:38:kworker.0 Request processed in 50us (612us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872832.206940:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00080000:3.0:1788872832.207056:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872832.207063:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872832.207089:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872832.207095:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872832.207099:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327764224:0@lo:38:kworker.0 00000100:00080000:3.0:1788872832.207120:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872832.207124:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872832.207127:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327764480:0@lo:38:kworker.0 00000100:00080000:3.0:1788872832.207136:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872832.207140:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872832.207143:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327765120:0@lo:38:kworker.0 00000100:00100000:1.0:1788872832.211072:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1788872832.211111:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327764608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872832.211274:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327764608:12345-0@lo:400:kworker.0 Request processed in 185us (13530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872832.211282:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1788872832.211358:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327764608:0@lo:400:kworker.0 00000100:00100000:2.0:1788872832.221300:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327764352:0@lo:400:kworker.0 00000100:00100000:0.0:1788872832.222398:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327764736 00000100:00100000:0.0:1788872832.222412:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327764736 00000100:00100000:0.0:1788872832.222495:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:0.0:1788872832.222507:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327764736:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872832.222539:0:8446:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872832.222705:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327764736:12345-0@lo:38:kworker.0 Request processed in 198us (16427us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872832.222713:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00080000:3.0:1788872832.223741:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872832.223754:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872832.223761:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327764736:0@lo:38:kworker.0 00010000:00010000:2.0:1788872832.313165:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872833.213494:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788872833.337843:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872833.723377:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872833.723413:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327765248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872833.723519:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872833.723668:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327765248 00000100:00100000:3.0:1788872833.723680:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327765248 00000100:00100000:3.0:1788872833.723750:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:3.0:1788872833.723771:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327765248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872833.723812:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872833.723873:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327765248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872833.723881:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00100000:3.0:1788872833.723940:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327765248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872833.724705:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327765376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872833.724760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872833.724939:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327765376 00000100:00100000:0.0:1788872833.724948:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327765376 00000100:00100000:0.0:1788872833.724999:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:0.0:1788872833.725010:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327765376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872833.725042:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872833.725131:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327765376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872833.725138:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00100000:2.0:1788872833.725741:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327765376:0@lo:13:osp-pre-0-1.0 00000400:00000100:3.0:1788872833.802458:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311198976 offset 0 length 224: 4 00000100:00100000:3.0:1788872833.802535:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872833.802676:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872833.802790:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311199488 00000100:00100000:0.0:1788872833.802804:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311199488 00000100:00100000:2.0:1788872833.802850:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311199360 00000100:00100000:2.0:1788872833.802863:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311199360 00000100:00100000:0.0:1788872833.802905:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2661 00000100:00100000:0.0:1788872833.802919:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2404:x1875765311199488:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872833.802929:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2662 00000100:00100000:2.0:1788872833.802951:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2404:x1875765311199360:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872833.803027:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2404:x1875765311199488:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 110us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872833.803056:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2661 00000100:00080000:3.0:1788872833.803222:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872833.803228:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872833.805499:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2404:x1875765311199360:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 2537us (2799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872833.805520:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2662 00000100:00100000:3.0:1788872833.805787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872833.805917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872833.806020:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311199104 00000100:00100000:3.0:1788872833.806032:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311199104 00000100:00100000:3.0:1788872833.806072:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311199232 00000100:00100000:3.0:1788872833.806076:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311199232 00000100:00100000:2.0:1788872833.806111:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1335 00000100:00100000:2.0:1788872833.806123:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311199104:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:2.0:1788872833.807118:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872833.807244:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311199104:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 1117us (1624us total) trans 0 rc -19/-19 00000100:00080000:1.0:1788872833.809631:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872833.813007:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1344 00000100:00100000:3.0:1788872833.813037:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2403:x1875765311199232:12345-192.168.204.39@tcp:38:kworker.0 00010000:02000400:3.0:1788872833.813085:0:68674:0:(ldlm_lib.c:964:target_handle_reconnect()) lustre-MDT0001: Client 0804304d-5904-48ad-87f2-bcbc7642a62a (at 192.168.204.39@tcp) reconnecting 00000100:00100000:2.0:1788872833.822182:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1335 00010000:00080000:3.0:1788872833.828625:0:68674:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp t0 exp ffff98a8c6799800 cur 3770 last 1788872833 00000004:00100000:3.0:1788872833.828670:0:68674:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0001: cli 192.168.204.39@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1788872833.828705:0:68674:0:(import.c:65:import_set_state_nolock()) ffff98a8c679a800 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1788872833.828716:0:68674:0:(import.c:65:import_set_state_nolock()) ffff98a8c679a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872833.828922:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2403:x1875765311199232:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 15897us (23002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872833.829149:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1344 00000100:00100000:1.0:1788872833.845919:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872833.846809:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311196800 00000100:00100000:2.0:1788872833.846826:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311196800 00000100:00100000:2.0:1788872833.846915:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 14 00000100:00100000:2.0:1788872833.846929:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0804304d-5904-48ad-87f2-bcbc7642a62a+7:71107:x1875765311196800:12345-192.168.204.39@tcp:700:cp.0 00000100:00080000:2.0:1788872833.847033:0:66202:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff98a8c49fb100 x1875765327765504/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872833.847047:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:3.0:1788872834.236922:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788872834.366427:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872834.873707:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:3.0:1788872835.256811:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788872835.384865:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872835.896723:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872836.284134:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788872836.420294:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872836.928254:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872837.304647:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00000100:00080000:1.0:1788872837.304881:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872837.304895:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872837.304899:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872837.304907:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3769 00000100:00080000:1.0:1788872837.304914:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872837.304922:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872837.304946:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3851c00 x1875765327765760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872837.304989:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872837.304993:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872837.304995:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872837.304998:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3769 00000100:00080000:1.0:1788872837.305001:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872837.305005:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872837.305017:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9fa5f4380 x1875765327766016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872837.305032:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872837.305034:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872837.305036:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872837.305039:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3769 00000100:00080000:1.0:1788872837.305041:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872837.305044:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872837.305055:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9fa5f4a80 x1875765327766272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872837.305073:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872837.305088:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872837.305090:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872837.305093:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3769 00000100:00080000:1.0:1788872837.305095:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872837.305099:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872837.305126:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9df4c2d80 x1875765327766656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872837.305156:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327765888:0@lo:400:kworker.0 00000100:00100000:0.0:1788872837.305395:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327766400:0@lo:400:kworker.0 00000100:00100000:0.0:1788872837.305463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872837.305534:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788872837.305543:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327765632:0@lo:400:kworker.0 00000400:00000100:0.0:1788872837.305588:0:3646:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327765632 offset 0 length 224: 4 00000100:00100000:0.0:1788872837.305629:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327766528:0@lo:400:kworker.0 00000100:00100000:0.0:1788872837.305652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872837.305689:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327766400 00000100:00100000:0.0:1788872837.305697:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327766400 00000100:00100000:0.0:1788872837.305753:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327766528 00000100:00100000:0.0:1788872837.305756:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327766528 00000100:00100000:0.0:1788872837.305779:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:0.0:1788872837.305787:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327766400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872837.305844:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327766400:12345-0@lo:400:kworker.0 Request processed in 57us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872837.305852:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00100000:0.0:1788872837.305867:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664 00000100:00100000:0.0:1788872837.305873:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327766528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872837.305917:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327766528:12345-0@lo:400:kworker.0 Request processed in 44us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872837.305923:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664 00000100:00100000:0.0:1788872837.305976:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327766528:0@lo:400:kworker.0 00000100:00100000:0.0:1788872837.305987:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327766400:0@lo:400:kworker.0 00000100:00100000:1.0:1788872837.306538:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872837.306580:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872837.306710:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327766144:0@lo:400:kworker.0 00000100:00100000:1.0:1788872837.306745:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788872837.306840:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872837.306846:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872837.306860:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327765888 00000100:00100000:1.0:1788872837.306865:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327765888 00000100:00100000:3.0:1788872837.307011:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327765760:0@lo:38:kworker.0 00000100:00100000:3.0:1788872837.307047:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872837.307070:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327766016:0@lo:38:kworker.0 00000100:00100000:3.0:1788872837.307092:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872837.307121:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327766272:0@lo:38:kworker.0 00000100:00100000:3.0:1788872837.307146:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872837.307177:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327766656:0@lo:38:kworker.0 00000100:00100000:3.0:1788872837.308862:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872837.308996:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327766144 00000100:00100000:3.0:1788872837.309005:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327766144 00000100:00100000:3.0:1788872837.309059:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327765760 00000100:00100000:3.0:1788872837.309063:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327765760 00000100:00100000:3.0:1788872837.309073:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327766016 00000100:00100000:3.0:1788872837.309076:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327766016 00000100:00100000:3.0:1788872837.309082:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327766656 00000100:00100000:3.0:1788872837.309084:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327766656 00000100:00100000:3.0:1788872837.309097:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1788872837.309118:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327766144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872837.309184:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327766144:12345-0@lo:400:kworker.0 Request processed in 79us (2437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872837.309717:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1788872837.309728:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327765888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872837.309768:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327765888:12345-0@lo:400:kworker.0 Request processed in 44us (3233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872837.309774:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1788872837.309793:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:1.0:1788872837.309797:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327765760:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872837.309819:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872837.309856:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327765760:12345-0@lo:38:kworker.0 Request processed in 56us (2807us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872837.309876:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1788872837.310098:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1788872837.310115:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327766016:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872837.310127:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872837.310183:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327766016:12345-0@lo:38:kworker.0 Request processed in 79us (3090us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872837.310205:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1788872837.310220:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:0.0:1788872837.310225:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327766656:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872837.310234:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872837.310263:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327766656:12345-0@lo:38:kworker.0 Request processed in 37us (1408us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872837.310269:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:0.0:1788872837.310291:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327766272 00000100:00100000:0.0:1788872837.310296:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327766272 00000100:00100000:0.0:1788872837.310321:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:0.0:1788872837.310326:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327766272:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872837.310335:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872837.310368:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327766272:12345-0@lo:38:kworker.0 Request processed in 41us (3221us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872837.310374:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00100000:3.0:1788872837.310844:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00080000:1.0:1788872837.311302:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872837.311341:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872837.311347:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872837.311352:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327765760:0@lo:38:kworker.0 00000100:00080000:1.0:1788872837.311362:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872837.311366:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872837.311369:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327766016:0@lo:38:kworker.0 00000100:00080000:1.0:1788872837.311378:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872837.311381:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872837.311384:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327766272:0@lo:38:kworker.0 00000100:00080000:1.0:1788872837.311393:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872837.311396:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872837.311399:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327766656:0@lo:38:kworker.0 00000100:00100000:1.0:1788872837.311445:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327766144:0@lo:400:kworker.0 00000100:00100000:1.0:1788872837.311458:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327765888:0@lo:400:kworker.0 00010000:00010000:1.0:1788872837.432720:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872837.945340:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00000400:0.0:1788872838.328910:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788872821/real 1788872821] req@ffff98a9f5b34e00 x1875765327760512/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872837 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872838.328976:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff98a9f5b34e00 x1875765327760512/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872837 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872838.328987:0:3646:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788872838.328990:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788872838.328994:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.139@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788872838.328996:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788872838.329000:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9f5b34e00 x1875765327760512/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872837 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872838.329008:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a8c3b48000 x1875765327762688/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872843 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872838.329028:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a8ca10aa00 x1875765327764096/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872838.329040:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9c12ace00 x1875765327765632/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872853 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788872838.329049:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788872838.329052:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788872838.329053:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788872838.329059:0:3646:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1788872838.329092:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327765632:0@lo:400:kworker.0 00000100:00100000:0.0:1788872838.329098:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327760512:0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.329237:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327762688:0@lo:400:kworker.0 00000100:00080000:1.0:1788872838.329261:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872838.329266:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788872838.329268:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872838.329282:0:52416:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3722 00000100:00080000:1.0:1788872838.329292:0:52416:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872838.329331:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9df4c2d80 x1875765327766784/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872838.329357:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872838.329361:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872838.329362:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872838.329366:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3774 00000100:00080000:1.0:1788872838.329368:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872838.329372:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872838.329387:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3852680 x1875765327766912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872838.329408:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872838.329417:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872838.329419:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872838.329422:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3774 00000100:00080000:1.0:1788872838.329425:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872838.329427:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872838.329438:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9df430380 x1875765327767168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872838.329452:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872838.329454:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872838.329456:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872838.329458:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3774 00000100:00080000:1.0:1788872838.329460:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872838.329464:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872838.329481:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f09f5500 x1875765327767424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872838.329512:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872838.329515:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872838.329517:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872838.329520:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3774 00000100:00080000:1.0:1788872838.329522:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872838.329526:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872838.329535:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a0700 x1875765327767808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872838.329581:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327767680:0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.329641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872838.329846:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872838.329853:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f09f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327767552:0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.329877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872838.329907:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327767680 00000100:00100000:1.0:1788872838.329914:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327767680 00000100:00100000:1.0:1788872838.329969:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327767552 00000100:00100000:1.0:1788872838.329972:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327767552 00000100:00100000:1.0:1788872838.329994:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:1.0:1788872838.330003:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327767680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.330057:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327767680:12345-0@lo:400:kworker.0 Request processed in 54us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872838.330063:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:1.0:1788872838.330079:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:1.0:1788872838.330097:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327767552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.330133:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327767552:12345-0@lo:400:kworker.0 Request processed in 48us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872838.330139:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:1.0:1788872838.330169:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327767040:0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.330199:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872838.330224:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327764096:0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.330240:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872838.330245:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f09f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327767296:0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.330265:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872838.330294:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327767040 00000100:00100000:1.0:1788872838.330297:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327767040 00000100:00100000:1.0:1788872838.330324:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327767296 00000100:00100000:1.0:1788872838.330326:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327767296 00000100:00100000:1.0:1788872838.330344:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1788872838.330350:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327767040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.330383:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327767040:12345-0@lo:400:kworker.0 Request processed in 33us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872838.330388:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1788872838.330405:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1788872838.330410:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327767296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.330436:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327767296:12345-0@lo:400:kworker.0 Request processed in 26us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872838.330442:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1788872838.330499:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f09f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327767296:0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.330509:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327767040:0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.330573:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f09f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327767552:0@lo:400:kworker.0 00000100:00100000:1.0:1788872838.330585:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327767680:0@lo:400:kworker.0 00000100:00100000:3.0:1788872838.333318:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872838.333468:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327766784:0@lo:250:kworker.0 00000400:00000100:0.0:1788872838.333542:0:3643:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327766784 offset 0 length 520: 4 00000100:00100000:0.0:1788872838.333634:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327766912:0@lo:38:kworker.0 00000100:00100000:0.0:1788872838.333682:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872838.333723:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327767168:0@lo:38:kworker.0 00000100:00100000:0.0:1788872838.333743:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872838.333758:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f09f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327767424:0@lo:38:kworker.0 00000100:00100000:0.0:1788872838.333778:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872838.333798:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327767808:0@lo:38:kworker.0 00000100:00100000:0.0:1788872838.333815:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872838.333850:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327767424 00000100:00100000:0.0:1788872838.333860:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327767424 00000100:00100000:0.0:1788872838.333897:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:0.0:1788872838.333905:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327767424:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872838.333926:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872838.333974:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327767424:12345-0@lo:38:kworker.0 Request processed in 68us (194us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872838.333980:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00080000:0.0:1788872838.334015:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872838.334020:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872838.334023:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f09f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327767424:0@lo:38:kworker.0 00000100:00100000:3.0:1788872838.334220:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327766912 00000100:00100000:3.0:1788872838.334225:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327766912 00000100:00100000:3.0:1788872838.334253:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327767168 00000100:00100000:3.0:1788872838.334255:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327767168 00000100:00100000:3.0:1788872838.334265:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327767808 00000100:00100000:3.0:1788872838.334267:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327767808 00000100:00100000:3.0:1788872838.334278:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1788872838.334283:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327766912:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872838.334294:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872838.334326:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327766912:12345-0@lo:38:kworker.0 Request processed in 42us (645us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872838.334332:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1788872838.334342:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1788872838.334353:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327767168:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872838.334362:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872838.334382:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327767168:12345-0@lo:38:kworker.0 Request processed in 28us (637us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872838.334387:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1788872838.334396:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:3.0:1788872838.334399:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327767808:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872838.334406:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872838.334422:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327767808:12345-0@lo:38:kworker.0 Request processed in 21us (606us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872838.334427:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00080000:3.0:1788872838.334445:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872838.334449:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872838.334451:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327766912:0@lo:38:kworker.0 00000100:00080000:3.0:1788872838.334458:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872838.334461:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872838.334464:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327767168:0@lo:38:kworker.0 00000100:00080000:3.0:1788872838.334470:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872838.334473:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872838.334476:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327767808:0@lo:38:kworker.0 00010000:00010000:0.0:1788872838.457792:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872838.843295:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327767936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872838.843369:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872838.844188:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327767936 00000100:00100000:0.0:1788872838.844198:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327767936 00000100:00100000:0.0:1788872838.844251:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:0.0:1788872838.844261:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327767936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872838.844297:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872838.844364:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327767936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872838.844370:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:1.0:1788872838.844469:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327767936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872838.844488:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872838.844495:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327768064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872838.844522:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872838.846452:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327768064 00000100:00100000:0.0:1788872838.846465:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327768064 00000100:00100000:0.0:1788872838.846534:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:0.0:1788872838.846545:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327768064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872838.846597:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872838.846728:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327768064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 184us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872838.846736:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00100000:0.0:1788872838.847611:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327768064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872838.935406:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000400:00000100:2.0:1788872838.935446:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311199744 offset 0 length 224: 4 00000100:00100000:2.0:1788872838.935466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872838.935500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872838.935532:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872838.935606:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311200128 00000100:00100000:2.0:1788872838.935616:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311200128 00000100:00100000:2.0:1788872838.935672:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311200256 00000100:00100000:2.0:1788872838.935675:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311200256 00000100:00100000:2.0:1788872838.935702:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5982 00000100:00100000:2.0:1788872838.935716:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2403:x1875765311200128:12345-192.168.204.39@tcp:9:kworker.0 00000100:00100000:0.0:1788872838.935723:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5983 00000100:00100000:0.0:1788872838.935736:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2403:x1875765311200256:12345-192.168.204.39@tcp:9:kworker.0 00000020:00000080:2.0:1788872838.935752:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dac83 00000020:00000080:0.0:1788872838.935753:0:26193:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dac8a 00000100:00080000:2.0:1788872838.935763:0:8436:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0aa000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788872838.935764:0:26193:0:(import.c:65:import_set_state_nolock()) ffff98a8c679e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788872838.935813:0:26193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:0.0:1788872838.935963:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0804304d-5904-48ad-87f2-bcbc7642a62a+2:2403:x1875765311200256:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 228us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872838.935971:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5983 00000100:00100000:3.0:1788872838.938459:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311200000 00000100:00100000:3.0:1788872838.938478:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311200000 00000100:00100000:3.0:1788872838.938564:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311199872 00000100:00100000:3.0:1788872838.938568:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311199872 00000100:00100000:3.0:1788872838.938607:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1349 00000100:00100000:3.0:1788872838.938632:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2407:x1875765311200000:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872838.938704:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2407:x1875765311200000:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 74us (3307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872838.938711:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1349 00000100:00100000:3.0:1788872838.938729:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1342 00000100:00100000:3.0:1788872838.938733:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311199872:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:3.0:1788872838.938753:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872838.938780:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311199872:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 44us (3312us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872838.938787:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1342 00010000:00010000:0.0:1788872838.939107:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872838.941880:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788872838.944897:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872838.944909:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872838.944912:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1788872838.951083:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:3.0:1788872838.951283:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+2:2403:x1875765311200128:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 15564us (15774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872838.951295:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5982 00000100:00100000:3.0:1788872838.974061:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:2.0:1788872839.356739:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788872839.480715:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872839.865656:0:66201:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:2.0:1788872839.865677:0:66201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:2.0:1788872839.994661:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:3.0:1788872840.380791:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788872840.505515:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872841.027906:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872841.400921:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788872841.541672:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788872841.803128:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311200384 offset 0 length 520: 4 00000100:00100000:3.0:1788872841.803176:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872841.803220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872841.803293:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311200512 00000100:00100000:0.0:1788872841.803305:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311200512 00000100:00100000:0.0:1788872841.803355:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311200640 00000100:00100000:0.0:1788872841.803358:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311200640 00000100:00100000:0.0:1788872841.803410:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1350 00000100:00100000:0.0:1788872841.803423:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2405:x1875765311200640:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872841.803504:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2405:x1875765311200640:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 85us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872841.803521:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1350 00000100:00100000:0.0:1788872841.803540:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1343 00000100:00100000:0.0:1788872841.803545:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311200512:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:0.0:1788872841.803589:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872841.803630:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311200512:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 83us (453us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872841.803637:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1343 00000100:00080000:0.0:1788872841.803656:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:2.0:1788872841.881237:0:92454:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788872841.881243:0:92454:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788872841.881245:0:92454:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788872841.881362:0:92454:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98a9ff63e800 00000020:01000004:2.0:1788872841.881379:0:92454:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788872841.881396:0:92454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788872841.881411:0:92454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98a9fa7919c0) 00000020:00000080:2.0:1788872841.881429:0:92454:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788872841.977265:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788872841.980102:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.981591:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788872841.983114:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788872841.983475:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788872841.983681:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788872841.983959:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788872841.984177:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788872841.984380:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788872841.984611:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788872841.984946:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788872841.985195:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788872841.985432:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788872841.985654:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788872841.985974:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788872841.989106:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.989321:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.989527:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.989757:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.990106:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.990338:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.990538:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.990966:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.991206:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.991437:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.991735:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.992079:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.992302:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.992485:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.992894:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.993119:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.993326:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.993534:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.993779:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.994138:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.994338:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.994573:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.995166:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.995365:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.995587:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788872841.995991:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.996248:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788872841.996457:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788872841.996982:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788872841.997238:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788872841.997452:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788872841.997675:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788872841.998096:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788872841.998530:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788872841.998882:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788872841.999226:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788872841.999399:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788872841.999609:0:92454:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1788872842.000712:0:92454:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788872842.001217:0:92454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788872842.001229:0:92454:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788872842.001245:0:92454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01dad16 00000020:01000004:2.0:1788872842.001253:0:92454:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788872842.001267:0:92454:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788872842.001273:0:92454:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a9ff63e800 from MGS 00000020:01000004:2.0:1788872842.001278:0:92454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788872842.001291:0:92454:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98a9fa793380) 00000020:00000080:2.0:1788872842.001311:0:92454:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:2.0:1788872842.001399:0:92454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9ff63e800 from MGS, refs=2 00080000:01000000:2.0:1788872842.001405:0:92454:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788872842.001413:0:92454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01dad24 00010000:00010000:2.0:1788872842.001623:0:92454:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1788872842.007046:0:92454:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788872842.007947:0:92458:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788872842.007995:0:92454:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788872842.008044:0:92454:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788872842.008844:0:92454:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788872842.009123:0:92454:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788872842.009275:0:92454:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788872842.009282:0:92454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788872842.010511:0:92454:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788872842.010522:0:92454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788872842.010893:0:92454:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788872842.010901:0:92454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788872842.011406:0:92454:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788872842.011432:0:92454:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1788872842.011433:0:92454:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.139@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1788872842.011437:0:92454:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.139@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1788872842.011443:0:92454:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98a9e98d3800 already not connected (conn 68, was 0): CONNECTING 00000100:00100000:2.0:1788872842.011449:0:92454:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1788872842.042541:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872842.424714:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788872842.554627:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872843.064964:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872843.448692:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00000100:00080000:1.0:1788872843.449138:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872843.449144:0:52416:0:(pinger.c:247:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788872843.449147:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872843.449151:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872843.449154:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872843.449162:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3775 00000100:00080000:1.0:1788872843.449165:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872843.449172:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872843.449630:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a2a00 x1875765327768192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872843.449777:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872843.449781:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872843.449784:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872843.449787:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3775 00000100:00080000:1.0:1788872843.449790:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872843.449793:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872843.449806:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a1c00 x1875765327768448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872843.449819:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1788872843.449822:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872843.449824:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872843.449826:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872843.449829:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3775 00000100:00080000:1.0:1788872843.449831:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1788872843.449833:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327768576:0@lo:400:kworker.0 00000100:00080000:1.0:1788872843.449834:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872843.449844:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a2d80 x1875765327768704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872843.449873:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872843.449875:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872843.449877:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872843.449880:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3775 00000100:00080000:1.0:1788872843.449882:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872843.449885:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872843.449895:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a3480 x1875765327769088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872843.449909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872843.449925:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327768960:0@lo:400:kworker.0 00000100:00100000:2.0:1788872843.449941:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327768320:0@lo:400:kworker.0 00000100:00100000:1.0:1788872843.449957:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872843.449960:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872843.449980:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872843.449998:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327768832:0@lo:400:kworker.0 00000100:00100000:2.0:1788872843.450010:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327768576 00000100:00100000:2.0:1788872843.450021:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327768576 00000100:00100000:2.0:1788872843.450070:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1788872843.450079:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327768576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872843.450130:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327768576:12345-0@lo:400:kworker.0 Request processed in 52us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872843.450137:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1788872843.450152:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327768320 00000100:00100000:2.0:1788872843.450156:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327768320 00000100:00100000:2.0:1788872843.450177:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:2.0:1788872843.450182:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327768320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872843.450210:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327768320:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872843.450215:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:2.0:1788872843.450253:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327768576:0@lo:400:kworker.0 00000100:00100000:2.0:1788872843.450266:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327768320:0@lo:400:kworker.0 00000100:00080000:0.0:1788872843.450363:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872843.450394:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327768960 00000100:00100000:0.0:1788872843.450398:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327768960 00000100:00100000:0.0:1788872843.450442:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:0.0:1788872843.450449:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327768960:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788872843.450575:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872843.450769:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327768960:12345-0@lo:400:kworker.0 Request processed in 320us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872843.450777:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00100000:3.0:1788872843.450947:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327768192:0@lo:38:kworker.0 00000100:00100000:3.0:1788872843.450992:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872843.451023:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327768448:0@lo:38:kworker.0 00000100:00100000:3.0:1788872843.451046:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872843.451063:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327768704:0@lo:38:kworker.0 00000100:00100000:3.0:1788872843.451087:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872843.451105:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327769088:0@lo:38:kworker.0 00000100:00100000:3.0:1788872843.451123:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872843.451186:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327768192 00000100:00100000:3.0:1788872843.451191:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327768192 00000100:00100000:3.0:1788872843.451211:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327768448 00000100:00100000:3.0:1788872843.451214:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327768448 00000100:00100000:3.0:1788872843.451224:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327769088 00000100:00100000:1.0:1788872843.451224:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872843.451226:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327769088 00000100:00100000:3.0:1788872843.451238:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1788872843.451243:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327768192:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788872843.451257:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327768960:0@lo:400:kworker.0 00010000:00020000:3.0:1788872843.451263:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872843.451282:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327768832 00000100:00100000:1.0:1788872843.451285:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327768832 00000100:00100000:3.0:1788872843.451297:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327768192:12345-0@lo:38:kworker.0 Request processed in 52us (313us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872843.451303:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1788872843.451315:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1788872843.451315:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00100000:3.0:1788872843.451319:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327768448:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788872843.451321:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327768832:12345-0@lo:400:kworker.0 00010000:00020000:3.0:1788872843.451329:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872843.451349:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327768448:12345-0@lo:38:kworker.0 Request processed in 28us (303us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872843.451351:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327768832:12345-0@lo:400:kworker.0 Request processed in 31us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872843.451356:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1788872843.451356:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00100000:3.0:1788872843.451366:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00080000:1.0:1788872843.451368:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872843.451370:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327769088:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872843.451380:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872843.451384:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327768832:0@lo:400:kworker.0 00000100:00100000:3.0:1788872843.451403:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327769088:12345-0@lo:38:kworker.0 Request processed in 31us (278us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872843.451408:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1788872843.451412:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327768704 00000100:00100000:1.0:1788872843.451416:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327768704 00000100:00080000:3.0:1788872843.451429:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788872843.451432:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00080000:3.0:1788872843.451434:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872843.451436:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327768704:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788872843.451437:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327768192:0@lo:38:kworker.0 00010000:00020000:1.0:1788872843.451446:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788872843.451453:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872843.451456:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872843.451459:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327768448:0@lo:38:kworker.0 00000100:00080000:3.0:1788872843.451466:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872843.451469:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872843.451469:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327768704:12345-0@lo:38:kworker.0 Request processed in 33us (382us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872843.451472:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327769088:0@lo:38:kworker.0 00000100:00100000:1.0:1788872843.451475:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00000100:00080000:3.0:1788872843.451486:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872843.451489:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872843.451492:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327768704:0@lo:38:kworker.0 00010000:00010000:1.0:1788872843.576931:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872843.849414:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872843.853340:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311200768 00000100:00100000:3.0:1788872843.853356:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311200768 00000100:00100000:3.0:1788872843.853416:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1347 00000100:00100000:3.0:1788872843.853425:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875765311200768:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:3.0:1788872843.853461:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872843.854665:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875765311200768:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 1233us (5254us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872843.854677:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1347 00000100:00100000:2.0:1788872843.856425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872843.861099:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311200896 00000100:00100000:1.0:1788872843.861241:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311200896 00000100:00100000:1.0:1788872843.861390:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1353 00000100:00100000:1.0:1788872843.861402:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2406:x1875765311200896:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872843.861669:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2406:x1875765311200896:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 268us (5250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872843.861678:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1353 00000100:00080000:2.0:1788872843.861742:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872843.960984:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327769344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872843.961100:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872843.961156:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872843.961163:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327769216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872843.961187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872843.961272:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327769344 00000100:00100000:1.0:1788872843.961283:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327769344 00000100:00100000:1.0:1788872843.961332:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327769216 00000100:00100000:1.0:1788872843.961335:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327769216 00000100:00100000:1.0:1788872843.961359:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:1.0:1788872843.961368:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327769344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872843.961399:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872843.961449:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327769344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872843.961457:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:1.0:1788872843.961489:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:1.0:1788872843.961496:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327769216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872843.961513:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872843.961542:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327769216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872843.961570:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00100000:1.0:1788872843.961616:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327769216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872843.961630:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327769344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872844.089147:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872844.472988:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788872844.603321:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788872844.991358:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000020:00000080:1.0:1788872844.991368:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a9ef0a8800/0804304d-5904-48ad-87f2-bcbc7642a62a 00000020:00000080:0.0:1788872844.991462:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef0a8800/0804304d-5904-48ad-87f2-bcbc7642a62a for lustre-OST0000 00000020:00000080:0.0:1788872844.991507:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ef0aa000 for lustre-OST0000 00000001:00100000:0.0:1788872844.993540:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000020:00000080:0.0:1788872844.993586:0:9516:0:(genops.c:906:class_export_put()) final put ffff98a8c679f000/0804304d-5904-48ad-87f2-bcbc7642a62a 00000020:00000080:2.0:1788872844.993717:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c679f000/0804304d-5904-48ad-87f2-bcbc7642a62a for lustre-OST0001 00000020:00000080:2.0:1788872844.993788:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c679e800 for lustre-OST0001 00000100:00100000:2.0:1788872845.119207:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872845.496857:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788872845.628443:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872846.136678:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872846.520819:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788872846.651211:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872846.859749:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872846.859818:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872846.859950:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311201152 00000100:00100000:1.0:1788872846.859962:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311201152 00000100:00100000:2.0:1788872846.859969:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311201024 00000100:00100000:2.0:1788872846.859973:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311201024 00000100:00100000:2.0:1788872846.860028:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1354 00000100:00100000:2.0:1788872846.860041:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2404:x1875765311201152:12345-192.168.204.39@tcp:400:kworker.0 00000100:00080000:3.0:1788872846.860072:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872846.860132:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2404:x1875765311201152:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 94us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872846.860140:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1354 00000100:00100000:2.0:1788872846.860157:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1348 00000100:00100000:2.0:1788872846.860161:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311201024:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:2.0:1788872846.860182:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872846.860205:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311201024:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 43us (387us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872846.860210:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1348 00000100:00100000:2.0:1788872847.160797:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872847.544923:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788872847.672738:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872848.185035:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00080000:1.0:1788872848.568707:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872848.568719:0:82775:0:(pinger.c:247:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788872848.568722:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872848.568725:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872848.568729:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872848.568738:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3780 00000100:00080000:1.0:1788872848.568743:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872848.568751:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872848.568794:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a0000 x1875765327769472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872848.568906:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872848.569092:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788872838/real 1788872838] req@ffff98a9df4c2d80 x1875765327766784/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788872848 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872848.569097:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00000100:00100000:3.0:1788872848.569144:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98a9df4c2d80 x1875765327766784/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788872848 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872848.569176:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327769472:0@lo:38:kworker.0 00000100:00080000:1.0:1788872848.569241:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872848.569248:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872848.569252:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872848.569257:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3780 00000100:00080000:1.0:1788872848.569261:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872848.569268:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872848.569297:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a0a80 x1875765327769728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872848.569305:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788872848.569420:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872848.569442:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788872848.569450:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327766784:0@lo:250:kworker.0 00000100:00100000:3.0:1788872848.569477:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327769728:0@lo:38:kworker.0 00000100:00100000:3.0:1788872848.569506:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872848.573696:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327769856:0@lo:400:kworker.0 10000000:01000000:2.0:1788872848.573816:0:92454:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1788872848.573836:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5440800/0xe4e6e89fb01da8e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da8e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.573848:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5440800/0xe4e6e89fb01da8e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da8e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.573854:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788872848.573880:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.573901:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5440800/0xe4e6e89fb01da8e0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da8e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.573934:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01da846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da84d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.573941:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01da846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da84d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.573946:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872848.573952:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.573956:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5441000/0xe4e6e89fb01da846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da84d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.573963:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c58af200/0xe4e6e89fb01da862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da869 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.573969:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c58af200/0xe4e6e89fb01da862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da869 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.573974:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872848.574003:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.574008:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c58af200/0xe4e6e89fb01da862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da869 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.574018:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52aee00/0xe4e6e89fb01da88c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da893 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.574024:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52aee00/0xe4e6e89fb01da88c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da893 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.574029:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872848.574041:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.574044:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52aee00/0xe4e6e89fb01da88c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da893 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.574054:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da89a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da8a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.574059:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da89a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da8a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.574064:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872848.574075:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.574079:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01da89a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da8a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.574090:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5441e00/0xe4e6e89fb01da8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da8bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.574096:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5441e00/0xe4e6e89fb01da8b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da8bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.574113:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872848.574126:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.574131:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5441e00/0xe4e6e89fb01da8b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da8bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.574155:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e7200/0xe4e6e89fb01da8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da8cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.574161:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e7200/0xe4e6e89fb01da8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da8cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.574167:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872848.574180:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.574184:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e7200/0xe4e6e89fb01da8c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da8cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.574194:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae800/0xe4e6e89fb01da8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da8f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.574200:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae800/0xe4e6e89fb01da8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da8f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.574206:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872848.574217:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.574221:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae800/0xe4e6e89fb01da8ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da8f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.574238:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c58afa00/0xe4e6e89fb01da854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da85b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.574257:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c58afa00/0xe4e6e89fb01da854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da85b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.574263:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872848.574276:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.574281:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c58afa00/0xe4e6e89fb01da854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da85b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.574318:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da877 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.574326:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da877 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.574331:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872848.574343:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.574350:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52afe00/0xe4e6e89fb01da870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da877 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.574375:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52af800/0xe4e6e89fb01da87e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da885 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.574382:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af800/0xe4e6e89fb01da87e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da885 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.574387:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788872848.574395:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.574400:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52af800/0xe4e6e89fb01da87e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da885 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.574423:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01da8a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da8af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.574440:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01da8a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da8af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.574445:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788872848.574460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788872848.574940:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.574948:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9f5441600/0xe4e6e89fb01da8a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da8af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.574961:0:92454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae000/0xe4e6e89fb01da8d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01da8d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872848.574967:0:92454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae000/0xe4e6e89fb01da8d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01da8d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872848.574972:0:92454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788872848.574986:0:92454:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788872848.574990:0:92454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c58ae000/0xe4e6e89fb01da8d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01da8d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788872848.575013:0:92454:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98a9e98d3800 already not connected (conn 68, was 0): DISCONN 00000100:00080000:2.0:1788872848.575018:0:92454:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872848.575025:0:92454:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3775 00000100:00080000:2.0:1788872848.575030:0:92454:0:(import.c:589:import_select_connection()) MGC192.168.204.139@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788872848.575036:0:92454:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872848.575067:0:92454:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f5b35c00 x1875765327769984/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872848.575095:0:92454:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1788872848.575109:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327769984:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1788872848.575687:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872848.575694:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872848.575696:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872848.575702:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3780 00000100:00080000:1.0:1788872848.575712:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872848.575719:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872848.576274:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327769472 00000100:00100000:0.0:1788872848.576292:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327769472 00000100:00100000:0.0:1788872848.576382:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327769728 00000100:00100000:0.0:1788872848.576387:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327769728 00000100:00100000:0.0:1788872848.576420:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1788872848.576431:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327769472:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872848.576464:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872848.576616:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327769472:12345-0@lo:38:kworker.0 Request processed in 185us (7316us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872848.576625:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1788872848.576647:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1788872848.576651:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327769728:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788872848.577416:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:0.0:1788872848.577753:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788872848.577859:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872848.577869:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872848.577876:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327769472:0@lo:38:kworker.0 00000100:00080000:2.0:1788872848.577938:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872848.577944:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872848.577949:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327769728:0@lo:38:kworker.0 00000100:00100000:2.0:1788872848.578062:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327769984 00000100:00100000:2.0:1788872848.578070:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327769984 00000100:00100000:3.0:1788872848.578105:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327769600:0@lo:400:kworker.0 00000100:00100000:2.0:1788872848.578115:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788872848.578125:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1875765327769984:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788872848.578171:0:92459:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo t0 exp 0000000000000000 cur 3785 last 0 00000020:00000080:2.0:1788872848.578201:0:92459:0:(genops.c:1406:class_connect()) connect: client f2e885a0-f180-4b85-9f87-6a01e20afd1a, cookie 0xe4e6e89fb01dad2b 00000100:00100000:0.0:1788872848.578267:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327769728:12345-0@lo:38:kworker.0 Request processed in 1280us (8426us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872848.578282:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1788872848.578313:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327769856 00000100:00100000:0.0:1788872848.578322:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327769856 00000100:00080000:2.0:1788872848.578369:0:92459:0:(import.c:65:import_set_state_nolock()) ffff98a9df96c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872848.578395:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1788872848.578405:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327769856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872848.578448:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:3643:x1875765327769984:12345-0@lo:250:mount.lustre.0 Request processed in 320us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.579001:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788872848.579066:0:3643:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.139@tcp: committing for last_committed 0 gen 28 00000100:00080000:2.0:1788872848.579076:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.139@tcp: connect to target with instance 0 00000100:00080000:2.0:1788872848.579086:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788872848.579091:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788872848.579096:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788872848.579098:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788872848.579267:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788872848.581467:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327769856:12345-0@lo:400:kworker.0 Request processed in 91us (4042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872848.581491:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00080000:0.0:1788872848.581578:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872848.582519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872848.583362:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327769856:0@lo:400:kworker.0 00000020:01000000:0.0:1788872848.583440:0:52416:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.139@tcp 10000000:01000000:0.0:1788872848.583477:0:52416:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1788872848.583483:0:52416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788872848.583486:0:52416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788872848.583487:0:52416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872848.583489:0:52416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872848.583491:0:52416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872848.583492:0:52416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872848.583494:0:52416:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788872848.583497:0:52416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872848.583499:0:52416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788872848.584283:0:52416:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788872848.584300:0:52416:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1788872848.584303:0:52416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788872848.584304:0:52416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788872848.584306:0:52416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872848.584307:0:52416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872848.584308:0:52416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872848.584309:0:52416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872848.584311:0:52416:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788872848.584312:0:52416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872848.584313:0:52416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788872848.584332:0:52416:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788872848.584337:0:52416:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1788872848.584339:0:52416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788872848.584341:0:52416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788872848.584342:0:52416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872848.584343:0:52416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872848.584345:0:52416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872848.584346:0:52416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872848.584347:0:52416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872848.584348:0:52416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872848.584349:0:52416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788872848.584393:0:52416:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1788872848.584450:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327770496:0@lo:253:kworker.0 00000100:00100000:0.0:1788872848.584582:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872848.584893:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a3480 x1875765327770112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872848.584959:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327770368:0@lo:253:kworker.0 00000100:00100000:1.0:1788872848.585225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872848.585311:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327770496 00000100:00100000:1.0:1788872848.585321:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327770496 00000100:00100000:1.0:1788872848.585540:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327770368 00000100:00100000:1.0:1788872848.585545:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327770368 00000100:00100000:1.0:1788872848.585592:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788872848.585601:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:3644:x1875765327770496:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788872848.585707:0:92459:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1788872848.585765:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327769600 00000100:00100000:3.0:1788872848.585778:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327769600 00000100:00080000:1.0:1788872848.585937:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872848.585942:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872848.585946:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872848.585951:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3780 00000100:00080000:1.0:1788872848.585955:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872848.585961:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872848.586053:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f67a2300 x1875765327770880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:1.0:1788872848.586114:0:92464:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1788872848.586386:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1788872848.586399:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327769600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872848.586502:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327769600:12345-0@lo:400:kworker.0 Request processed in 105us (7975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872848.586511:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1788872848.586580:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327770240:0@lo:253:kworker.0 00000100:00100000:3.0:1788872848.586633:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788872848.586807:0:92454:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1788872848.586825:0:92454:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788872848.586869:0:92454:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788872848.586875:0:92454:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788872848.586966:0:92454:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788872848.587016:0:92454:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.139@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788872848.587021:0:92454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788872848.587023:0:92454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788872848.587024:0:92454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872848.587025:0:92454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872848.587027:0:92454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872848.587028:0:92454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872848.587030:0:92454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788872848.587032:0:92454:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788872848.587033:0:92454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872848.587035:0:92454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788872848.587037:0:92454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788872848.587040:0:92454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788872848.587041:0:92454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788872848.587042:0:92454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872848.587043:0:92454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872848.587045:0:92454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872848.587046:0:92454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872848.587047:0:92454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788872848.587048:0:92454:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788872848.587049:0:92454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872848.587050:0:92454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788872848.587068:0:92454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788872848.587087:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327771008:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788872848.587157:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872848.587199:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327770240 00000100:00100000:1.0:1788872848.587205:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327770240 00000100:00100000:1.0:1788872848.587229:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327771008 00000100:00100000:1.0:1788872848.587231:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327771008 00000100:00100000:1.0:1788872848.587243:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788872848.587251:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3647:x1875765327770368:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788872848.587279:0:92460:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:1.0:1788872848.587305:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872848.587720:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327769984:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788872848.587776:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327770112:0@lo:38:kworker.0 00000100:00100000:2.0:1788872848.587813:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872848.587843:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327770112 00000100:00100000:2.0:1788872848.587847:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327770112 00000100:00100000:2.0:1788872848.587868:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:2.0:1788872848.587874:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327770112:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872848.587905:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872848.587938:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327770112:12345-0@lo:38:kworker.0 Request processed in 64us (124us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872848.587945:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00000100:00100000:2.0:1788872848.587989:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327770624:0@lo:400:kworker.0 00000100:00100000:2.0:1788872848.588016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872848.588042:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327770624 00000100:00100000:2.0:1788872848.588045:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327770624 20000000:01000000:1.0:1788872848.588195:0:92459:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 119 00000100:00100000:2.0:1788872848.590860:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:2.0:1788872848.590899:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327770624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872848.591012:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327770624:12345-0@lo:400:kworker.0 Request processed in 140us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.591020:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00080000:2.0:1788872848.591057:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 20000000:01000000:1.0:1788872848.595313:0:92465:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788872848.595330:0:92465:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788872848.595333:0:92465:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788872848.595336:0:92465:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788872848.595781:0:92465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788872848.596135:0:92459:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788872848.596186:0:92460:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788872848.596480:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327770752:0@lo:400:kworker.0 00000100:00100000:1.0:1788872848.596587:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f033e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788872848.596632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788872848.596751:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872848.596761:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872848.596767:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327770112:0@lo:38:kworker.0 00000100:00100000:1.0:1788872848.596785:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327770880:0@lo:38:kworker.0 00000100:00100000:1.0:1788872848.596859:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872848.596942:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327770880 00000100:00100000:1.0:1788872848.596949:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327770880 00000100:00100000:3.0:1788872848.597007:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327770752 00000100:00100000:3.0:1788872848.597018:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327770752 00000100:00100000:0.0:1788872848.597094:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1788872848.597101:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:0.0:1788872848.597109:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327770880:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788872848.597120:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327770752:12345-0@lo:400:kworker.0 00010000:00020000:0.0:1788872848.597147:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872848.597224:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327770880:12345-0@lo:38:kworker.0 Request processed in 117us (364us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872848.597231:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00080000:0.0:1788872848.597370:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872848.597374:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872848.597378:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327770880:0@lo:38:kworker.0 00000100:00100000:3.0:1788872848.597498:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327770752:12345-0@lo:400:kworker.0 Request processed in 383us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872848.597506:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000100:00080000:3.0:1788872848.597580:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872848.597663:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327770752:0@lo:400:kworker.0 00000100:00100000:2.0:1788872848.599800:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327770624:0@lo:400:kworker.0 00000100:00100000:2.0:1788872848.599824:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327769600:0@lo:400:kworker.0 20000000:01000000:1.0:1788872848.608496:0:92460:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788872848.608526:0:92460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788872848.608987:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3647:x1875765327770368:12345-0@lo:253:kworker.0 Request processed in 21730us (23756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872848.609000:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788872848.609047:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788872848.609058:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:3646:x1875765327770240:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788872848.609092:0:92460:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788872848.609107:0:92460:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:3.0:1788872848.609293:0:3647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788872848.609297:0:3647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788872848.609298:0:3647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872848.609300:0:3647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872848.609301:0:3647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872848.609303:0:3647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872848.609304:0:3647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788872848.609306:0:3647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872848.609308:0:3647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788872848.609311:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327770368:0@lo:253:kworker.0 20000000:01000000:2.0:1788872848.612646:0:92464:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788872848.612658:0:92464:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788872848.612717:0:92464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c5c5bc00/0xe4e6e89fb01dad32 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.612735:0:92464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5c5bc00/0xe4e6e89fb01dad32 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788872848.612746:0:92464:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000089390s 00010000:00010000:2.0:1788872848.612751:0:92464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c5c5bc00/0xe4e6e89fb01dad32 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.612757:0:92464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c5c5bc00/0xe4e6e89fb01dad32 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.612765:0:92464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c5c5bc00/0xe4e6e89fb01dad32 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.612772:0:92464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c5c5bc00/0xe4e6e89fb01dad32 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.612778:0:92464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5bc00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872848.612782:0:92464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c5c5bc00/0xe4e6e89fb01dad32 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.612790:0:92464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c5c5bc00/0xe4e6e89fb01dad32 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.612803:0:92464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c5c5bc00/0xe4e6e89fb01dad32 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.612811:0:92464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c5c5bc00/0xe4e6e89fb01dad32 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.612817:0:92464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5c5bc00/0xe4e6e89fb01dad32 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788872848.618178:0:92460:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788872848.618198:0:92460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788872848.618345:0:92459:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788872848.618471:0:92464:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788872848.618477:0:92464:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788872848.618500:0:92464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.618518:0:92464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad39 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788872848.618527:0:92464:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000089390s 00010000:00010000:2.0:1788872848.618532:0:92464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad39 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.618540:0:92464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad39 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.618583:0:92464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad39 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.618592:0:92464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad39 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.618598:0:92464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5a200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872848.618602:0:92464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad39 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.618610:0:92464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.618624:0:92464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad39 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.618668:0:92464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.618674:0:92464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad39 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872848.619046:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:3646:x1875765327770240:12345-0@lo:253:kworker.0 Request processed in 9986us (32407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872848.619058:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788872848.619104:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788872848.619115:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:92454:x1875765327771008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788872848.619172:0:92460:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788872848.619175:0:92460:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788872848.619178:0:92460:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1788872848.619186:0:92460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:0.0:1788872848.619299:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788872848.619302:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788872848.619304:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872848.619305:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872848.619307:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872848.619308:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872848.619310:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788872848.619311:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872848.619313:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788872848.619316:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327770240:0@lo:253:kworker.0 20000000:01000000:1.0:1788872848.640836:0:92459:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788872848.640867:0:92459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788872848.640924:0:92464:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788872848.640931:0:92464:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788872848.640965:0:92464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dad40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.640984:0:92464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dad40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788872848.640995:0:92464:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000089390s 00010000:00010000:3.0:1788872848.640999:0:92464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dad40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.641006:0:92464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dad40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.641013:0:92464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dad40 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.641021:0:92464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dad40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.641048:0:92464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872848.641053:0:92464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dad40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.641061:0:92464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dad40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.641076:0:92464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dad40 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.641086:0:92464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dad40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.641093:0:92464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dad40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872848.641171:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:92454:x1875765327771008:12345-0@lo:253:mount.lustre.0 Request processed in 22053us (54007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.641183:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788872848.641338:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327771008:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788872848.641847:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:3644:x1875765327770496:12345-0@lo:253:kworker.0 Request processed in 56245us (57263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.641855:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:1.0:1788872848.641910:0:92454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788872848.641914:0:92454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788872848.641916:0:92454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788872848.641918:0:92454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872848.641919:0:92454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872848.641920:0:92454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872848.641922:0:92454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872848.641923:0:92454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788872848.641924:0:92454:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788872848.641927:0:92454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872848.641927:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788872848.641928:0:92454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788872848.641929:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788872848.641930:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872848.641931:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872848.641932:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872848.641943:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872848.641944:0:3644:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872848.641945:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872848.641946:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788872848.641950:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327770496:0@lo:253:kworker.0 00000020:01000004:1.0:1788872848.641951:0:92454:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a9ff63e800 from lustre-MDT0000 10000000:01000000:1.0:1788872848.642050:0:92454:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788872848.642053:0:92454:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788872848.642062:0:92454:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98a9ff63e800 10000000:01000000:1.0:1788872848.642066:0:92454:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788872848.642070:0:92454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98a9ff63e800 10000000:01000000:1.0:1788872848.642073:0:92454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788872848.642076:0:92454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a9ff63e800 from 1 10000000:01000000:1.0:1788872848.642079:0:92454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788872848.642113:0:92454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.642123:0:92454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.642144:0:92454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872848.642168:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327771136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788872848.642202:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872848.642239:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c6507780 going to sleep for 11 seconds 00000100:00100000:3.0:1788872848.642311:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327771136 00000100:00100000:3.0:1788872848.642318:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327771136 00000100:00100000:3.0:1788872848.642840:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788872848.642855:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:92454:x1875765327771136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872848.642870:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872848.642896:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3a00/0xe4e6e89fb01dad4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dad47 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.642921:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3a00/0xe4e6e89fb01dad4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dad47 expref: 6 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.642931:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d3a00/0xe4e6e89fb01dad4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dad47 expref: 6 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.642953:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3a00, rc 0) 00000100:00100000:3.0:1788872848.643001:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:92454:x1875765327771136:12345-0@lo:101:mount.lustre.0 Request processed in 150us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872848.643007:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788872848.643074:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327771136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872848.643088:0:92454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.643097:0:92454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872848.643112:0:92454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788872848.643130:0:92454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.643137:0:92454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872848.643143:0:92454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788872848.643147:0:92454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788872848.643151:0:92454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98a9ff63e800 10000000:01000000:1.0:1788872848.643153:0:92454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788872848.643156:0:92454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788872848.643158:0:92454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788872848.643172:0:92454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.643183:0:92454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.643191:0:92454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872848.643202:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327771264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788872848.643227:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872848.643543:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c6507780 going to sleep for 11 seconds 00000100:00100000:2.0:1788872848.643605:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327771264 00000100:00100000:2.0:1788872848.643610:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327771264 00000100:00100000:2.0:1788872848.643635:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788872848.643641:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:92454:x1875765327771264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872848.643651:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872848.643662:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dad55 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.643676:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dad55 expref: 7 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.643684:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dad55 expref: 7 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872848.643691:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5c5a200, rc 0) 00000100:00100000:2.0:1788872848.643729:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:92454:x1875765327771264:12345-0@lo:101:mount.lustre.0 Request processed in 88us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.643757:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788872848.643873:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327771264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872848.643894:0:92454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dad5c expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.643903:0:92454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dad5c expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872848.643963:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327771392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872848.643997:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872848.644022:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c6507780 going to sleep for 11 seconds 00000100:00100000:2.0:1788872848.644127:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327771392 00000100:00100000:2.0:1788872848.644133:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327771392 00000100:00100000:2.0:1788872848.644164:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788872848.644171:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:92454:x1875765327771392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872848.644340:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:92454:x1875765327771392:12345-0@lo:501:mount.lustre.0 Request processed in 169us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.644359:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788872848.645247:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327771392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872848.645287:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327771520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872848.645339:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872848.645382:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c6507780 going to sleep for 11 seconds 00000100:00100000:0.0:1788872848.645492:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327771520 00000100:00100000:0.0:1788872848.645498:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327771520 00000100:00100000:0.0:1788872848.645624:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788872848.645634:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:92454:x1875765327771520:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872848.648343:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:92454:x1875765327771520:12345-0@lo:503:mount.lustre.0 Request processed in 2701us (2994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872848.648378:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788872848.649233:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327771520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872848.649508:0:92466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92466:1875765327771648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872848.649600:0:92466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.656836:0:92466:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ca268780 going to sleep for 11 seconds 00000100:00100000:2.0:1788872848.659035:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327771648 00000100:00100000:2.0:1788872848.659052:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327771648 00000100:00100000:2.0:1788872848.659126:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788872848.659138:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:92466:x1875765327771648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872848.660090:0:92466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92466:1875765327771648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788872848.660136:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872848.660150:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872848.660153:0:92466:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788872848.660159:0:92466:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788872848.660162:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788872848.660183:0:92466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98a8c72eb380) 00000020:00000080:0.0:1788872848.660211:0:92466:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1788872848.660218:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788872848.660306:0:92466:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788872848.660315:0:92466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01dad6a 00000020:00000080:0.0:1788872848.660662:0:92466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788872848.660667:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872848.660671:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872848.660673:0:92466:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788872848.660676:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872848.660687:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872848.660688:0:92466:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788872848.660692:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788872848.660701:0:92466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98a8c72e99c0) 00000020:00000080:0.0:1788872848.660714:0:92466:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1788872848.660718:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788872848.660720:0:92466:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788872848.660723:0:92466:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788872848.660729:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788872848.660778:0:92466:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9ff63e800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788872848.660792:0:92466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98a8c72e8000) 00000020:00000080:0.0:1788872848.660802:0:92466:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1788872848.660862:0:92466:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788872848.660869:0:92466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01dad7f 00000020:00000080:0.0:1788872848.661052:0:92466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788872848.661060:0:92466:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788872848.661065:0:92466:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe4e6e89fb01dad86 00080000:01000000:0.0:1788872848.661070:0:92466:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788872848.661075:0:92466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01dad8d 00000100:00100000:2.0:1788872848.661512:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:92466:x1875765327771648:12345-0@lo:502:llog_process_th.0 Request processed in 2372us (11907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.661525:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788872848.700464:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872848.717843:0:92466:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1788872848.718857:0:92466:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 115964116995 lx: 0 gen 22 00000001:00080000:3.0:1788872848.718919:0:92466:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0804304d-5904-48ad-87f2-bcbc7642a62a idx: 2 lr: 0 srv lr: 115964116995 lx: 0 gen 24 00000001:00000004:3.0:1788872848.718945:0:92466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116995 00000001:00080000:3.0:1788872848.719251:0:92466:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788872848.719313:0:92466:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff98a9c54476c0: xid 1875765327756032, transno 115964116995, client gen 22, slot idx 1 00000020:00000080:3.0:1788872848.720170:0:92466:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98a9e99999c0) 00000020:00000080:3.0:1788872848.720197:0:92466:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1788872848.720275:0:92466:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788872848.720282:0:92466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01dada9 00000020:00000080:2.0:1788872848.725804:0:92466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788872848.731978:0:92466:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe4e6e89fb01dadb0 00000020:00000080:2.0:1788872848.733214:0:92466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788872848.733228:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872848.733235:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872848.733237:0:92466:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788872848.733240:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788872848.733243:0:92466:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788872848.733244:0:92466:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788872848.733246:0:92466:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788872848.733247:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788872848.733250:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872848.733251:0:92466:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788872848.733262:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872848.733333:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872848.733336:0:92466:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788872848.733341:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788872848.733533:0:92466:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788872848.733730:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872848.733735:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872848.733737:0:92466:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788872848.733740:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872848.733744:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872848.733745:0:92466:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788872848.733748:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788872848.733753:0:92466:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:00000080:2.0:1788872848.733778:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788872848.733793:0:92466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98a9fa794d40) 00000020:00000080:2.0:1788872848.733813:0:92466:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788872848.733818:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788872848.733894:0:92466:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788872848.733900:0:92466:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788872848.733905:0:92466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01dadbe 00010000:00080000:2.0:1788872848.733938:0:92466:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9ee83e800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:2.0:1788872848.743796:0:92466:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1788872848.745198:0:92466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872848.745214:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788872848.745253:0:92466:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788872848.745281:0:92466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01dadc5 00000100:00080000:3.0:1788872848.745292:0:92466:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788872848.745299:0:92466:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98a9ee83e800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872848.745342:0:92466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c6c94e00 x1875765327771776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872848.745372:0:92466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788872848.745433:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872848.745451:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872848.745453:0:92466:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788872848.745465:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788872848.745468:0:92466:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788872848.745469:0:92466:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788872848.745471:0:92466:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788872848.745473:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788872848.745476:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872848.745477:0:92466:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788872848.745480:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788872848.745485:0:92466:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788872848.745488:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872848.745489:0:92466:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788872848.745492:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788872848.745496:0:92466:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:3.0:1788872848.745521:0:92466:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788872848.745524:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788872848.745536:0:92466:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98a9e999cd40) 00000020:00000080:3.0:1788872848.745584:0:92466:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788872848.745591:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788872848.745654:0:92466:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788872848.745660:0:92466:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788872848.745678:0:92466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01dadd3 00010000:00080000:3.0:1788872848.745710:0:92466:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9c5f10800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:3.0:1788872848.745908:0:92466:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:3.0:1788872848.746914:0:92466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788872848.747105:0:92466:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788872848.747330:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327771776:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788872848.747408:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872848.747544:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327771776 00000100:00100000:2.0:1788872848.747582:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327771776 00000100:00100000:2.0:1788872848.747614:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:2.0:1788872848.747622:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327771776:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788872848.747652:0:30614:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3785 last 0 00000020:00000080:2.0:1788872848.747694:0:30614:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01dadda 00000004:00100000:2.0:1788872848.747711:0:30614:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788872848.747813:0:30614:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe91800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872848.747892:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327771776:12345-0@lo:38:llog_process_th.0 Request processed in 258us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.747901:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00100000:0.0:1788872848.748681:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788872848.748691:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1788872848.748700:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788872848.748705:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788872848.748708:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ee83e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788872848.748722:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327771776:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788872848.749266:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327771904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872848.749317:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788872848.753760:0:92466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788872848.754335:0:92466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000040:00080000:0.0:1788872848.754620:0:92466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000100:00100000:2.0:1788872848.758100:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327771904 00000100:00100000:2.0:1788872848.758122:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327771904 00000100:00100000:2.0:1788872848.758193:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:2.0:1788872848.758203:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327771904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872848.758252:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1788872848.758351:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327771904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (9033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.758359:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00000100:00100000:1.0:1788872848.758463:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327771904:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788872848.758923:0:92472:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:3.0:1788872848.758929:0:92472:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788872848.759792:0:92466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872848.759807:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788872848.759844:0:92466:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788872848.759866:0:92466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01dade1 00000100:00080000:0.0:1788872848.759875:0:92466:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788872848.759892:0:92466:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98a9c5f10800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872848.759928:0:92466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9fa5f6300 x1875765327772032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872848.759958:0:92466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788872848.760023:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872848.760028:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872848.760030:0:92466:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788872848.760033:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788872848.760035:0:92466:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788872848.760037:0:92466:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788872848.760038:0:92466:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788872848.760040:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788872848.760042:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872848.760043:0:92466:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788872848.760045:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788872848.760049:0:92466:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788872848.760052:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872848.760054:0:92466:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788872848.760057:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788872848.760061:0:92466:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:0.0:1788872848.760085:0:92466:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788872848.760088:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788872848.760100:0:92466:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98a8c72ecd40) 00000020:00000080:0.0:1788872848.760117:0:92466:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788872848.760130:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788872848.760197:0:92466:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788872848.760205:0:92466:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788872848.760217:0:92466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01dadef 00010000:00080000:0.0:1788872848.760248:0:92466:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9ef0a8800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:0.0:1788872848.760422:0:92466:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1788872848.760496:0:92466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788872848.760512:0:92466:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788872848.762274:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327772032:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788872848.762345:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.762459:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327772032 00000100:00100000:0.0:1788872848.762469:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327772032 00000100:00100000:0.0:1788872848.762546:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5984 00000100:00100000:0.0:1788872848.762580:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3643:x1875765327772032:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788872848.762612:0:26184:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3785 last 0 00000020:00000080:0.0:1788872848.762642:0:26184:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01dadf6 00002000:00100000:0.0:1788872848.762656:0:26184:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98a9ef0aa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788872848.762670:0:26184:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788872848.762673:0:26184:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788872848.762731:0:26184:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788872848.762755:0:26184:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0ad000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872848.762825:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327772032:12345-0@lo:8:llog_process_th.0 Request processed in 244us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872848.762832:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5984 00000100:00100000:2.0:1788872848.762909:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788872848.762918:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788872848.762924:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788872848.762929:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788872848.762932:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9c5f10800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788872848.762944:0:3643:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:2.0:1788872848.762950:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327772032:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788872848.763199:0:92472:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788872848.763253:0:92472:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3785889703543ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788872848.763260:0:92472:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788872848.764225:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872848.764247:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327772160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872848.764307:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872848.764755:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327772160 00000100:00100000:3.0:1788872848.764764:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327772160 00000100:00100000:3.0:1788872848.764833:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:3.0:1788872848.764843:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327772160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788872848.764876:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000004:00080000:2.0:1788872848.765087:0:92455:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1788872848.765403:0:92466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788872848.765756:0:92466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:0.0:1788872848.765918:0:92466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000100:00100000:3.0:1788872848.766226:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327772160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1381us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872848.766239:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00080000:3.0:1788872848.766274:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872848.766413:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327772160:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788872848.767035:0:92474:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:2.0:1788872848.767049:0:92474:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788872848.767811:0:92466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788872848.767827:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788872848.767869:0:92466:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788872848.767912:0:92466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01dadfd 00000100:00080000:0.0:1788872848.767928:0:92466:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788872848.767934:0:92466:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98a9ef0a8800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872848.767976:0:92466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9fa5f5c00 x1875765327772288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872848.768042:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327772288:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788872848.768122:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788872848.768240:0:92466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788872848.768302:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872848.768307:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872848.768309:0:92466:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788872848.768312:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872848.768315:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872848.768316:0:92466:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788872848.768319:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788872848.768321:0:92466:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788872848.768323:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872848.768325:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872848.768326:0:92466:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788872848.768329:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872848.768331:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872848.768332:0:92466:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788872848.768336:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788872848.768365:0:92466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92466:1875765327772416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872848.768415:0:92466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.768468:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327772416 00000100:00100000:0.0:1788872848.768474:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327772416 00000100:00100000:0.0:1788872848.768512:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788872848.768519:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:92466:x1875765327772416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872848.768641:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:92466:x1875765327772416:12345-0@lo:502:llog_process_th.0 Request processed in 121us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872848.768649:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788872848.768722:0:92466:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c1370900 going to sleep for 11 seconds 00000100:00100000:0.0:1788872848.768742:0:92466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92466:1875765327772416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788872848.768765:0:92466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872848.768769:0:92466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872848.768771:0:92466:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788872848.768775:0:92466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788872848.768837:0:92454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788872848.768861:0:92454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788872848.768877:0:92454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dad5c expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.768905:0:92454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dad5c expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872848.768914:0:92454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9ff63e800 from 1 10000000:01000000:0.0:1788872848.768917:0:92454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788872848.768945:0:92454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.768953:0:92454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.768962:0:92454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872848.768976:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327772544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788872848.769004:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.769023:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872848.769231:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327772544 00000100:00100000:3.0:1788872848.769237:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327772544 00000100:00100000:3.0:1788872848.769270:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788872848.769277:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:92454:x1875765327772544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872848.769288:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872848.769302:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dae0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dae04 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.769324:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dae0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae04 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.769334:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dae0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae04 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.769344:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3800, rc 0) 00000100:00100000:3.0:1788872848.769378:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:92454:x1875765327772544:12345-0@lo:101:mount.lustre.0 Request processed in 102us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872848.769384:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788872848.769484:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327772288 00000100:00100000:1.0:1788872848.769489:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327772288 00000100:00100000:1.0:1788872848.769512:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5985 00000100:00100000:1.0:1788872848.769517:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3643:x1875765327772288:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788872848.769542:0:14545:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3785 last 0 00000020:00000080:1.0:1788872848.769583:0:14545:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01dae12 00002000:00100000:1.0:1788872848.769597:0:14545:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98aa002c0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788872848.769602:0:14545:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788872848.769604:0:14545:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788872848.769744:0:14545:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788872848.769769:0:14545:0:(import.c:65:import_set_state_nolock()) ffff98aa002c7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872848.769910:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327772544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788872848.769939:0:92454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae0b expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.769949:0:92454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dae0b expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872848.770500:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327772672:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788872848.770542:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.770608:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872848.770632:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327772672 00000100:00100000:0.0:1788872848.770636:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327772672 00000100:00100000:0.0:1788872848.770674:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788872848.770683:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:92454:x1875765327772672:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788872848.770700:0:92460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788872848.770719:0:92460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788872848.770723:0:92460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788872848.770726:0:92460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788872848.770728:0:92460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 122 00000100:00100000:0.0:1788872848.770817:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:92454:x1875765327772672:12345-0@lo:256:mount.lustre.0 Request processed in 134us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872848.770825:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788872848.770866:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327772672:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788872848.771476:0:92454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788872848.771493:0:92454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae0b expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.771503:0:92454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae0b expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872848.771518:0:92454:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ff63e800 from 1 10000000:01000000:0.0:1788872848.771522:0:92454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788872848.771574:0:92454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.771582:0:92454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.771592:0:92454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872848.771608:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327772800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788872848.771640:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.771667:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872848.771691:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327772800 00000100:00100000:0.0:1788872848.771695:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327772800 00000100:00100000:0.0:1788872848.771722:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788872848.771728:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:92454:x1875765327772800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788872848.771737:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872848.771751:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01dae20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dae19 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.771772:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01dae20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae19 expref: 10 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.771781:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01dae20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae19 expref: 10 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.771799:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9800, rc 0) 00000100:00100000:0.0:1788872848.771834:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:92454:x1875765327772800:12345-0@lo:101:mount.lustre.0 Request processed in 105us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872848.771840:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788872848.771876:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327772800:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788872848.771899:0:92454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.771906:0:92454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872848.771959:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327772928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788872848.771983:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.772000:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872848.772012:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327772928 00000100:00100000:0.0:1788872848.772016:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327772928 00000100:00100000:0.0:1788872848.772036:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788872848.772043:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:92454:x1875765327772928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788872848.772183:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:92454:x1875765327772928:12345-0@lo:501:mount.lustre.0 Request processed in 140us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872848.772190:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788872848.772223:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327772928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788872848.772252:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327773056:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872848.772290:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.772328:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872848.772341:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327773056 00000100:00100000:0.0:1788872848.772345:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327773056 00000100:00100000:0.0:1788872848.772366:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788872848.772371:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:92454:x1875765327773056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872848.772454:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:92454:x1875765327773056:12345-0@lo:503:mount.lustre.0 Request processed in 82us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872848.772461:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788872848.772505:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327773056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788872848.773636:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327772288:12345-0@lo:8:llog_process_th.0 Request processed in 4113us (5509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872848.773648:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5985 00000100:00100000:2.0:1788872848.773969:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788872848.773980:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788872848.773989:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788872848.773996:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788872848.774000:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0a8800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788872848.774025:0:3643:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:2.0:1788872848.774031:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327772288:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1788872848.774106:0:92474:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788872848.774209:0:92474:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3785900658430ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788872848.774216:0:92474:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788872848.774379:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872848.774391:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327773184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872848.774444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.774495:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327773184 00000100:00100000:0.0:1788872848.774500:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327773184 00000100:00100000:0.0:1788872848.774578:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:0.0:1788872848.774586:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327773184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872848.774610:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872848.774654:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327773184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872848.774821:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00080000:0.0:1788872848.774843:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872848.774873:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327773184:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788872848.776387:0:92455:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788872848.776854:0:92476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92476:1875765327773312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872848.776952:0:92476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872848.776999:0:92476:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788872848.777060:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327773312 00000100:00100000:1.0:1788872848.777068:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327773312 00000100:00100000:1.0:1788872848.777120:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788872848.777129:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:92476:x1875765327773312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872848.777807:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:92476:x1875765327773312:12345-0@lo:502:llog_process_th.0 Request processed in 675us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872848.777825:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788872848.778042:0:92476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92476:1875765327773312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788872848.778080:0:92476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872848.778091:0:92476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872848.778094:0:92476:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788872848.778102:0:92476:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a9ff63e800 00000020:00000080:3.0:1788872848.778105:0:92476:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788872848.778114:0:92476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872848.778116:0:92476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872848.778118:0:92476:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788872848.778121:0:92476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872848.778123:0:92476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872848.778124:0:92476:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788872848.778128:0:92476:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a9ff63e800 00000020:00000080:3.0:1788872848.778130:0:92476:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788872848.778232:0:92476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92476:1875765327773440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872848.778272:0:92476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872848.778306:0:92476:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788872848.778406:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327773440 00000100:00100000:2.0:1788872848.778411:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327773440 00000100:00100000:2.0:1788872848.778449:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788872848.778457:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:92476:x1875765327773440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872848.778538:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:92476:x1875765327773440:12345-0@lo:502:llog_process_th.0 Request processed in 82us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.778545:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788872848.779707:0:92476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92476:1875765327773440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788872848.779741:0:92476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872848.779746:0:92476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872848.779747:0:92476:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788872848.779751:0:92476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788872848.781824:0:92454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1788872848.781862:0:92454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788872848.781898:0:92454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.781913:0:92454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872848.781973:0:92454:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788872848.781976:0:92454:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98a9ff63e800 10000000:01000000:1.0:1788872848.781979:0:92454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98a9ff63e800 10000000:01000000:1.0:1788872848.781983:0:92454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788872848.781989:0:92454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff63e800 from 1 10000000:01000000:1.0:1788872848.781991:0:92454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788872848.782029:0:92454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.782038:0:92454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.782049:0:92454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872848.782071:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327773568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788872848.783238:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872848.783294:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5492180 going to sleep for 11 seconds 00000100:00100000:1.0:1788872848.783321:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327773568 00000100:00100000:1.0:1788872848.783329:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327773568 00000100:00100000:1.0:1788872848.783394:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788872848.783404:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:92454:x1875765327773568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872848.783419:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872848.783438:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dae2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dae27 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.783464:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dae2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae27 expref: 11 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.783476:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dae2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae27 expref: 11 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872848.783486:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d000, rc 0) 00000100:00100000:1.0:1788872848.783821:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92454:x1875765327773568:12345-0@lo:101:mount.lustre.0 Request processed in 416us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872848.783828:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788872848.784407:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327773568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788872848.784428:0:92454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae2e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.784454:0:92454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dae2e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872848.784545:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327773696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788872848.784623:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.784800:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef2af0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872848.784876:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327773696 00000100:00100000:1.0:1788872848.784892:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327773696 00000100:00100000:1.0:1788872848.784968:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788872848.784977:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92454:x1875765327773696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872848.785100:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92454:x1875765327773696:12345-0@lo:501:mount.lustre.0 Request processed in 124us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872848.785107:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788872848.787740:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327773696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788872848.787824:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327773824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872848.790402:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.790527:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef2af0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872848.791953:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327773824 00000100:00100000:2.0:1788872848.791969:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327773824 00000100:00100000:2.0:1788872848.792039:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788872848.792051:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92454:x1875765327773824:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872848.792243:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92454:x1875765327773824:12345-0@lo:503:mount.lustre.0 Request processed in 194us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.792251:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788872848.793926:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327773824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872848.797486:0:92479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92479:1875765327773952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872848.797621:0:92479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872848.797816:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327773952 00000100:00100000:2.0:1788872848.797824:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327773952 00000100:00100000:2.0:1788872848.797870:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788872848.797890:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92479:x1875765327773952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872848.798030:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92479:x1875765327773952:12345-0@lo:502:llog_process_th.0 Request processed in 151us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.798038:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788872848.798091:0:92479:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9eeba3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788872848.798116:0:92479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92479:1875765327773952:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788872848.798201:0:92479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788872848.798218:0:92479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98a9e9b0cd40) 00000020:00000080:2.0:1788872848.798245:0:92479:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788872848.799021:0:92479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9ff63e800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788872848.799027:0:92479:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9ff63e800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788872848.799030:0:92479:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9ff63e800 4 00010000:00080000:2.0:1788872848.799062:0:92479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a8c6774000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:2.0:1788872848.800904:0:92479:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1788872848.801005:0:92479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788872848.801427:0:92479:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788872848.801442:0:92479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe4e6e89fb01dae3c 00000100:00080000:2.0:1788872848.801453:0:92479:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788872848.801459:0:92479:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98a8c6774000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872848.801500:0:92479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f5b36680 x1875765327774080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872848.804013:0:92479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788872848.804640:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327774080:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788872848.805362:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.805466:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327774080 00000100:00100000:0.0:1788872848.805474:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327774080 00000100:00100000:0.0:1788872848.806321:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:0.0:1788872848.806333:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327774080:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788872848.806432:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327774080:12345-0@lo:38:llog_process_th.0 Request processed in 99us (1070us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788872848.806440:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1788872848.807784:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788872848.807799:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c6774000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872848.807807:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788872848.807812:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327774080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788872848.809369:0:92479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92479:1875765327774208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872848.809472:0:92479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872848.809519:0:92479:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9eeba3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788872848.809544:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327774208 00000100:00100000:2.0:1788872848.809565:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327774208 00000100:00100000:2.0:1788872848.809604:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788872848.809613:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92479:x1875765327774208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872848.809744:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92479:x1875765327774208:12345-0@lo:502:llog_process_th.0 Request processed in 131us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.809752:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788872848.809806:0:92479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92479:1875765327774208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872848.809842:0:92479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92479:1875765327774336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872848.809870:0:92479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872848.809900:0:92479:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ca268780 going to sleep for 11 seconds 00000100:00100000:0.0:1788872848.811646:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327774336 00000100:00100000:0.0:1788872848.811667:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327774336 00000100:00100000:0.0:1788872848.811718:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788872848.811728:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92479:x1875765327774336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872848.811935:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92479:x1875765327774336:12345-0@lo:502:llog_process_th.0 Request processed in 208us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872848.811943:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788872848.812680:0:92479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92479:1875765327774336:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788872848.812725:0:92479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788872848.812873:0:92454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788872848.812910:0:92454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872848.812926:0:92454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae2e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872848.812938:0:92454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae2e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788872848.812995:0:92454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788872848.812997:0:92454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788872848.812998:0:92454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872848.813000:0:92454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872848.813001:0:92454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872848.813002:0:92454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872848.813003:0:92454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872848.813005:0:92454:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788872848.813007:0:92454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872848.813008:0:92454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788872848.813012:0:92454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788872848.813014:0:92454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788872848.813016:0:92454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788872848.813017:0:92454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872848.813018:0:92454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872848.813019:0:92454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872848.813020:0:92454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872848.813021:0:92454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872848.813022:0:92454:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788872848.813024:0:92454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872848.813029:0:92454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788872848.813054:0:92454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788872848.813072:0:92454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327774464:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788872848.813122:0:92454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872848.813184:0:92454:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef2af180 going to sleep for 11 seconds 00000100:00100000:0.0:1788872848.813209:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327774464 00000100:00100000:0.0:1788872848.813214:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327774464 00000100:00100000:0.0:1788872848.813247:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788872848.813254:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92454:x1875765327774464:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788872848.813280:0:92459:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788872848.813294:0:92459:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788872848.815982:0:92459:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788872848.816001:0:92459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788872848.816821:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:92454:x1875765327774464:12345-0@lo:253:mount.lustre.0 Request processed in 3559us (3690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872848.816837:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788872848.816933:0:92454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:92454:1875765327774464:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788872848.816948:0:92454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788872848.816952:0:92454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788872848.816954:0:92454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788872848.816956:0:92454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872848.816958:0:92454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872848.816959:0:92454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872848.816961:0:92454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872848.816962:0:92454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872848.816964:0:92454:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788872848.816966:0:92454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872848.816967:0:92454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788872848.816985:0:92454:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788872848.817478:0:92464:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788872848.817484:0:92464:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788872848.817505:0:92464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.818339:0:92464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dae0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae04 expref: 10 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.818349:0:92464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.818395:0:92464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dae0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dae04 expref: 10 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.818412:0:92464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dae0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae04 expref: 10 pid: 92461 timeout: 3885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872848.818427:0:92464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92464:1875765327774592:0@lo:104: 00000100:00100000:3.0:1788872848.818486:0:92464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872848.818624:0:92464:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788872848.818653:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327774592 00000100:00100000:3.0:1788872848.818715:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327774592 00000100:00100000:3.0:1788872848.818759:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788872848.818768:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:92464:x1875765327774592:12345-0@lo:104: 00010000:00010000:3.0:1788872848.818783:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dae0b expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.818834:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788872848.818841:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:92464:x1875765327774592:12345-0@lo:104: Request processed in 74us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872848.818848:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788872848.818897:0:92464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92464:1875765327774592:0@lo:104: 00010000:00010000:3.0:1788872848.818917:0:92464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.818934:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872848.818939:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dae0b expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.818959:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872848.818963:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dae0b expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.818972:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dae0b expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872848.818979:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dae0b expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872848.818984:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872848.819012:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dae0b expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.819019:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872848.819038:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dae0b expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.819046:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9400/0xe4e6e89fb01dae04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dae0b expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.819064:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872848.819066:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872848.819067:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872848.819081:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327774720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872848.819110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872848.821302:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327774720 00000100:00100000:3.0:1788872848.821313:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327774720 00010000:00010000:3.0:1788872848.821342:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dae0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae04 expref: 11 pid: 92461 timeout: 3885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872848.821381:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1788872848.821391:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:3646:x1875765327774720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872848.821407:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872848.821412:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dae0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae04 expref: 11 pid: 92461 timeout: 3885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.821425:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dae0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae04 expref: 11 pid: 92461 timeout: 3885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.821444:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3800/0xe4e6e89fb01dae0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dae04 expref: 11 pid: 92461 timeout: 3885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.821463:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.821472:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788872848.821491:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004006554s 00010000:00010000:3.0:1788872848.821495:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.821502:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.821790:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.821799:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.821813:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872848.821817:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.821826:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.821840:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.821851:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872848.823888:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:3646:x1875765327774720:12345-0@lo:103:ldlm_bl.0 Request processed in 2479us (4757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872848.823902:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00010000:00010000:3.0:1788872848.823973:0:92464:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.823985:0:92464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872848.823992:0:92464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae43 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872848.826845:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327774720:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788872848.836643:0:92454:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411353 00000040:01000000:1.0:1788872848.837925:0:92454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788872848.838012:0:92484:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411353 00000020:00080000:0.0:1788872848.838018:0:92484:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411353 00000040:01000000:0.0:1788872848.838267:0:92485:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788872848.838740:0:92485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788872848.840796:0:92485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788872848.840905:0:92485:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788872848.842520:0:92454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:0.0:1788872848.856364:0:92454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788872848.856411:0:92454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788872848.857916:0:92486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c96d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92486:1875765327774848:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788872848.857998:0:92486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872848.859790:0:92486:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d900 going to sleep for 11 seconds 00000004:00000080:0.0:1788872848.860002:0:92454:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788872848.860017:0:92454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000100:00100000:3.0:1788872848.860288:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327774848 00000100:00100000:3.0:1788872848.860297:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327774848 00000100:00100000:3.0:1788872848.860364:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:3.0:1788872848.860376:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92486:x1875765327774848:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788872848.860525:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92486:x1875765327774848:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 151us (2526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872848.860533:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00000040:00080000:0.0:1788872848.861624:0:92454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788872848.862636:0:92454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1788872848.863179:0:92486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c96d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92486:1875765327774848:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788872848.863225:0:92486:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788872848.863275:0:92486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92486:1875765327774976:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872848.863337:0:92486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872848.863374:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327774976 00000100:00100000:2.0:1788872848.863380:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327774976 00000100:00100000:2.0:1788872848.863420:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:2.0:1788872848.863427:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92486:x1875765327774976:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872848.863537:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92486:x1875765327774976:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 110us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872848.863545:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00000100:00100000:2.0:1788872848.863606:0:92486:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e1c75000 going to sleep for 11 seconds 00000100:00100000:2.0:1788872848.863621:0:92486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92486:1875765327774976:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872848.863684:0:92486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92486:1875765327775104:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872848.863710:0:92486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872848.863725:0:92486:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872848.863982:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327775104 00000100:00100000:1.0:1788872848.863987:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327775104 00000100:00100000:1.0:1788872848.864021:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:1.0:1788872848.864028:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92486:x1875765327775104:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788872848.864094:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92486:x1875765327775104:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 67us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872848.864100:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00000100:00100000:2.0:1788872848.865692:0:92486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92486:1875765327775104:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788872848.865769:0:92486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788872848.869796:0:92454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788872848.870137:0:92454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788872848.870270:0:92454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788872848.870916:0:92454:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4f:0x0] (8/32) registered 00000040:00080000:2.0:1788872848.874586:0:92486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788872848.874670:0:92486:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788872848.874675:0:92486:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1788872848.876024:0:92454:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964116995 00010000:00080000:1.0:1788872848.876913:0:92487:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 92487 00010000:02000000:1.0:1788872848.876925:0:92487:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1788872848.876929:0:92487:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788872848.876932:0:92487:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1788872848.877036:0:92454:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788872848.877125:0:92454:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.139@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788872848.877158:0:92454:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788872848.877187:0:92454:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788872848.880246:0:92454:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788872848.880595:0:92454:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788872849.081652:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872849.081689:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327775232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872849.081757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.081816:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327775232 00000100:00100000:0.0:1788872849.081823:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327775232 00000100:00100000:0.0:1788872849.081860:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:0.0:1788872849.081868:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327775232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872849.081900:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872849.081941:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327775232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.081948:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00000100:00100000:0.0:1788872849.081988:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327775232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872849.082507:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872849.082518:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327775360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872849.082570:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872849.082601:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327775360 00000100:00100000:3.0:1788872849.082605:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327775360 00000100:00100000:3.0:1788872849.082632:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150 00000100:00100000:3.0:1788872849.082639:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327775360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872849.082651:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872849.082685:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327775360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.082691:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150 00000100:00100000:3.0:1788872849.082726:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327775360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872849.208661:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872849.592969:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788872849.724362:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788872849.784614:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788872849.784623:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9ff63e800 from 123 10000000:01000000:3.0:1788872849.784629:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788872849.784745:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.784757:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.784768:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872849.784795:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327775488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.784886:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872849.784931:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.785012:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327775488 00000100:00100000:0.0:1788872849.785020:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327775488 00000100:00100000:0.0:1788872849.785082:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788872849.785093:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:6517:x1875765327775488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872849.785109:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872849.785131:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c8000/0xe4e6e89fb01dae51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dae4a expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.785156:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c8000/0xe4e6e89fb01dae51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae4a expref: 11 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.785166:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c8000/0xe4e6e89fb01dae51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae4a expref: 11 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.785177:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8000, rc 0) 00000100:00100000:0.0:1788872849.785239:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327775488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.785246:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788872849.786896:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327775488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872849.786923:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.786936:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872849.787003:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327775616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.787060:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872849.787100:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.787312:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327775616 00000100:00100000:0.0:1788872849.787319:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327775616 00000100:00100000:0.0:1788872849.787368:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788872849.787376:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327775616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788872849.787398:0:92460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788872849.787414:0:92460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788872849.787417:0:92460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 123 00000100:00100000:0.0:1788872849.787855:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327775616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 478us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.787874:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788872849.787916:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327775616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788872849.787966:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788872849.787976:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.787984:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872849.787998:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788872849.788001:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9d0cfb000 from 52 10000000:01000000:0.0:1788872849.788003:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788872849.788033:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.788041:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.788050:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872849.788066:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327775744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.788093:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.788168:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c1370480 going to sleep for 11 seconds 00000100:00100000:3.0:1788872849.789868:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327775744 00000100:00100000:3.0:1788872849.789885:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327775744 00000100:00100000:3.0:1788872849.789942:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788872849.789953:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327775744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872849.789970:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872849.789988:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dae58 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.790017:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae58 expref: 12 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.790028:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae58 expref: 12 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.790038:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3200, rc 0) 00000100:00100000:3.0:1788872849.790119:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327775744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.790133:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788872849.790272:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327775744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872849.790292:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.790302:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dae5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872849.790381:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327775872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.790416:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872849.790450:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788872849.792390:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327775872 00000100:00100000:3.0:1788872849.792402:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327775872 00000100:00100000:3.0:1788872849.792452:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788872849.792462:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327775872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.792639:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327775872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.792775:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788872849.792908:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327775872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.792957:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.793010:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872849.793047:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.793127:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327776000 00000100:00100000:0.0:1788872849.793132:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327776000 00000100:00100000:0.0:1788872849.793166:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788872849.793174:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327776000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.793275:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327776000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.793281:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788872849.793369:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788872849.794277:0:92536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788872849.797972:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788872849.798016:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788872849.798029:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.798043:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872849.798053:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788872849.798056:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9d0cfb000 from 120 10000000:01000000:3.0:1788872849.798059:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788872849.798099:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01dae66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.798107:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01dae66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.798116:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01dae66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872849.798142:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.798221:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872849.798273:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.798427:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327776128 00000100:00100000:0.0:1788872849.798435:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327776128 00000100:00100000:0.0:1788872849.798489:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788872849.798499:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327776128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872849.798514:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872849.798534:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c9c00/0xe4e6e89fb01dae6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dae66 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.798582:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c9c00/0xe4e6e89fb01dae6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae66 expref: 13 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.798595:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c9c00/0xe4e6e89fb01dae6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae66 expref: 13 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.798603:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9c00, rc 0) 00000100:00100000:0.0:1788872849.798683:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327776128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.798691:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788872849.798740:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872849.798755:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01dae66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae6d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.798764:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01dae66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dae6d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872849.798811:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.798843:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.798873:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5504900 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.798888:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327776256 00000100:00100000:0.0:1788872849.798893:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327776256 00000100:00100000:0.0:1788872849.798917:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788872849.798923:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327776256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788872849.798939:0:92460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788872849.798961:0:92460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788872849.798965:0:92460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788872849.798968:0:92460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788872849.798971:0:92460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788872849.798973:0:92460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 123 00000100:00100000:0.0:1788872849.799059:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327776256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.799066:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788872849.799096:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788872849.799178:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788872849.799184:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01dae66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae6d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.799192:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01dae66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae6d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872849.799199:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788872849.799201:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1788872849.799204:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788872849.799220:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.799228:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.799236:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872849.799248:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.799274:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.799299:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5504900 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.799312:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327776384 00000100:00100000:0.0:1788872849.799316:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327776384 00000100:00100000:0.0:1788872849.799336:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788872849.799342:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327776384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872849.799349:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872849.799358:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c9400/0xe4e6e89fb01dae7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dae74 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.799371:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c9400/0xe4e6e89fb01dae7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae74 expref: 14 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.799379:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c9400/0xe4e6e89fb01dae7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae74 expref: 14 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.799385:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9400, rc 0) 00000100:00100000:0.0:1788872849.799416:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327776384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.799422:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788872849.799450:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872849.799461:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae7b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.799468:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dae7b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872849.799515:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.799538:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.799582:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5504900 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.799595:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327776512 00000100:00100000:0.0:1788872849.799598:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327776512 00000100:00100000:0.0:1788872849.799618:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788872849.799623:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327776512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.799763:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327776512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.799770:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788872849.799799:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.799825:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.799873:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.799891:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5504900 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.799901:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327776640 00000100:00100000:0.0:1788872849.799904:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327776640 00000100:00100000:0.0:1788872849.799921:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788872849.799926:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327776640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.802202:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327776640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2263us (2316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.802215:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788872849.810293:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788872849.815087:0:92537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1788872849.815494:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1788872849.815533:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788872849.815580:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae7b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.815592:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae7b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872849.815604:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788872849.815607:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a9d0cfb000 from 1 10000000:01000000:3.0:1788872849.815610:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788872849.815746:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3000/0xe4e6e89fb01dae82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.815756:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3000/0xe4e6e89fb01dae82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.815768:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3000/0xe4e6e89fb01dae82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872849.815797:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.815896:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872849.815943:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.816038:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327776768 00000100:00100000:0.0:1788872849.816045:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327776768 00000100:00100000:0.0:1788872849.816087:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788872849.816098:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc823850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327776768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872849.816115:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872849.816128:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c8a00/0xe4e6e89fb01dae89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dae82 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.816166:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c8a00/0xe4e6e89fb01dae89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae82 expref: 15 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.816177:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c8a00/0xe4e6e89fb01dae89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae82 expref: 15 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.816188:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8a00, rc 0) 00000100:00100000:0.0:1788872849.816368:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc823850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327776768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 270us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.816377:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788872849.819255:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872849.819289:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3000/0xe4e6e89fb01dae82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae89 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.819302:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3000/0xe4e6e89fb01dae82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dae89 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872849.819326:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788872849.819331:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3000/0xe4e6e89fb01dae82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae89 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.819340:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3000/0xe4e6e89fb01dae82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae89 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872849.819359:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788872849.819362:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9d0cfb000 from 7 10000000:01000000:2.0:1788872849.819365:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788872849.819399:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a400/0xe4e6e89fb01dae90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.819407:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a400/0xe4e6e89fb01dae90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.819430:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a400/0xe4e6e89fb01dae90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872849.819454:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.819528:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872849.819588:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.819690:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327776896 00000100:00100000:0.0:1788872849.819697:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327776896 00000100:00100000:0.0:1788872849.819750:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788872849.819759:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327776896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872849.819773:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872849.819787:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01dae97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dae90 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.819809:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01dae97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae90 expref: 16 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.819818:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01dae97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae90 expref: 16 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.819826:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8800, rc 0) 00000100:00100000:0.0:1788872849.819903:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327776896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.819910:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788872849.820175:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327776896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872849.820189:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a400/0xe4e6e89fb01dae90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae97 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.820196:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a400/0xe4e6e89fb01dae90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dae97 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872849.820254:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.820284:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872849.820313:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.820441:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327777024 00000100:00100000:0.0:1788872849.820446:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327777024 00000100:00100000:0.0:1788872849.820479:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788872849.820487:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327777024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.820840:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327777024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 353us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.820849:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788872849.820920:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.820949:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.820989:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872849.821018:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8480 going to sleep for 11 seconds 00000100:00100000:1.0:1788872849.821230:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327777152 00000100:00100000:1.0:1788872849.821234:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327777152 00000100:00100000:1.0:1788872849.821272:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788872849.821281:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc822c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327777152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872849.821435:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc822c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327777152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872849.821442:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788872849.821536:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788872849.822818:0:92538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788872849.830905:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788872849.830947:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788872849.830959:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a400/0xe4e6e89fb01dae90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae97 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.830972:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a400/0xe4e6e89fb01dae90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae97 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872849.830982:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788872849.830985:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff5b1000 from 52 10000000:01000000:0.0:1788872849.830988:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788872849.831028:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.831037:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.831048:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872849.831074:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.831140:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.831257:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788872849.844134:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327777280 00000100:00100000:2.0:1788872849.844152:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327777280 00000100:00100000:2.0:1788872849.844239:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788872849.844251:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327777280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872849.844269:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872849.844288:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5c5b600/0xe4e6e89fb01daea5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dae9e expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.844885:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5c5b600/0xe4e6e89fb01daea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae9e expref: 17 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.844899:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5c5b600/0xe4e6e89fb01daea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae9e expref: 17 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.844908:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5c5b600, rc 0) 00000100:00100000:2.0:1788872849.848400:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327777280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4141us (17249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872849.848413:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788872849.854587:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872849.854621:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daea5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.854659:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daea5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872849.854753:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.854820:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872849.854883:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872849.855032:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327777408 00000100:00100000:2.0:1788872849.855038:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327777408 00000100:00100000:2.0:1788872849.855086:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788872849.855096:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327777408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.855249:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327777408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872849.855257:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788872849.855802:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872849.855849:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872849.855911:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872849.855937:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788872849.855981:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327777536 00000100:00100000:2.0:1788872849.855987:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327777536 00000100:00100000:2.0:1788872849.856037:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788872849.856044:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327777536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.856143:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327777536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872849.856157:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788872849.856301:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872849.865501:0:92540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788872849.865804:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788872849.865827:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788872849.865839:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daea5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.865851:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daea5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872849.865872:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788872849.865874:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788872849.865877:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788872849.865917:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.865925:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.865937:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872849.865965:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.866040:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872849.866078:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327777664 00000100:00100000:2.0:1788872849.866085:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327777664 00000100:00100000:2.0:1788872849.866130:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788872849.866139:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327777664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872849.866154:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872849.866178:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c5c5b200/0xe4e6e89fb01daeb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01daeac expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.866201:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c5c5b200/0xe4e6e89fb01daeb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01daeac expref: 18 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.866211:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c5c5b200/0xe4e6e89fb01daeb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daeac expref: 18 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.866219:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5c5b200, rc 0) 00000100:00100000:2.0:1788872849.866250:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327777664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872849.866256:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788872849.866300:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872849.866319:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872849.866333:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daeb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.866353:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daeb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872849.866409:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.866435:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872849.872208:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788872849.872879:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327777792 00000100:00100000:3.0:1788872849.872891:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327777792 00000100:00100000:3.0:1788872849.872944:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788872849.872955:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327777792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.873595:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327777792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 639us (7156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.873604:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788872849.873803:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.873856:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.873917:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.873963:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82bacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872849.874449:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327777920 00000100:00100000:2.0:1788872849.874455:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327777920 00000100:00100000:2.0:1788872849.874495:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788872849.874502:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327777920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.875307:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327777920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 802us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872849.875316:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788872849.875501:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327777920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872849.877594:0:92542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788872849.885354:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788872849.885394:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788872849.885407:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daeb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.885421:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daeb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872849.885431:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788872849.885434:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ff5b1000 from 7 10000000:01000000:2.0:1788872849.885437:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788872849.885474:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a000/0xe4e6e89fb01daeba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.885483:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a000/0xe4e6e89fb01daeba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.885494:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a000/0xe4e6e89fb01daeba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872849.885518:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.885617:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872849.885675:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872849.885928:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327778048 00000100:00100000:3.0:1788872849.885936:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327778048 00000100:00100000:3.0:1788872849.885992:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788872849.886002:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327778048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872849.886015:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872849.886030:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d2000/0xe4e6e89fb01daec1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01daeba expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.886054:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d2000/0xe4e6e89fb01daec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01daeba expref: 19 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.886065:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d2000/0xe4e6e89fb01daec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daeba expref: 19 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.886091:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2000, rc 0) 00000100:00100000:3.0:1788872849.886138:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327778048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.886145:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788872849.886329:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872849.886363:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a000/0xe4e6e89fb01daeba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daec1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872849.886373:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a000/0xe4e6e89fb01daeba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daec1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872849.886438:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872849.886465:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872849.886499:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872849.886669:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327778176 00000100:00100000:3.0:1788872849.886675:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327778176 00000100:00100000:3.0:1788872849.886704:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788872849.886711:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327778176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.886886:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327778176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.886893:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788872849.886955:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.886989:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.887035:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.887083:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82bacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872849.887185:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327778304 00000100:00100000:3.0:1788872849.887189:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327778304 00000100:00100000:3.0:1788872849.887222:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788872849.887230:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327778304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.887317:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327778304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.887324:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788872849.887376:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872849.888212:0:92543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788872849.894285:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788872849.894332:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788872849.894416:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a000/0xe4e6e89fb01daeba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daec1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.894433:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a000/0xe4e6e89fb01daeba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daec1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872849.894444:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788872849.894447:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ef97c000 from 52 10000000:01000000:0.0:1788872849.894450:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788872849.894500:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.894509:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.894521:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872849.894596:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.895258:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.895332:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788872849.895623:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327778432 00000100:00100000:3.0:1788872849.895633:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327778432 00000100:00100000:3.0:1788872849.895838:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788872849.895849:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327778432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872849.895889:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872849.895911:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d2a00/0xe4e6e89fb01daecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01daec8 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.895940:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d2a00/0xe4e6e89fb01daecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01daec8 expref: 20 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.895950:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d2a00/0xe4e6e89fb01daecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daec8 expref: 20 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.895959:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2a00, rc 0) 00000100:00100000:3.0:1788872849.896018:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327778432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.896024:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788872849.898936:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872849.898978:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daecf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872849.899009:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daecf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872849.899101:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872849.899164:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872849.899207:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73a19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.899301:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327778560 00000100:00100000:0.0:1788872849.899307:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327778560 00000100:00100000:0.0:1788872849.899775:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788872849.899786:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327778560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.899958:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327778560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.899965:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788872849.901794:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872849.901869:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872849.901942:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872849.901971:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73a19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872849.903669:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327778688 00000100:00100000:0.0:1788872849.903684:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327778688 00000100:00100000:0.0:1788872849.903747:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788872849.903757:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327778688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.903931:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327778688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872849.903938:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788872849.905513:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872849.908849:0:92545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788872849.909199:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788872849.909223:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872849.909236:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daecf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.909249:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daecf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872849.909259:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788872849.909270:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1788872849.909273:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788872849.909313:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.909322:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.909331:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872849.909745:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.909830:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.909913:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82baf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872849.910186:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327778816 00000100:00100000:3.0:1788872849.910196:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327778816 00000100:00100000:3.0:1788872849.910246:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788872849.910256:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327778816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872849.910271:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872849.910287:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d2400/0xe4e6e89fb01daedd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01daed6 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.910314:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d2400/0xe4e6e89fb01daedd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01daed6 expref: 21 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.910325:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d2400/0xe4e6e89fb01daedd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daed6 expref: 21 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.910334:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2400, rc 0) 00000100:00100000:3.0:1788872849.910845:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327778816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 589us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.910854:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788872849.911011:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872849.911032:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daedd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.911043:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daedd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872849.911123:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.911155:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.911209:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872849.911481:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327778944 00000100:00100000:1.0:1788872849.911487:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327778944 00000100:00100000:1.0:1788872849.911525:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788872849.911533:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327778944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872849.912471:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327778944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 936us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872849.912481:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788872849.912761:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327778944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.912805:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.912845:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.912932:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82baf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872849.918498:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327779072 00000100:00100000:3.0:1788872849.918519:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327779072 00000100:00100000:3.0:1788872849.918589:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788872849.918599:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327779072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.920451:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327779072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1842us (7594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.920465:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788872849.922486:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788872849.930738:0:92547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788872849.930871:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788872849.930898:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788872849.930912:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daedd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.930924:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daedd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872849.930934:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788872849.930939:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ef97c000 from 7 10000000:01000000:0.0:1788872849.930942:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788872849.930987:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01daee4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.930994:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01daee4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.931003:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01daee4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872849.931028:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.931100:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.931174:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872849.931587:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327779200 00000100:00100000:1.0:1788872849.931596:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327779200 00000100:00100000:1.0:1788872849.931717:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788872849.931729:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327779200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872849.931745:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872849.931761:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9ca00/0xe4e6e89fb01daeeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01daee4 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872849.931786:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9ca00/0xe4e6e89fb01daeeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01daee4 expref: 22 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872849.931798:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9ca00/0xe4e6e89fb01daeeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daee4 expref: 22 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872849.931807:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9ca00, rc 0) 00000100:00100000:1.0:1788872849.931852:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327779200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872849.931869:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788872849.933513:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872849.933539:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01daee4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daeeb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872849.933581:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01daee4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daeeb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872849.933680:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.933733:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.933796:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872849.933941:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327779328 00000100:00100000:1.0:1788872849.933948:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327779328 00000100:00100000:1.0:1788872849.933997:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788872849.934006:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df43a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327779328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872849.934139:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df43a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327779328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872849.934156:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788872849.934236:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.934265:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872849.934305:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872849.934391:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872849.936467:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327779456 00000100:00100000:1.0:1788872849.936479:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327779456 00000100:00100000:3.0:1788872849.940595:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788872849.940609:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327779456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.940982:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327779456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 375us (6674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.940990:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788872849.943246:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788872849.944145:0:92550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788872849.944364:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788872849.944391:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788872849.944406:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01daee4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daeeb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.944419:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01daee4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daeeb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872849.944431:0:6517:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788872849.944435:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98a9e9b999c0 from 1 10000000:01000000:3.0:1788872849.944438:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788872849.944478:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2200/0xe4e6e89fb01daef2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.944499:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2200/0xe4e6e89fb01daef2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.944509:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2200/0xe4e6e89fb01daef2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872849.944535:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.944647:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872849.944685:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788872849.944706:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327779584 00000100:00100000:3.0:1788872849.944712:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327779584 00000100:00100000:3.0:1788872849.944761:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788872849.944769:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327779584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872849.944783:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872849.944796:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3600/0xe4e6e89fb01daef9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01daef2 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.944824:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3600/0xe4e6e89fb01daef9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01daef2 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.944835:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d3600/0xe4e6e89fb01daef9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daef2 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.944844:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3600, rc 0) 00000100:00100000:3.0:1788872849.944895:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327779584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.944903:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788872849.944961:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872849.944977:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2200/0xe4e6e89fb01daef2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daef9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.944987:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2200/0xe4e6e89fb01daef2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daef9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872849.945004:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788872849.945009:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2200/0xe4e6e89fb01daef2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daef9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.945016:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2200/0xe4e6e89fb01daef2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daef9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872849.945023:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788872849.945025:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98a9e9b999c0 from 1 10000000:01000000:3.0:1788872849.945027:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788872849.945041:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.945047:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.945054:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872849.945066:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.945090:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872849.945106:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d24fd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788872849.945119:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327779712 00000100:00100000:3.0:1788872849.945128:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327779712 00000100:00100000:3.0:1788872849.945150:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788872849.945156:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327779712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872849.945164:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872849.945172:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01daf07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01daf00 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.945184:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01daf07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01daf00 expref: 24 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.945192:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01daf07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daf00 expref: 24 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.945199:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3c00, rc 0) 00000100:00100000:3.0:1788872849.945228:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327779712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872849.945234:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788872849.945263:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872849.945273:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daf07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.945281:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daf07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872849.945327:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.945350:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872849.945363:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d24fd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788872849.945375:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327779840 00000100:00100000:3.0:1788872849.945385:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327779840 00000100:00100000:3.0:1788872849.945409:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788872849.945415:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327779840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872849.945486:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327779840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (134us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788872849.945492:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788872849.945521:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327779840:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788872849.945542:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788872849.945569:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daf07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872849.945578:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daf07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872850.232920:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788872850.620859:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788872850.747707:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872851.258639:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872851.646289:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788872851.769992:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872851.977697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872851.977893:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311201536 00000100:00100000:2.0:1788872851.977906:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311201536 00000100:00100000:2.0:1788872851.977983:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1357 00000100:00100000:2.0:1788872851.977994:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2405:x1875765311201536:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872851.978082:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2405:x1875765311201536:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 89us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872851.978090:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1357 00000100:00080000:1.0:1788872851.978151:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872851.984127:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872851.984206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872851.984277:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311201408 00000100:00100000:2.0:1788872851.984287:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311201408 00000100:00100000:2.0:1788872851.984329:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1353 00000100:00100000:2.0:1788872851.984338:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311201408:12345-192.168.204.39@tcp:38:kworker.0 00010000:00080000:2.0:1788872851.984376:0:68674:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '0804304d-5904-48ad-87f2-bcbc7642a62a' at ffff98a8c67ef000, cookie 0xe4e6e89fb01dad9b 00010000:00080000:2.0:1788872851.984384:0:68674:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp recovering/t0 exp ffff98a8c67ef000 cur 3789 last 1788872848 00010000:02000400:2.0:1788872851.984410:0:68674:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788872851.984418:0:68674:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788872851.984453:0:68674:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788872851.984637:0:68674:0:(import.c:65:import_set_state_nolock()) ffff98a9c4c3b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872851.984709:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311201408:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 370us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872851.984717:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1353 00000100:00100000:3.0:1788872851.986134:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311201280 00000100:00100000:3.0:1788872851.986149:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311201280 00000100:00100000:3.0:1788872851.986209:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 60 00000100:00100000:3.0:1788872851.986216:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2403:x1875765311201280:12345-192.168.204.39@tcp:250:kworker.0 00010000:00080000:3.0:1788872851.986249:0:92461:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp t0 exp 0000000000000000 cur 3789 last 0 00000020:00000080:3.0:1788872851.986292:0:92461:0:(genops.c:1406:class_connect()) connect: client c67645b7-2296-4087-92b1-886500c47477, cookie 0xe4e6e89fb01daf0e 00000100:00080000:3.0:1788872851.986440:0:92461:0:(import.c:65:import_set_state_nolock()) ffff98a9cb5ed800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872851.986507:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+5:2403:x1875765311201280:12345-192.168.204.39@tcp:250:kworker.0 Request processed in 290us (2396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872851.986521:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 60 00000100:00100000:3.0:1788872851.997478:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872851.997644:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311201664 00000100:00100000:1.0:1788872851.997655:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311201664 00000100:00100000:1.0:1788872851.997726:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1354 00000100:00100000:1.0:1788872851.997738:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311201664:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788872851.997763:0:66192:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a8c6c96d80 x1875765311201664/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:22/0 lens 328/0 e 0 to 0 dl 1788872862 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872851.997783:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311201664:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 49us (316us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872851.997790:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1354 00010000:00080000:1.0:1788872851.997807:0:92487:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1788872852.283420:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:2.0:1788872852.667459:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788872852.798593:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872853.260522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872853.260707:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311201792 00000100:00100000:3.0:1788872853.260718:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311201792 00000100:00100000:3.0:1788872853.260781:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 61 00000100:00100000:3.0:1788872853.260802:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+5:71021:x1875765311201792:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872853.260819:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872853.260839:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d2e00/0xe4e6e89fb01daf15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0b0 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872853.260868:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d2e00/0xe4e6e89fb01daf15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0b0 expref: 6 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872853.260881:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d2e00/0xe4e6e89fb01daf15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0b0 expref: 6 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872853.260892:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2e00, rc 0) 00000100:00100000:3.0:1788872853.260954:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+6:71021:x1875765311201792:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 163us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872853.260962:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 61 00000100:00100000:2.0:1788872853.274891:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872853.274989:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311201920 00000100:00100000:3.0:1788872853.275002:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311201920 00000100:00100000:3.0:1788872853.275076:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:3.0:1788872853.275088:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+6:71021:x1875765311201920:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788872853.275122:0:92460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788872853.275147:0:92460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788872853.275151:0:92460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788872853.275154:0:92460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788872853.275157:0:92460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788872853.275165:0:92460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 123 00000100:00100000:3.0:1788872853.289710:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+6:71021:x1875765311201920:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 Request processed in 14609us (14816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872853.289730:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 62 00000100:00100000:0.0:1788872853.296460:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872853.298437:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311202048 00000100:00100000:3.0:1788872853.298452:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311202048 00000100:00100000:3.0:1788872853.298533:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:3.0:1788872853.298544:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+6:71021:x1875765311202048:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872853.298581:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872853.298601:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9df4d3400/0xe4e6e89fb01daf1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0b7 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872853.298633:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9df4d3400/0xe4e6e89fb01daf1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0b7 expref: 7 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872853.298646:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9df4d3400/0xe4e6e89fb01daf1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0b7 expref: 7 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872853.298655:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3400, rc 0) 00000100:00100000:3.0:1788872853.298723:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+7:71021:x1875765311202048:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 181us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872853.298731:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 63 00000100:00100000:0.0:1788872853.305257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872853.305304:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311202176 00000100:00100000:0.0:1788872853.305315:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311202176 00000100:00100000:0.0:1788872853.305372:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 64 00000100:00100000:0.0:1788872853.305384:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+7:71021:x1875765311202176:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872853.305734:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+8:71021:x1875765311202176:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 352us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872853.305742:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 64 00000100:00100000:0.0:1788872853.307152:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788872853.307933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872853.308401:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311202304 00000100:00100000:1.0:1788872853.308411:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311202304 00000100:00100000:1.0:1788872853.308472:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 65 00000100:00100000:1.0:1788872853.308483:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+8:71021:x1875765311202304:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872853.308666:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+8:71021:x1875765311202304:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 183us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872853.308674:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 65 00000100:00100000:3.0:1788872853.313647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872853.313695:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311202432 00000100:00100000:0.0:1788872853.313706:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311202432 00000100:00100000:0.0:1788872853.313763:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 66 00000100:00100000:0.0:1788872853.313774:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+8:71021:x1875765311202432:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872853.313801:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872853.313821:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9c56c8200/0xe4e6e89fb01daf23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0be expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872853.313853:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9c56c8200/0xe4e6e89fb01daf23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0be expref: 9 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872853.313864:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9c56c8200/0xe4e6e89fb01daf23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0be expref: 9 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872853.313873:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8200, rc 0) 00000100:00100000:0.0:1788872853.313936:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311202432:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 164us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872853.313943:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 66 00000100:00100000:1.0:1788872853.327026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872853.327383:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311202560 00000100:00100000:2.0:1788872853.327392:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311202560 00000100:00100000:2.0:1788872853.327454:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 67 00000100:00100000:2.0:1788872853.327464:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311202560:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872853.327724:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311202560:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 260us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872853.327733:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 67 00000100:00100000:3.0:1788872853.330926:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872853.332099:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311202688 00000100:00100000:0.0:1788872853.332115:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311202688 00000100:00100000:0.0:1788872853.332197:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 68 00000100:00100000:0.0:1788872853.332207:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311202688:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872853.332361:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311202688:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 154us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872853.332370:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 68 00000100:00100000:2.0:1788872853.343905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872853.344316:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311202816 00000100:00100000:1.0:1788872853.344328:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311202816 00000100:00100000:1.0:1788872853.344390:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 69 00000100:00100000:1.0:1788872853.344399:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311202816:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872853.344417:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872853.344435:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d600/0xe4e6e89fb01daf2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0c5 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872853.344687:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d600/0xe4e6e89fb01daf2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0c5 expref: 10 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872853.344702:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9d600/0xe4e6e89fb01daf2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0c5 expref: 10 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872853.344712:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d600, rc 0) 00000100:00100000:1.0:1788872853.344777:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311202816:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 379us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872853.344785:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 69 00000100:00100000:1.0:1788872853.350466:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872853.351397:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311202944 00000100:00100000:0.0:1788872853.351421:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311202944 00000100:00100000:0.0:1788872853.351484:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 70 00000100:00100000:0.0:1788872853.351495:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311202944:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872853.351636:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311202944:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 142us (1178us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788872853.351645:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 70 00000100:00100000:0.0:1788872853.688868:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788872853.817753:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788872854.041932:0:92738:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788872854.200877:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872854.200885:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872854.200889:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872854.200898:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3785 00000100:00080000:0.0:1788872854.200902:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872854.200910:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872854.200933:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f85c5500 x1875765327780096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872854.200967:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872854.200971:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872854.200973:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872854.200975:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3785 00000100:00080000:0.0:1788872854.200978:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872854.200981:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872854.200991:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f85c6300 x1875765327780352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872854.201008:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872854.201012:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872854.201027:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872854.201031:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3785 00000100:00080000:0.0:1788872854.201034:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872854.201038:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872854.201051:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f85c6a00 x1875765327780608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872854.201073:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872854.201076:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872854.201078:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872854.201082:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3785 00000100:00080000:0.0:1788872854.201084:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872854.201088:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872854.201098:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f85c4e00 x1875765327780992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872854.201122:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788872854.201125:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872854.201126:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c6774000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872854.201130:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98a8c6774000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872854.201140:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f85c4380 x1875765327781504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872854.201170:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327779968:0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.201248:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872854.204693:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327779968 00000100:00100000:1.0:1788872854.204712:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327779968 00000100:00100000:1.0:1788872854.204806:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788872854.204821:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327779968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872854.204942:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327779968:12345-0@lo:400:kworker.0 Request processed in 125us (3693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872854.204951:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788872854.213913:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327780096:0@lo:38:kworker.0 00000100:00100000:3.0:1788872854.213996:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872854.214100:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327780096 00000100:00100000:1.0:1788872854.214110:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327780096 00000100:00100000:1.0:1788872854.214163:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1788872854.214171:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327780096:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788872854.214205:0:66190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3791 last 0 00000020:00000080:1.0:1788872854.214245:0:66190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe4e6e89fb01daf31 00000004:00100000:1.0:1788872854.214260:0:66190:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788872854.214409:0:66190:0:(import.c:65:import_set_state_nolock()) ffff98a9faa59800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872854.214461:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875765327780096:12345-0@lo:38:kworker.0 Request processed in 289us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872854.214469:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1788872854.215623:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327780480:0@lo:400:kworker.0 00000100:00100000:1.0:1788872854.215674:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872854.215964:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327780480 00000100:00100000:2.0:1788872854.215971:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327780480 00000100:00100000:2.0:1788872854.216023:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:2.0:1788872854.216033:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327780480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872854.216082:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327780480:12345-0@lo:400:kworker.0 Request processed in 51us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872854.216089:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00080000:2.0:1788872854.216112:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872854.216334:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327779968:0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.216345:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327780864:0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.216393:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872854.216426:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327780864 00000100:00100000:0.0:1788872854.216430:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327780864 00000100:00100000:0.0:1788872854.216463:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:0.0:1788872854.216470:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327780864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.216504:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327780864:12345-0@lo:400:kworker.0 Request processed in 35us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872854.216510:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00100000:0.0:1788872854.216539:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327780864:0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.216590:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327781632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872854.216887:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872854.216914:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327781632 00000100:00100000:0.0:1788872854.216918:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327781632 00000100:00100000:0.0:1788872854.216947:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:0.0:1788872854.216953:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327781632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872854.216978:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872854.217013:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327781632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872854.217020:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00100000:0.0:1788872854.217055:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327781632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872854.217068:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788872854.217075:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327780736:0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.217098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872854.217125:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327780736 00000100:00100000:0.0:1788872854.217128:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327780736 00000100:00100000:0.0:1788872854.217153:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:0.0:1788872854.217168:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327780736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.217201:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327780736:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872854.217208:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:0.0:1788872854.217236:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327780736:0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.217243:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327781376:0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.217264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872854.217287:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327781376 00000100:00100000:0.0:1788872854.217291:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327781376 00000100:00100000:0.0:1788872854.217317:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:0.0:1788872854.217323:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327781376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.217451:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327781376:12345-0@lo:400:kworker.0 Request processed in 127us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872854.217456:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00100000:0.0:1788872854.217483:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327781376:0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.217519:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327780224:0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.221223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872854.221310:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327781120:0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.221393:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872854.221416:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327781760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872854.221440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872854.221514:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327780224 00000100:00100000:0.0:1788872854.221521:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327780224 00000100:00100000:0.0:1788872854.221737:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:0.0:1788872854.221747:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327780224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.221836:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327780224:12345-0@lo:400:kworker.0 Request processed in 90us (4287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872854.221844:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:0.0:1788872854.221893:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327780224:0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.221927:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327781120 00000100:00100000:0.0:1788872854.221931:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327781120 00000100:00100000:0.0:1788872854.221956:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327781760 00000100:00100000:0.0:1788872854.221959:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327781760 00000100:00100000:0.0:1788872854.221977:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:0.0:1788872854.221983:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875765327781120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.222021:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875765327781120:12345-0@lo:400:kworker.0 Request processed in 38us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872854.222027:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00000100:00100000:0.0:1788872854.222039:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:0.0:1788872854.222045:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327781760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788872854.222071:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1788872854.222104:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327781760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872854.222110:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00000100:00100000:0.0:1788872854.222136:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327781120:0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.222149:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327781760:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788872854.222404:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872854.222410:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872854.222412:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872854.222424:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872854.222432:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327781888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872854.222466:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872854.222496:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327781888 00000100:00100000:2.0:1788872854.222500:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327781888 00000100:00100000:2.0:1788872854.222527:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:2.0:1788872854.222534:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327781888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872854.222577:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872854.222751:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327781888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 217us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872854.222758:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00100000:2.0:1788872854.222802:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327781888:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788872854.222884:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9f85c5500 x1875765327780096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872854.222900:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00080000:3.0:1788872854.224020:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff98a9f85c5500 x1875765327780096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872879 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872854.224032:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788872854.224037:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788872854.224040:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788872854.224046:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327780096:0@lo:38:kworker.0 00000100:00100000:3.0:1788872854.224056:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327780352:0@lo:38:kworker.0 00000100:00100000:3.0:1788872854.224104:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872854.224136:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327780608:0@lo:38:kworker.0 00000100:00100000:3.0:1788872854.224156:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872854.224190:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327780608 00000100:00100000:3.0:1788872854.224196:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327780608 00000100:00100000:3.0:1788872854.224222:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:3.0:1788872854.224227:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327780608:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872854.224252:0:23717:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff98a8c67ef800, cookie 0xe4e6e89fb01dad94 00010000:00080000:3.0:1788872854.224257:0:23717:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378652 exp ffff98a8c67ef800 cur 3791 last 1788872848 00000004:00100000:3.0:1788872854.224274:0:23717:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872854.224302:0:23717:0:(import.c:65:import_set_state_nolock()) ffff98a9cb5ea800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872854.224557:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327780352 00000100:00100000:2.0:1788872854.224571:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327780352 00000100:00100000:2.0:1788872854.224595:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1788872854.224600:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327780352:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788872854.224621:0:66190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3791 last 0 00000020:00000080:2.0:1788872854.224651:0:66190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe4e6e89fb01daf38 00000004:00100000:2.0:1788872854.224659:0:66190:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788872854.224674:0:66190:0:(import.c:65:import_set_state_nolock()) ffff98a9c4c3f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872854.224712:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875765327780352:12345-0@lo:38:kworker.0 Request processed in 111us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872854.224719:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1788872854.224916:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327780608:12345-0@lo:38:kworker.0 Request processed in 687us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872854.224923:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00000100:00080000:3.0:1788872854.225180:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:3.0:1788872854.225202:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788872854.225206:0:3643:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788872854.225209:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000100:00080000:3.0:1788872854.225213:0:3643:0:(recover.c:53:ptlrpc_replay_next()) import ffff98a9df8c9800 from lustre-MDT0000_UUID committed 115964116995 last 0 00000100:00080000:3.0:1788872854.225216:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788872854.225308:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327780608:0@lo:38:kworker.0 00000100:00100000:3.0:1788872854.225316:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327780992:0@lo:38:kworker.0 00010000:00080000:1.0:1788872854.225590:0:92487:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788872854.225598:0:92487:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 115964116996 00000020:00080000:1.0:1788872854.225719:0:92487:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872854.225724:0:92487:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116996 00000020:00080000:1.0:1788872854.225727:0:92487:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872854.225729:0:92487:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116996 00000100:00100000:1.0:1788872854.225761:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327780480:0@lo:400:kworker.0 00000100:00100000:1.0:1788872854.225769:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327781248:0@lo:400:kworker.0 00000100:00100000:1.0:1788872854.225817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872854.225919:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327781248 00000100:00100000:0.0:1788872854.225924:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327781248 00000100:00100000:0.0:1788872854.225979:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:0.0:1788872854.225987:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327781248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872854.226041:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327781248:12345-0@lo:400:kworker.0 Request processed in 55us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872854.226047:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00100000:3.0:1788872854.227471:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872854.227520:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327781504:0@lo:38:kworker.0 00000100:00100000:2.0:1788872854.227746:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327780992 00000100:00100000:2.0:1788872854.227760:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327780992 00000100:00100000:2.0:1788872854.227812:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:2.0:1788872854.227819:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327780992:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788872854.227851:0:68674:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3791 last 0 00000020:00000080:2.0:1788872854.227899:0:68674:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe4e6e89fb01daf3f 00000100:00080000:1.0:1788872854.228626:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872854.228674:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327781248:0@lo:400:kworker.0 00000004:00100000:2.0:1788872854.235581:0:68674:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788872854.235741:0:68674:0:(import.c:65:import_set_state_nolock()) ffff98a9e0219000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872854.235840:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875765327780992:12345-0@lo:38:kworker.0 Request processed in 8018us (8371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872854.235852:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00010000:00080000:2.0:1788872854.237508:0:92745:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1788872854.237514:0:92745:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1788872854.237520:0:92745:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1788872854.237987:0:92745:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788872854.240219:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872854.240303:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327782016:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788872854.240368:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788872854.240419:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9f85c6300 x1875765327780352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872854.240440:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00100000:2.0:1788872854.240718:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327782016 00000100:00100000:2.0:1788872854.240727:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327782016 00000100:00100000:2.0:1788872854.240786:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:2.0:1788872854.240796:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327782016:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788872854.240817:0:8446:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a9df4c2d80 x1875765327782016/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:25/0 lens 224/0 e 0 to 0 dl 1788872865 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872854.240836:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327782016:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 42us (468us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788872854.240844:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00000020:00080000:2.0:1788872854.240869:0:92487:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872854.240873:0:92487:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964116996 00010000:00080000:2.0:1788872854.240876:0:92487:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1788872854.240893:0:92487:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788872854.240901:0:92487:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788872854.240904:0:92487:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788872854.240913:0:92487:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a8c6c96d80 x1875765311201664/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:22/0 lens 328/0 e 0 to 0 dl 1788872862 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788872854.240931:0:92487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872854.240964:0:92487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01daf46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb086 expref: -99 pid: 92487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.240994:0:92487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01daf46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb086 expref: 7 pid: 92487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.241014:0:92487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01daf46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb086 expref: 7 pid: 92487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.241023:0:92487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5c5aa00, rc 0) 00010000:00080000:2.0:1788872854.241082:0:92487:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788872854.241097:0:92487:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00080000:3.0:1788872854.242087:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff98a9f85c6300 x1875765327780352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872879 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872854.242099:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788872854.242104:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788872854.242108:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788872854.242113:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327780352:0@lo:38:kworker.0 00010000:00080000:3.0:1788872854.242143:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9f85c4e00 x1875765327780992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872854.242156:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00000100:00100000:1.0:1788872854.243490:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327781504 00000100:00100000:1.0:1788872854.243500:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327781504 00000100:00100000:1.0:1788872854.243572:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:1.0:1788872854.243583:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327781504:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788872854.243792:0:66192:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3791 last 0 00000020:00000080:1.0:1788872854.243836:0:66192:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe4e6e89fb01daf4d 00000004:00100000:1.0:1788872854.243851:0:66192:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788872854.243887:0:66192:0:(import.c:65:import_set_state_nolock()) ffff98a9faa5e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872854.243968:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875765327781504:12345-0@lo:38:kworker.0 Request processed in 386us (3752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872854.243975:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00080000:3.0:1788872854.246167:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff98a9f85c4e00 x1875765327780992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872879 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872854.246182:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788872854.246187:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788872854.246191:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788872854.246198:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000268479bb): req@ffff98a8c49fb100 x1875765327765504/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872854.246226:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327780992:0@lo:38:kworker.0 00000100:00080000:3.0:1788872854.246269:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:3.0:1788872854.246277:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788872854.246282:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788872854.246285:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c6774000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788872854.246290:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327781504:0@lo:38:kworker.0 00000100:00100000:0.0:1788872854.247585:0:66202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872854.247699:0:66202:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872854.248308:0:66199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327765504 00000100:00100000:1.0:1788872854.248317:0:66199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327765504 00000100:00100000:1.0:1788872854.248379:0:66199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788872854.248389:0:66199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66202:x1875765327765504:12345-0@lo:700:mdt_seqm_0001.0 00010000:00080000:1.0:1788872854.248409:0:66199:0:(ldlm_lib.c:3211:target_queue_recovery_request()) @@@ not queueing req@ffff98a9f85c4380 x1875765327765504/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:25/0 lens 264/0 e 0 to 0 dl 1788872865 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 40000000:02000000:2.0:1788872854.253919:0:66199:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000100:00100000:0.0:1788872854.256457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872854.256597:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311203072 00000100:00100000:3.0:1788872854.256671:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311203072 00000100:00100000:3.0:1788872854.256731:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1360 00000100:00100000:3.0:1788872854.256742:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2403:x1875765311203072:12345-192.168.204.39@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1788872854.256765:0:66190:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a9f85c4e00 x1875765311203072/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:25/0 lens 224/0 e 0 to 0 dl 1788872865 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872854.256795:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2403:x1875765311203072:12345-192.168.204.39@tcp:400:ptlrpcd_rcv.0 Request processed in 56us (4257us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872854.256802:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1360 00010000:00080000:3.0:1788872854.256818:0:92487:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788872854.256931:0:92487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 00000001:00100000:3.0:1788872854.277097:0:92455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000001:00100000:3.0:1788872854.277108:0:92455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788872854.277150:0:92487:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788872854.277196:0:92487:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788872854.277214:0:92487:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff98a9df4c2d80 x1875765327782016/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:25/0 lens 224/0 e 0 to 0 dl 1788872865 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788872854.277338:0:92487:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.39@tcp: req@ffff98a9f85c4e00 x1875765311203072/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:25/0 lens 224/0 e 0 to 0 dl 1788872865 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788872854.277411:0:92487:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:02, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:2.0:1788872854.278075:0:66199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66202:x1875765327765504:12345-0@lo:700:mdt_seqm_0001.0 Request processed in 29684us (30492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872854.278092:0:66199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788872854.278143:0:66202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49fb100 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-lwp-MDT0001_UUID:66202:1875765327765504:0@lo:700:mdt_seqm_0001.0 40000000:02000000:2.0:1788872854.278157:0:66202:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000100:00080000:0.0:1788872854.283707:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1788872854.283725:0:3643:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff98a8c4a16680 x1875765327782016/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872870 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872854.283737:0:3643:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff98a8c4a16680 x1875765327782016/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872870 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872854.283745:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788872854.283758:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1788872854.283765:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e8a3656d): req@ffff98a8c38b7480 x1875765327762560/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872854.283791:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327782016:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788872854.283917:0:75625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872854.283946:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c5c4f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872854.305540:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:0804304d-5904-48ad-87f2-bcbc7642a62a+7:71107:x1875765311196800:12345-192.168.204.39@tcp:700:cp.0 Request processed in 20458603us (20459630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872854.305574:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 14 00000001:00100000:0.0:1788872854.307642:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788872854.308725:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327762560 00000100:00100000:1.0:1788872854.308741:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327762560 00000100:00100000:1.0:1788872854.308815:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:1.0:1788872854.308826:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75625:x1875765327762560:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788872854.310916:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75625:x1875765327762560:12345-0@lo:1000:osp_up0-1.0 Request processed in 2085us (26991us total) trans 120259084289 rc 0/0 00000100:00100000:1.0:1788872854.310930:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:1.0:1788872854.311049:0:75625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327762560:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788872854.311074:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327782144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872854.311109:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872854.311156:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327782144 00000100:00100000:1.0:1788872854.311163:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327782144 00000100:00100000:1.0:1788872854.311203:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:1.0:1788872854.311210:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327782144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788872854.311243:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445101568 avail 1298862080 00000100:00100000:1.0:1788872854.311283:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327782144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872854.311289:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00000100:00100000:1.0:1788872854.311320:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327782144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872854.320535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872854.320753:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311203328 00000100:00100000:2.0:1788872854.320763:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311203328 00000100:00100000:2.0:1788872854.320845:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1359 00000100:00100000:2.0:1788872854.320856:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+7:71107:x1875765311203328:12345-192.168.204.39@tcp:101:cp.0 00010000:00010000:2.0:1788872854.320879:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872854.320900:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ba00/0xe4e6e89fb01daf54 lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0cc expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321000:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5ae00/0xe4e6e89fb01daf5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321009:0:68674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5ae00/0xe4e6e89fb01daf5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321019:0:68674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5ae00/0xe4e6e89fb01daf5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872854.321039:0:68674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68674:1875765327782272:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1788872854.321088:0:68674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872854.321113:0:68674:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e7bc6c00 going to sleep for 11 seconds 00000100:00080000:2.0:1788872854.321126:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872854.321140:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327782272 00000100:00100000:2.0:1788872854.321143:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327782272 00000100:00100000:2.0:1788872854.321170:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:2.0:1788872854.321176:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68674:x1875765327782272:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1788872854.321199:0:23717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872854.321211:0:23717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b800/0xe4e6e89fb01daf62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01daf5b expref: -99 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321231:0:23717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b800/0xe4e6e89fb01daf62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01daf5b expref: 8 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321252:0:23717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b800/0xe4e6e89fb01daf62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daf5b expref: 8 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321260:0:23717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:2.0:1788872854.321263:0:23717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788872854.321267:0:23717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5c5b800, rc 0) 00000100:00100000:2.0:1788872854.321307:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68674:x1875765327782272:12345-0@lo:101:mdt00_004.0 Request processed in 130us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872854.321314:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00000100:00100000:2.0:1788872854.321752:0:68674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68674:1875765327782272:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1788872854.321781:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5ae00/0xe4e6e89fb01daf5b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daf62 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321793:0:68674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5ae00/0xe4e6e89fb01daf5b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daf62 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788872854.321812:0:68674:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788872854.321819:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5ae00/0xe4e6e89fb01daf5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daf62 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321827:0:68674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5ae00/0xe4e6e89fb01daf5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01daf62 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321889:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ac00/0xe4e6e89fb01daf69 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321899:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ac00/0xe4e6e89fb01daf69 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321917:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ac00/0xe4e6e89fb01daf69 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321931:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b400/0xe4e6e89fb01daf70 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321938:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b400/0xe4e6e89fb01daf70 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.321944:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b400/0xe4e6e89fb01daf70 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872854.322076:0:68674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68674:1875765327782400:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788872854.322111:0:68674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872854.322133:0:68674:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e7bc6900 going to sleep for 11 seconds 00000100:00100000:2.0:1788872854.322154:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327782400 00000100:00100000:2.0:1788872854.322158:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327782400 00000100:00100000:2.0:1788872854.322187:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:2.0:1788872854.322194:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68674:x1875765327782400:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788872854.322269:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68674:x1875765327782400:12345-0@lo:1000:mdt00_004.0 Request processed in 76us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872854.322276:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000100:00100000:2.0:1788872854.322309:0:68674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68674:1875765327782400:0@lo:1000:mdt00_004.0 00000004:00080000:2.0:1788872854.327492:0:68674:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x472:0x0], count =400 00000004:00080000:2.0:1788872854.327508:0:68674:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x472:0x0]+400 in llog 00000004:00080000:2.0:1788872854.327533:0:68674:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x602:0x0], index 0: 0 00010000:00010000:2.0:1788872854.328079:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b000/0xe4e6e89fb01daf77 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328108:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b000/0xe4e6e89fb01daf77 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328123:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b000/0xe4e6e89fb01daf77 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328166:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ac00/0xe4e6e89fb01daf69 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328173:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ac00/0xe4e6e89fb01daf69 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328181:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ac00/0xe4e6e89fb01daf69 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328187:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ac00/0xe4e6e89fb01daf69 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328194:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5ac00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872854.328199:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ac00/0xe4e6e89fb01daf69 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328206:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ac00/0xe4e6e89fb01daf69 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328219:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a8ca102100) 00010000:00010000:2.0:1788872854.328222:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872854.328227:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ac00/0xe4e6e89fb01daf69 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328233:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ac00/0xe4e6e89fb01daf69 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872854.328254:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000522b8b50 reply state 000000003f6c6b78 transno 77309411445 ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b400/0xe4e6e89fb01daf70 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328266:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b400/0xe4e6e89fb01daf70 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328272:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xb1bed465 (ffff98a9d1dc7600) 00010000:00010000:2.0:1788872854.328275:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872854.328278:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788872854.328318:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5ba00/0xe4e6e89fb01daf54 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0cc expref: 10 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328334:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b000/0xe4e6e89fb01daf77 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0cc expref: 9 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.328342:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff98a9d1dc7e00) 00010000:00010000:2.0:1788872854.328344:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872854.329728:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c5c5b000, rc 0) 00000100:00100000:2.0:1788872854.329829:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+10:71107:x1875765311203328:12345-192.168.204.39@tcp:101:cp.0 Request processed in 8971us (9299us total) trans 77309411445 rc 0/0 00000100:00100000:2.0:1788872854.329840:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1359 00000004:00000080:3.0:1788872854.345588:0:92487:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb002c873fe10 00100000:10000000:3.0:1788872854.345603:0:92487:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:0.0:1788872854.348742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872854.350725:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311203456 00000100:00100000:2.0:1788872854.350740:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311203456 00000100:00100000:2.0:1788872854.350804:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5986 00000100:00100000:2.0:1788872854.350814:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2403:x1875765311203456:12345-192.168.204.39@tcp:8:cp.0 00010000:00080000:2.0:1788872854.350849:0:26191:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp t0 exp 0000000000000000 cur 3791 last 0 00000020:00000080:2.0:1788872854.350882:0:26191:0:(genops.c:1406:class_connect()) connect: client 0804304d-5904-48ad-87f2-bcbc7642a62a, cookie 0xe4e6e89fb01daf85 00002000:00100000:2.0:1788872854.350903:0:26191:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0804304d-5904-48ad-87f2-bcbc7642a62a/ffff98a9f0830000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788872854.350917:0:26191:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788872854.350994:0:26191:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788872854.351024:0:26191:0:(import.c:65:import_set_state_nolock()) ffff98a9f0834000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872854.351092:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311203456:12345-192.168.204.39@tcp:8:cp.0 Request processed in 278us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872854.351101:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5986 00000004:00080000:3.0:1788872854.353480:0:92473:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x323:0x0] 00000100:00100000:3.0:1788872854.353529:0:92473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df456a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92473:1875765327782528:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788872854.355419:0:92473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872854.355457:0:92473:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56e2900 going to sleep for 11 seconds 00000004:00080000:3.0:1788872854.355474:0:92475:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x322:0x0] 00000100:00100000:3.0:1788872854.355512:0:92475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df457b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92475:1875765327782656:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788872854.355543:0:92475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872854.355650:0:92475:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788872854.355672:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327782528 00000100:00100000:3.0:1788872854.355678:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327782528 00000100:00100000:3.0:1788872854.355720:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327782656 00000100:00100000:3.0:1788872854.355723:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327782656 00000100:00100000:3.0:1788872854.355742:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5987 00000100:00100000:3.0:1788872854.355750:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:92473:x1875765327782528:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788872854.355788:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -62 00002000:02000040:3.0:1788872854.355801:0:8437:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:804 to 0x280000401:865) 00000100:00100000:2.0:1788872854.369234:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5988 00000100:00100000:2.0:1788872854.369265:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:92475:x1875765327782656:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788872854.369306:0:26188:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -63 00002000:02000040:2.0:1788872854.369312:0:26188:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:803 to 0x2c0000401:865) 00002000:00010000:3.0:1788872854.373936:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.373950:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01daf8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.373969:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x361:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.373974:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x361:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.373980:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01daf8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.373997:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01daf8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374008:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01daf8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374016:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01daf8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374036:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.374049:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.374055:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01daf8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374063:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.374067:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01daf8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374091:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01daf8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374109:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01daf8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374117:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01daf8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374136:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.374138:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.374140:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.374260:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.374265:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01daf93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374274:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x360:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.374277:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x360:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.374281:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01daf93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374290:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01daf93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374297:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01daf93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374311:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01daf93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374327:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.374336:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.374341:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01daf93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374348:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.374351:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01daf93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374360:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01daf93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374372:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01daf93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374380:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01daf93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374393:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.374395:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.374396:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.374442:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.374456:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01daf9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374465:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35f:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.374468:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.374472:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01daf9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374482:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01daf9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374490:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01daf9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374497:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01daf9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374512:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.374521:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.374526:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01daf9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374533:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.374536:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01daf9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374544:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01daf9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374608:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01daf9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374616:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01daf9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374630:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.374631:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.374633:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.374937:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.374942:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf408d45/0xe4e6e89fb01dafa1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374950:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35e:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.374953:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.374957:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf408d45/0xe4e6e89fb01dafa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374965:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf408d45/0xe4e6e89fb01dafa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374973:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf408d45/0xe4e6e89fb01dafa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.374981:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf408d45/0xe4e6e89fb01dafa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375006:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.375014:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.375019:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf408d45/0xe4e6e89fb01dafa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375025:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.375029:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf408d45/0xe4e6e89fb01dafa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375037:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf408d45/0xe4e6e89fb01dafa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375049:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf408d45/0xe4e6e89fb01dafa1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375056:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf408d45/0xe4e6e89fb01dafa1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375069:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.375071:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.375072:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.375112:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.375117:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080dd84ff/0xe4e6e89fb01dafa8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375124:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35d:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.375132:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.375137:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080dd84ff/0xe4e6e89fb01dafa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375145:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080dd84ff/0xe4e6e89fb01dafa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375153:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080dd84ff/0xe4e6e89fb01dafa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375160:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080dd84ff/0xe4e6e89fb01dafa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375173:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.375181:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.375184:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080dd84ff/0xe4e6e89fb01dafa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375191:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.375195:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080dd84ff/0xe4e6e89fb01dafa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375202:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080dd84ff/0xe4e6e89fb01dafa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375212:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080dd84ff/0xe4e6e89fb01dafa8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375230:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080dd84ff/0xe4e6e89fb01dafa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375244:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.375246:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.375248:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.375294:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.375300:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a13d6fa/0xe4e6e89fb01dafaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375307:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35c:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.375310:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.375315:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a13d6fa/0xe4e6e89fb01dafaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375325:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a13d6fa/0xe4e6e89fb01dafaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375333:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a13d6fa/0xe4e6e89fb01dafaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375340:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a13d6fa/0xe4e6e89fb01dafaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375353:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.375360:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.375371:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a13d6fa/0xe4e6e89fb01dafaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375378:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.375381:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a13d6fa/0xe4e6e89fb01dafaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375389:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a13d6fa/0xe4e6e89fb01dafaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375400:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a13d6fa/0xe4e6e89fb01dafaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375407:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a13d6fa/0xe4e6e89fb01dafaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375421:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.375423:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.375425:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.375466:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.375471:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b99f1f25/0xe4e6e89fb01dafb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375479:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35b:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.375482:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.375486:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b99f1f25/0xe4e6e89fb01dafb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375507:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b99f1f25/0xe4e6e89fb01dafb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375516:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b99f1f25/0xe4e6e89fb01dafb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375524:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b99f1f25/0xe4e6e89fb01dafb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375537:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.375545:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.375603:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b99f1f25/0xe4e6e89fb01dafb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375610:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.375614:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b99f1f25/0xe4e6e89fb01dafb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375622:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b99f1f25/0xe4e6e89fb01dafb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375633:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b99f1f25/0xe4e6e89fb01dafb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375641:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b99f1f25/0xe4e6e89fb01dafb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375661:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.375663:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.375665:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.375709:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.375714:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01dafbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375722:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35a:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.375725:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.375729:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01dafbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375738:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01dafbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375745:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01dafbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375752:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01dafbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375764:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.375783:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.375788:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01dafbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375805:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.375808:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01dafbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375817:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01dafbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375827:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01dafbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375834:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d8fd4f2/0xe4e6e89fb01dafbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375846:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.375848:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.375850:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.375890:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.375895:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c376e15/0xe4e6e89fb01dafc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375903:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x359:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.375906:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x359:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.375911:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c376e15/0xe4e6e89fb01dafc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375920:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c376e15/0xe4e6e89fb01dafc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375933:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c376e15/0xe4e6e89fb01dafc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375941:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c376e15/0xe4e6e89fb01dafc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375954:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.375960:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.375964:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c376e15/0xe4e6e89fb01dafc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375970:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.375974:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c376e15/0xe4e6e89fb01dafc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375982:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c376e15/0xe4e6e89fb01dafc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375992:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c376e15/0xe4e6e89fb01dafc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.375999:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c376e15/0xe4e6e89fb01dafc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376011:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.376018:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.376020:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.376060:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.376065:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c43e313/0xe4e6e89fb01dafcb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376074:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x358:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.376076:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x358:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.376080:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c43e313/0xe4e6e89fb01dafcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376089:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c43e313/0xe4e6e89fb01dafcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376097:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c43e313/0xe4e6e89fb01dafcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376104:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c43e313/0xe4e6e89fb01dafcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376116:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.376122:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.376125:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c43e313/0xe4e6e89fb01dafcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376132:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5440000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.376135:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c43e313/0xe4e6e89fb01dafcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376154:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c43e313/0xe4e6e89fb01dafcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376165:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c43e313/0xe4e6e89fb01dafcb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376171:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c43e313/0xe4e6e89fb01dafcb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376183:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.376185:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.376187:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.376226:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.376232:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a172fa/0xe4e6e89fb01dafd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376238:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x357:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.376241:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x357:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.376245:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a172fa/0xe4e6e89fb01dafd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376252:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a172fa/0xe4e6e89fb01dafd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376259:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a172fa/0xe4e6e89fb01dafd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376272:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a172fa/0xe4e6e89fb01dafd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376284:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.376292:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.376295:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a172fa/0xe4e6e89fb01dafd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376301:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.376304:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a172fa/0xe4e6e89fb01dafd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376315:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a172fa/0xe4e6e89fb01dafd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376325:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a172fa/0xe4e6e89fb01dafd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376332:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a172fa/0xe4e6e89fb01dafd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.376343:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.376345:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.376346:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872854.376670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872854.378855:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311203584 00000100:00100000:3.0:1788872854.378877:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311203584 00000100:00100000:3.0:1788872854.378947:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5989 00000100:00100000:3.0:1788872854.378958:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+6:0:x1875765311203584:12345-192.168.204.39@tcp:101:cp.0 00010000:00010000:3.0:1788872854.378976:0:26185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872854.378998:0:26185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01dafd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0d3 expref: -99 pid: 26185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872854.379023:0:26185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x602:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.379044:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.379049:0:26185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.379057:0:26185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01dafd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0d3 expref: 7 pid: 26185 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.379074:0:26185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01dafd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0d3 expref: 7 pid: 26185 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.379088:0:26185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5440a00, rc 0) 00000100:00100000:3.0:1788872854.379150:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+7:0:x1875765311203584:12345-192.168.204.39@tcp:101:cp.0 Request processed in 194us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872854.379157:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5989 00000100:00080000:3.0:1788872854.379180:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872854.384947:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872854.385004:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311203712 00000100:00100000:3.0:1788872854.385015:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311203712 00000100:00100000:3.0:1788872854.385068:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5990 00000100:00100000:3.0:1788872854.385078:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0804304d-5904-48ad-87f2-bcbc7642a62a+7:71107:x1875765311203712:12345-192.168.204.39@tcp:101:cp.0 00010000:00010000:3.0:1788872854.385111:0:26194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872854.385130:0:26194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0da expref: -99 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385162:0:26194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01dafd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0d3 expref: 8 pid: 26185 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385172:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.385177:0:26194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.385182:0:26194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0da expref: 8 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385218:0:26194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01dafd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0d3 expref: 8 pid: 26185 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385231:0:26194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01dafd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0d3 expref: 8 pid: 26185 timeout: 3891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872854.385246:0:26194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df457480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:26194:1875765327782784:192.168.204.39@tcp:104: 00000100:00100000:3.0:1788872854.385321:0:26194:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e1c75000 going to sleep for 11 seconds 00002000:00010000:3.0:1788872854.385467:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.385474:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d536be/0xe4e6e89fb01dafe7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385484:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x356:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.385487:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x356:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.385499:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075d536be/0xe4e6e89fb01dafe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385513:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075d536be/0xe4e6e89fb01dafe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385523:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d536be/0xe4e6e89fb01dafe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385531:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075d536be/0xe4e6e89fb01dafe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385574:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.385587:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.385593:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075d536be/0xe4e6e89fb01dafe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385601:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.385606:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d536be/0xe4e6e89fb01dafe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385616:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d536be/0xe4e6e89fb01dafe7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385632:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075d536be/0xe4e6e89fb01dafe7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385653:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075d536be/0xe4e6e89fb01dafe7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385670:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.385672:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.385674:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.385779:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.385785:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01dafee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385793:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x355:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.385796:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x355:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.385800:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01dafee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385810:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01dafee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385819:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01dafee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385826:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01dafee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385841:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.385848:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.385859:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01dafee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385866:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.385870:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01dafee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385878:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01dafee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385889:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01dafee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385896:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000772cb814/0xe4e6e89fb01dafee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385909:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.385911:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.385913:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.385959:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.385964:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01daff5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385972:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x354:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.385975:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x354:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.385978:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01daff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.385998:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01daff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386006:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01daff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386013:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01daff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386025:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.386033:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.386037:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01daff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386043:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.386047:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01daff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386054:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01daff5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386064:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01daff5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386071:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000253e557e/0xe4e6e89fb01daff5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386089:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.386091:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.386093:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.386135:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.386140:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01daffc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386148:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x353:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.386151:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x353:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.386155:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01daffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386163:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01daffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386171:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01daffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386178:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01daffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386192:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.386199:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.386204:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01daffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386222:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.386226:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01daffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386233:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01daffc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386244:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01daffc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386252:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089d145ed/0xe4e6e89fb01daffc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386264:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.386265:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.386267:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.386308:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.386314:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01db003 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386321:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x352:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.386325:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.386328:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01db003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386338:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01db003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386352:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01db003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386360:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01db003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386371:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.386378:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.386382:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01db003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386389:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.386392:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01db003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386399:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01db003 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386409:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01db003 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386416:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b79680/0xe4e6e89fb01db003 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386428:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.386434:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.386436:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.386479:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.386484:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db00a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386491:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x351:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.386494:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x351:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.386499:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db00a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386507:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db00a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386514:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db00a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386521:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db00a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386533:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.386540:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.386544:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db00a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386571:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.386575:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db00a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386595:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db00a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386605:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db00a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386612:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db00a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386624:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.386626:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.386627:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.386668:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.386673:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01db011 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386680:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x350:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.386683:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x350:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.386686:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01db011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386695:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01db011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386703:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01db011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386716:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01db011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386727:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.386733:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.386737:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01db011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386744:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.386747:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01db011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386754:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01db011 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386764:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01db011 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386785:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d212d44/0xe4e6e89fb01db011 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386798:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.386799:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.386801:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.386840:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.386852:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01db018 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386861:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34f:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.386864:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.386868:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01db018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386876:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01db018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386884:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01db018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386891:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01db018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386905:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.386912:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.386916:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01db018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386922:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.386926:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01db018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386933:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01db018 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386950:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01db018 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386957:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011def12d/0xe4e6e89fb01db018 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.386970:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.386972:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.386974:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.387017:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.387022:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01db01f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387029:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34e:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.387032:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.387035:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01db01f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387044:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01db01f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387052:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01db01f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387060:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01db01f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387083:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.387091:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.387095:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01db01f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387101:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.387104:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01db01f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387111:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01db01f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387122:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01db01f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387129:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af913952/0xe4e6e89fb01db01f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387142:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.387144:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.387145:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.387190:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.387196:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01db026 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387203:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34d:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.387213:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.387217:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01db026 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387226:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01db026 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387234:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01db026 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387241:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01db026 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387253:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.387261:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.387264:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01db026 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387271:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.387275:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01db026 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387282:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01db026 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387291:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01db026 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387309:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85956f2/0xe4e6e89fb01db026 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387322:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.387323:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.387325:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.387369:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.387373:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01db02d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387381:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34c:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.387384:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.387388:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01db02d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387396:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01db02d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387404:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01db02d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387411:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01db02d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387424:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.387430:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.387440:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01db02d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387447:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.387451:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01db02d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387459:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01db02d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387469:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01db02d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387476:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ad8a306/0xe4e6e89fb01db02d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.387488:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.387490:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.387492:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788872854.394903:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.394918:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01db034 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.394937:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x361:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.394942:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x361:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.394948:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01db034 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.394965:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01db034 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.394975:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01db034 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.394995:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01db034 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395030:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788872854.395269:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.395275:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01db03b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395283:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x360:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.395287:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x360:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.395291:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01db03b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395300:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01db03b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395307:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01db03b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395314:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01db03b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395328:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788872854.395366:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.395372:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db8c213f/0xe4e6e89fb01db042 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395385:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35f:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.395388:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.395392:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db8c213f/0xe4e6e89fb01db042 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395402:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db8c213f/0xe4e6e89fb01db042 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395410:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db8c213f/0xe4e6e89fb01db042 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395417:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db8c213f/0xe4e6e89fb01db042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395432:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788872854.395475:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.395480:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c0d668/0xe4e6e89fb01db049 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395488:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35e:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.395490:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.395494:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003c0d668/0xe4e6e89fb01db049 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395503:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003c0d668/0xe4e6e89fb01db049 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395521:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c0d668/0xe4e6e89fb01db049 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395527:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003c0d668/0xe4e6e89fb01db049 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395537:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788872854.395615:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.395621:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005abf65f5/0xe4e6e89fb01db050 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395629:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35d:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.395632:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.395635:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005abf65f5/0xe4e6e89fb01db050 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395644:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005abf65f5/0xe4e6e89fb01db050 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395653:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005abf65f5/0xe4e6e89fb01db050 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395660:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005abf65f5/0xe4e6e89fb01db050 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395681:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788872854.395715:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.395720:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012f9c754/0xe4e6e89fb01db057 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395728:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35c:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.395731:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.395735:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f9c754/0xe4e6e89fb01db057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395743:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012f9c754/0xe4e6e89fb01db057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395751:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012f9c754/0xe4e6e89fb01db057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395759:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012f9c754/0xe4e6e89fb01db057 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395766:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788872854.395808:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.395812:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfdf06f/0xe4e6e89fb01db05e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395819:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35b:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.395827:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.395831:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfdf06f/0xe4e6e89fb01db05e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395840:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cfdf06f/0xe4e6e89fb01db05e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395849:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfdf06f/0xe4e6e89fb01db05e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395856:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cfdf06f/0xe4e6e89fb01db05e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395864:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788872854.395896:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.395901:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ea70921/0xe4e6e89fb01db065 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395907:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35a:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.395910:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.395914:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ea70921/0xe4e6e89fb01db065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395922:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ea70921/0xe4e6e89fb01db065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395930:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ea70921/0xe4e6e89fb01db065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395941:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ea70921/0xe4e6e89fb01db065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395949:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788872854.395978:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.395983:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002ec2e86/0xe4e6e89fb01db06c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.395990:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x359:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.395992:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x359:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.396105:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788872854.396113:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01db034 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396121:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5ba00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.396126:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01db034 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396148:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01db034 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396166:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01db034 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396174:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3c7d142/0xe4e6e89fb01db034 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396194:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788872854.396197:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01db03b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396204:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5ac00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.396207:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01db03b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396215:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01db03b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396225:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01db03b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396232:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000382efdc8/0xe4e6e89fb01db03b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396256:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788872854.396260:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db8c213f/0xe4e6e89fb01db042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396266:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5a800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.396269:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db8c213f/0xe4e6e89fb01db042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396277:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db8c213f/0xe4e6e89fb01db042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396287:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db8c213f/0xe4e6e89fb01db042 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396293:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db8c213f/0xe4e6e89fb01db042 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396304:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788872854.396307:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003c0d668/0xe4e6e89fb01db049 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396313:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5a600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.396316:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c0d668/0xe4e6e89fb01db049 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396335:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c0d668/0xe4e6e89fb01db049 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396346:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003c0d668/0xe4e6e89fb01db049 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396353:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003c0d668/0xe4e6e89fb01db049 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396366:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788872854.396369:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005abf65f5/0xe4e6e89fb01db050 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396376:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449aa00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.396379:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005abf65f5/0xe4e6e89fb01db050 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396387:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005abf65f5/0xe4e6e89fb01db050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396396:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005abf65f5/0xe4e6e89fb01db050 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396403:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005abf65f5/0xe4e6e89fb01db050 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396424:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788872854.396427:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012f9c754/0xe4e6e89fb01db057 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396434:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449b200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.396437:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012f9c754/0xe4e6e89fb01db057 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396444:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012f9c754/0xe4e6e89fb01db057 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396453:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012f9c754/0xe4e6e89fb01db057 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396460:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012f9c754/0xe4e6e89fb01db057 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396470:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872854.396473:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cfdf06f/0xe4e6e89fb01db05e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396479:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449a400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.396482:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfdf06f/0xe4e6e89fb01db05e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396498:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfdf06f/0xe4e6e89fb01db05e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396507:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cfdf06f/0xe4e6e89fb01db05e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396514:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cfdf06f/0xe4e6e89fb01db05e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396524:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.396527:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ea70921/0xe4e6e89fb01db065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396532:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449b000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.396535:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ea70921/0xe4e6e89fb01db065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396542:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ea70921/0xe4e6e89fb01db065 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396649:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ea70921/0xe4e6e89fb01db065 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396657:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ea70921/0xe4e6e89fb01db065 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.396690:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.396692:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.396694:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872854.396863:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872854.396895:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311203840 00000100:00100000:3.0:1788872854.396903:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311203840 00010000:00010000:3.0:1788872854.396933:0:26197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01dafd9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0d3 expref: 9 pid: 26185 timeout: 3891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872854.396962:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2563 00000100:00100000:3.0:1788872854.396970:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2405:x1875765311203840:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788872854.396983:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872854.397000:0:26197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01dafd9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0d3 expref: 9 pid: 26185 timeout: 3891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.397013:0:26197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01dafd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0d3 expref: 9 pid: 26185 timeout: 3891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.397029:0:26197:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.397033:0:26197:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.397041:0:26197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0da expref: 9 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.397051:0:26197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0da expref: 9 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.397098:0:26197:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0da expref: 9 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872854.397114:0:26197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df454e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:26197:1875765327782912:192.168.204.39@tcp:105: 00000100:00100000:3.0:1788872854.397196:0:26197:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e1c75c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788872854.400393:0:26194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a291e666/0xe4e6e89fb01dafd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0d3 expref: 9 pid: 26185 timeout: 3891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872854.400417:0:26194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df457480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:26194:1875765327782784:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788872854.400445:0:26194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0da expref: 8 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.400460:0:26194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9f5441200, rc 0) 00000100:00100000:3.0:1788872854.400519:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71107:x1875765311203712:12345-192.168.204.39@tcp:101:cp.0 Request processed in 15442us (15582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872854.400527:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5990 00000100:00100000:3.0:1788872854.400725:0:26197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df454e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:26197:1875765327782912:192.168.204.39@tcp:105: 00010000:00010000:3.0:1788872854.400737:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872854.400758:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311203840:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 3789us (3900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872854.400780:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2563 00010000:00010000:3.0:1788872854.400827:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.400833:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.401016:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.401024:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01db073 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401037:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34b:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.401042:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.401048:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01db073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401062:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01db073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401072:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01db073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401080:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01db073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401095:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.401102:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.401108:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01db073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401114:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.401119:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01db073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401138:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01db073 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401153:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01db073 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401160:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbdebe97/0xe4e6e89fb01db073 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401176:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.401177:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.401179:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.401220:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.401225:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01db07a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401232:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34a:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.401236:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.401240:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01db07a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401249:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01db07a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401257:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01db07a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401270:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01db07a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401283:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.401290:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.401294:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01db07a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401300:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.401304:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01db07a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401352:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01db07a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401363:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01db07a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401369:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aefd2a93/0xe4e6e89fb01db07a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401381:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.401383:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.401384:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.401427:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.401439:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01db081 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401447:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x349:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.401451:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x349:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.401454:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01db081 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401464:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01db081 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401471:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01db081 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401478:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01db081 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401491:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.401497:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.401501:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01db081 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401508:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.401510:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01db081 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401518:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01db081 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401534:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01db081 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401540:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01db081 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401570:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.401572:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.401574:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.401615:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.401620:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01db088 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401628:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x348:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.401630:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x348:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.401634:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01db088 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401642:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01db088 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401649:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01db088 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401655:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01db088 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401678:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.401685:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.401688:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01db088 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401695:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.401698:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01db088 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401705:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01db088 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401716:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01db088 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401723:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094990c99/0xe4e6e89fb01db088 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401734:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.401736:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.401737:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.401790:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.401796:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01db08f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401803:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x347:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.401811:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x347:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.401816:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01db08f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401824:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01db08f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401832:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01db08f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401839:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01db08f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401851:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.401858:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.401861:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01db08f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401868:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.401871:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01db08f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401879:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01db08f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401889:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01db08f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401906:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000155b9969/0xe4e6e89fb01db08f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401921:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.401923:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.401924:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.401966:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.401972:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01db096 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401979:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x346:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.401983:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x346:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.401986:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01db096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.401995:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01db096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402002:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01db096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402009:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01db096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402095:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.402102:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.402111:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01db096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402118:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.402121:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01db096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402128:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01db096 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402138:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01db096 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402145:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f34257e/0xe4e6e89fb01db096 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402157:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.402159:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.402160:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.402199:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.402204:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01db09d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402211:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x345:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.402214:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x345:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.402217:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01db09d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402238:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01db09d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402246:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01db09d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402253:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01db09d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402265:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.402272:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.402275:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01db09d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402282:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.402286:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01db09d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402294:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01db09d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402303:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01db09d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402309:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf2d766e/0xe4e6e89fb01db09d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402327:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.402329:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.402330:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.402373:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.402377:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e342ab9f/0xe4e6e89fb01db0a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402385:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x344:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.402388:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x344:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.402392:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e342ab9f/0xe4e6e89fb01db0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402401:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e342ab9f/0xe4e6e89fb01db0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402410:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e342ab9f/0xe4e6e89fb01db0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402417:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e342ab9f/0xe4e6e89fb01db0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402429:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.402434:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.402438:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e342ab9f/0xe4e6e89fb01db0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402455:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9f5441800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.402458:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e342ab9f/0xe4e6e89fb01db0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402466:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e342ab9f/0xe4e6e89fb01db0a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402476:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e342ab9f/0xe4e6e89fb01db0a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402482:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e342ab9f/0xe4e6e89fb01db0a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402495:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.402497:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.402499:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.402540:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.402545:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01db0ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402572:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x343:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.402575:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x343:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.402579:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01db0ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402588:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01db0ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402602:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01db0ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402609:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01db0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402621:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.402628:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.402631:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01db0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402636:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.402639:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01db0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402646:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01db0ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402656:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01db0ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402662:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007749c67f/0xe4e6e89fb01db0ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402676:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.402682:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.402684:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872854.402725:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872854.402729:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01db0b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402737:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x342:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788872854.402740:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x342:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872854.402744:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01db0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402752:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01db0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402758:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01db0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402764:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01db0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402790:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872854.402796:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.402799:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01db0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402805:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.402808:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01db0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402826:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01db0b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402837:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01db0b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402843:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3c71153/0xe4e6e89fb01db0b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.402856:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.402857:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.402859:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872854.404853:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002ec2e86/0xe4e6e89fb01db06c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.404887:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002ec2e86/0xe4e6e89fb01db06c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.404900:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002ec2e86/0xe4e6e89fb01db06c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.404909:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002ec2e86/0xe4e6e89fb01db06c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.404957:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788872854.405055:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.405061:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000178b0f77/0xe4e6e89fb01db0b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405077:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x358:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.405082:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x358:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.405088:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000178b0f77/0xe4e6e89fb01db0b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405098:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000178b0f77/0xe4e6e89fb01db0b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405106:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000178b0f77/0xe4e6e89fb01db0b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405115:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000178b0f77/0xe4e6e89fb01db0b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405132:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788872854.405164:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.405169:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822a2530/0xe4e6e89fb01db0c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405176:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x357:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.405179:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x357:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.405183:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822a2530/0xe4e6e89fb01db0c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405191:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000822a2530/0xe4e6e89fb01db0c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405210:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822a2530/0xe4e6e89fb01db0c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405217:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000822a2530/0xe4e6e89fb01db0c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405230:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788872854.405272:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.405277:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000436d41aa/0xe4e6e89fb01db0c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405314:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x356:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.405317:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x356:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.405321:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000436d41aa/0xe4e6e89fb01db0c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405331:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000436d41aa/0xe4e6e89fb01db0c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405340:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000436d41aa/0xe4e6e89fb01db0c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405347:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000436d41aa/0xe4e6e89fb01db0c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1788872854.405399:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000001:00100000:2.0:1788872854.405406:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788872854.405420:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788872854.405460:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.405466:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000557cf276/0xe4e6e89fb01db0ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405475:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x355:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.405478:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x355:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.405482:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000557cf276/0xe4e6e89fb01db0ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405491:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000557cf276/0xe4e6e89fb01db0ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405499:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000557cf276/0xe4e6e89fb01db0ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405507:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000557cf276/0xe4e6e89fb01db0ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405514:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788872854.405544:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.405581:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8c0bc64/0xe4e6e89fb01db0d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405599:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x354:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.405602:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x354:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.405606:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8c0bc64/0xe4e6e89fb01db0d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405616:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8c0bc64/0xe4e6e89fb01db0d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405624:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8c0bc64/0xe4e6e89fb01db0d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405631:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8c0bc64/0xe4e6e89fb01db0d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405639:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788872854.405672:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.405677:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c586661b/0xe4e6e89fb01db0dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405683:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x353:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.405686:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x353:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.405690:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c586661b/0xe4e6e89fb01db0dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405699:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c586661b/0xe4e6e89fb01db0dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405716:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c586661b/0xe4e6e89fb01db0dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405724:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c586661b/0xe4e6e89fb01db0dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405731:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788872854.405760:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.405765:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01db0e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405784:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x352:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.405787:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.405791:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01db0e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405800:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01db0e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405808:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01db0e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405816:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01db0e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405833:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788872854.405867:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.405872:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db0ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405880:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x351:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.405883:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x351:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.405887:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db0ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405896:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db0ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405903:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db0ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405911:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db0ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405918:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1788872854.405943:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.405947:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db0f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405954:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x350:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.405961:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x350:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.405965:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db0f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405974:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db0f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405983:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db0f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405990:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db0f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.405997:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1788872854.406028:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.406033:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01db0f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406040:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34f:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.406042:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.406046:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01db0f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406054:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01db0f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406062:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01db0f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406074:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01db0f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406082:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1788872854.406112:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.406117:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db0ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406124:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34e:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.406127:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.406131:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406140:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406148:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406155:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db0ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406162:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1788872854.406192:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.406197:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c04121/0xe4e6e89fb01db106 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406210:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34d:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.406213:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.406217:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c04121/0xe4e6e89fb01db106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406225:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3c04121/0xe4e6e89fb01db106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406233:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c04121/0xe4e6e89fb01db106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406240:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c04121/0xe4e6e89fb01db106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406248:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1788872854.406284:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.406289:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecc5105a/0xe4e6e89fb01db10d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406295:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34c:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.406298:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.406301:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc5105a/0xe4e6e89fb01db10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406309:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecc5105a/0xe4e6e89fb01db10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406325:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecc5105a/0xe4e6e89fb01db10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406332:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc5105a/0xe4e6e89fb01db10d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406340:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1788872854.406378:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.406383:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf3cae1/0xe4e6e89fb01db114 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406391:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34b:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.406394:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.406398:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf3cae1/0xe4e6e89fb01db114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406406:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bf3cae1/0xe4e6e89fb01db114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406414:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf3cae1/0xe4e6e89fb01db114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406421:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bf3cae1/0xe4e6e89fb01db114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406440:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1788872854.406478:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.406483:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d4df0a1/0xe4e6e89fb01db11b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406491:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34a:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.406494:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.406499:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d4df0a1/0xe4e6e89fb01db11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406507:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d4df0a1/0xe4e6e89fb01db11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406515:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d4df0a1/0xe4e6e89fb01db11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406523:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d4df0a1/0xe4e6e89fb01db11b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406531:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1788872854.406587:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.406592:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca7faa2b/0xe4e6e89fb01db122 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406599:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x349:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.406607:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x349:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.406611:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca7faa2b/0xe4e6e89fb01db122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406621:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca7faa2b/0xe4e6e89fb01db122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406629:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca7faa2b/0xe4e6e89fb01db122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406637:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca7faa2b/0xe4e6e89fb01db122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406644:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:2.0:1788872854.406687:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.406692:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003596cc7f/0xe4e6e89fb01db129 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406699:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x348:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.406701:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x348:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.406705:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003596cc7f/0xe4e6e89fb01db129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406714:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003596cc7f/0xe4e6e89fb01db129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406722:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003596cc7f/0xe4e6e89fb01db129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406733:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003596cc7f/0xe4e6e89fb01db129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406740:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:2.0:1788872854.406780:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.406785:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15ce5ff/0xe4e6e89fb01db130 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406792:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x347:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.406795:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x347:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.406799:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b15ce5ff/0xe4e6e89fb01db130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406808:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b15ce5ff/0xe4e6e89fb01db130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406816:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15ce5ff/0xe4e6e89fb01db130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406824:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b15ce5ff/0xe4e6e89fb01db130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406831:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:2.0:1788872854.406862:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.406866:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa57e70a/0xe4e6e89fb01db137 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406879:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x346:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.406881:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x346:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.406886:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa57e70a/0xe4e6e89fb01db137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406895:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa57e70a/0xe4e6e89fb01db137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406903:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa57e70a/0xe4e6e89fb01db137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406911:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa57e70a/0xe4e6e89fb01db137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406919:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:2.0:1788872854.406949:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.406953:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3431078/0xe4e6e89fb01db13e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406960:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x345:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.406963:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x345:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.406967:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3431078/0xe4e6e89fb01db13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406975:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3431078/0xe4e6e89fb01db13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406992:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3431078/0xe4e6e89fb01db13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.406999:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3431078/0xe4e6e89fb01db13e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407007:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:2.0:1788872854.407034:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.407039:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b30298b9/0xe4e6e89fb01db145 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407046:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x344:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.407049:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x344:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.407053:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b30298b9/0xe4e6e89fb01db145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407062:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b30298b9/0xe4e6e89fb01db145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407070:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b30298b9/0xe4e6e89fb01db145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407078:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b30298b9/0xe4e6e89fb01db145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407095:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:2.0:1788872854.407125:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.407129:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e14f57b3/0xe4e6e89fb01db14c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407137:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x343:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.407140:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x343:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.407144:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e14f57b3/0xe4e6e89fb01db14c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407153:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e14f57b3/0xe4e6e89fb01db14c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407160:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e14f57b3/0xe4e6e89fb01db14c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407167:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e14f57b3/0xe4e6e89fb01db14c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407177:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:2.0:1788872854.407209:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788872854.407215:0:26188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee9a60b0/0xe4e6e89fb01db153 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407222:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x342:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788872854.407230:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x342:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872854.407234:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9a60b0/0xe4e6e89fb01db153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407243:0:26188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee9a60b0/0xe4e6e89fb01db153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407250:0:26188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee9a60b0/0xe4e6e89fb01db153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407257:0:26188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9a60b0/0xe4e6e89fb01db153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872854.407266:0:26188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00080000:2.0:1788872854.407479:0:26188:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:802 00010000:00010000:1.0:1788872854.407753:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:1.0:1788872854.407763:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002ec2e86/0xe4e6e89fb01db06c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407784:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449a600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.407789:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002ec2e86/0xe4e6e89fb01db06c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407798:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002ec2e86/0xe4e6e89fb01db06c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407818:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002ec2e86/0xe4e6e89fb01db06c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407824:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002ec2e86/0xe4e6e89fb01db06c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407890:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:1.0:1788872854.407895:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000178b0f77/0xe4e6e89fb01db0b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407902:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449bc00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.407906:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000178b0f77/0xe4e6e89fb01db0b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407914:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000178b0f77/0xe4e6e89fb01db0b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407925:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000178b0f77/0xe4e6e89fb01db0b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407932:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000178b0f77/0xe4e6e89fb01db0b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407944:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:1.0:1788872854.407947:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000822a2530/0xe4e6e89fb01db0c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407954:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449a200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.407957:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000822a2530/0xe4e6e89fb01db0c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407976:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000822a2530/0xe4e6e89fb01db0c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407985:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000822a2530/0xe4e6e89fb01db0c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.407991:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822a2530/0xe4e6e89fb01db0c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408002:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:1.0:1788872854.408005:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000436d41aa/0xe4e6e89fb01db0c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408010:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449a800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408013:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000436d41aa/0xe4e6e89fb01db0c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408020:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000436d41aa/0xe4e6e89fb01db0c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408028:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000436d41aa/0xe4e6e89fb01db0c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408034:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000436d41aa/0xe4e6e89fb01db0c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408056:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:1.0:1788872854.408060:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000557cf276/0xe4e6e89fb01db0ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408065:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449a000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408068:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000557cf276/0xe4e6e89fb01db0ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408075:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000557cf276/0xe4e6e89fb01db0ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408084:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000557cf276/0xe4e6e89fb01db0ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408089:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000557cf276/0xe4e6e89fb01db0ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408099:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:1.0:1788872854.408102:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8c0bc64/0xe4e6e89fb01db0d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408108:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449ae00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408111:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8c0bc64/0xe4e6e89fb01db0d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408131:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8c0bc64/0xe4e6e89fb01db0d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408141:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8c0bc64/0xe4e6e89fb01db0d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408148:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8c0bc64/0xe4e6e89fb01db0d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408161:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:1.0:1788872854.408165:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c586661b/0xe4e6e89fb01db0dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408172:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449b400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408175:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c586661b/0xe4e6e89fb01db0dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408182:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c586661b/0xe4e6e89fb01db0dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408191:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c586661b/0xe4e6e89fb01db0dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408199:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c586661b/0xe4e6e89fb01db0dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408222:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:1.0:1788872854.408225:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01db0e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408232:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449b600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408235:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01db0e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408243:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01db0e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408252:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01db0e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408258:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01db0e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408269:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:1.0:1788872854.408272:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db0ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408279:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449ac00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408282:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db0ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408298:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db0ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408308:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db0ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408315:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db0ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408325:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:1.0:1788872854.408329:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db0f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408335:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449be00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408339:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db0f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408346:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db0f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408354:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db0f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408360:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db0f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408379:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:1.0:1788872854.408382:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01db0f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408388:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449ba00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408391:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01db0f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408398:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01db0f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408407:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01db0f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408414:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01db0f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408423:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:1.0:1788872854.408426:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db0ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408432:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449b800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408435:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db0ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408450:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db0ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408459:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db0ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408466:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db0ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408475:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1788872854.408478:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3c04121/0xe4e6e89fb01db106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408484:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408487:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c04121/0xe4e6e89fb01db106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408494:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c04121/0xe4e6e89fb01db106 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408502:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3c04121/0xe4e6e89fb01db106 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408510:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3c04121/0xe4e6e89fb01db106 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408528:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1788872854.408531:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecc5105a/0xe4e6e89fb01db10d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408538:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408541:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecc5105a/0xe4e6e89fb01db10d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408567:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecc5105a/0xe4e6e89fb01db10d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408578:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecc5105a/0xe4e6e89fb01db10d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408585:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecc5105a/0xe4e6e89fb01db10d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408596:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1788872854.408599:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bf3cae1/0xe4e6e89fb01db114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408605:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408609:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf3cae1/0xe4e6e89fb01db114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408626:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf3cae1/0xe4e6e89fb01db114 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408635:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bf3cae1/0xe4e6e89fb01db114 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408642:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bf3cae1/0xe4e6e89fb01db114 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408652:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788872854.408656:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d4df0a1/0xe4e6e89fb01db11b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408663:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408666:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d4df0a1/0xe4e6e89fb01db11b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408673:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d4df0a1/0xe4e6e89fb01db11b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408681:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d4df0a1/0xe4e6e89fb01db11b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408688:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d4df0a1/0xe4e6e89fb01db11b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408708:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788872854.408711:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca7faa2b/0xe4e6e89fb01db122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408718:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.408721:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca7faa2b/0xe4e6e89fb01db122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408728:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca7faa2b/0xe4e6e89fb01db122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408737:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca7faa2b/0xe4e6e89fb01db122 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408744:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca7faa2b/0xe4e6e89fb01db122 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.408752:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788872854.408755:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003596cc7f/0xe4e6e89fb01db129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411757:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788872854.411780:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b15ce5ff/0xe4e6e89fb01db130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411794:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.411800:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15ce5ff/0xe4e6e89fb01db130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411811:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15ce5ff/0xe4e6e89fb01db130 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411830:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b15ce5ff/0xe4e6e89fb01db130 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411851:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b15ce5ff/0xe4e6e89fb01db130 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411869:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788872854.411874:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa57e70a/0xe4e6e89fb01db137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411880:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.411884:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa57e70a/0xe4e6e89fb01db137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411892:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa57e70a/0xe4e6e89fb01db137 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411900:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa57e70a/0xe4e6e89fb01db137 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411906:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa57e70a/0xe4e6e89fb01db137 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411915:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788872854.411917:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3431078/0xe4e6e89fb01db13e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411922:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.411931:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3431078/0xe4e6e89fb01db13e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411939:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3431078/0xe4e6e89fb01db13e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411947:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3431078/0xe4e6e89fb01db13e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411953:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3431078/0xe4e6e89fb01db13e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411965:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788872854.411969:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b30298b9/0xe4e6e89fb01db145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411974:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.411977:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b30298b9/0xe4e6e89fb01db145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411984:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b30298b9/0xe4e6e89fb01db145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411992:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b30298b9/0xe4e6e89fb01db145 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.411998:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b30298b9/0xe4e6e89fb01db145 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.412014:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872854.412018:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e14f57b3/0xe4e6e89fb01db14c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.412025:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.412028:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e14f57b3/0xe4e6e89fb01db14c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.412035:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e14f57b3/0xe4e6e89fb01db14c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.412044:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e14f57b3/0xe4e6e89fb01db14c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.412050:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e14f57b3/0xe4e6e89fb01db14c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.412059:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872854.412062:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee9a60b0/0xe4e6e89fb01db153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.412068:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872854.412071:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee9a60b0/0xe4e6e89fb01db153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.412089:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee9a60b0/0xe4e6e89fb01db153 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.412100:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee9a60b0/0xe4e6e89fb01db153 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.412107:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee9a60b0/0xe4e6e89fb01db153 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872854.412119:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.412121:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872854.412123:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872854.412177:0:92475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df457b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92475:1875765327782656:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788872854.412193:0:92475:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x361:0x0] from OST, last_created [0x2c0000401:0x361:0x0]last_used is [0x2c0000401:0x322:0x0] 00000100:00100000:3.0:1788872854.412261:0:92475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df454e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92475:1875765327783168:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788872854.412318:0:92475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872854.412348:0:92475:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e1c75c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872854.412417:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327783040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872854.412442:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872854.412522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00010000:00010000:3.0:1788872854.412541:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788872854.412755:0:8437:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:803 00000100:00100000:3.0:1788872854.412819:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:92473:x1875765327782528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 57067us (57402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872854.412839:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5987 00000100:00100000:3.0:1788872854.412880:0:92473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df456a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92473:1875765327782528:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788872854.412889:0:92473:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x361:0x0] from OST, last_created [0x280000401:0x361:0x0]last_used is [0x280000401:0x323:0x0] 00000100:00100000:3.0:1788872854.412931:0:92473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df456300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92473:1875765327783424:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788872854.412954:0:92473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872854.412971:0:92473:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e1c75000 going to sleep for 11 seconds 00000100:00100000:3.0:1788872854.412984:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327783296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872854.413007:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872854.413041:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327783168 00000100:00100000:3.0:1788872854.413047:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327783168 00000100:00100000:3.0:1788872854.413079:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327783424 00000100:00100000:3.0:1788872854.413083:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327783424 00000100:00100000:3.0:1788872854.413104:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5991 00000100:00100000:3.0:1788872854.413112:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:92475:x1875765327783168:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788872854.413151:0:14545:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 866 00010000:00010000:1.0:1788872854.414711:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872854.414719:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003596cc7f/0xe4e6e89fb01db129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.414744:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003596cc7f/0xe4e6e89fb01db129 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.414763:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003596cc7f/0xe4e6e89fb01db129 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.414781:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003596cc7f/0xe4e6e89fb01db129 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872854.414802:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872854.414803:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872854.414806:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872854.415163:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:92475:x1875765327782656:12345-0@lo:5:osp-pre-1-0.0 Request processed in 38357us (52061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872854.415177:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5988 00000100:00100000:2.0:1788872854.415208:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5992 00000100:00100000:2.0:1788872854.415219:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:92473:x1875765327783424:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788872854.415261:0:26188:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 866 00000100:00100000:2.0:1788872854.416713:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:92473:x1875765327783424:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1493us (3753us total) trans 4294969454 rc 0/0 00000100:00100000:2.0:1788872854.416723:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5992 00000100:00100000:1.0:1788872854.416901:0:92473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df456300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92473:1875765327783424:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788872854.416915:0:92473:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x361:0x0]-[0x280000401:0x381:0x0] 00000100:00100000:0.0:1788872854.417823:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327783040 00000100:00100000:0.0:1788872854.417833:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327783040 00000100:00100000:0.0:1788872854.417871:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327783296 00000100:00100000:0.0:1788872854.417874:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327783296 00000100:00100000:0.0:1788872854.417890:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:0.0:1788872854.417898:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875765327783040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872854.417931:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 896 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872854.417989:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875765327783040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (5545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872854.417996:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000100:00100000:0.0:1788872854.418008:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:0.0:1788872854.418014:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327783296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872854.418024:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872854.418051:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327783296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (5043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872854.418057:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:00100000:0.0:1788872854.418078:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311204096 00000100:00100000:0.0:1788872854.418081:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311204096 00000100:00100000:0.0:1788872854.418106:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 232 00000100:00100000:0.0:1788872854.418112:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+10:71107:x1875765311204096:12345-192.168.204.39@tcp:35:cp.0 00000001:00080000:0.0:1788872854.418307:0:80566:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 77309411446 00000100:00100000:0.0:1788872854.418389:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+12:71107:x1875765311204096:12345-192.168.204.39@tcp:35:cp.0 Request processed in 276us (5868us total) trans 77309411447 rc 0/0 00000100:00100000:0.0:1788872854.418396:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 232 00000020:00080000:0.0:1788872854.418400:0:80566:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788872854.418688:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327783040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872854.418736:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327783296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788872854.423624:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788872854.423754:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788872854.431825:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969455 is committed 00000100:00100000:3.0:1788872854.432054:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:92475:x1875765327783168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18937us (19730us total) trans 4294969455 rc 0/0 00000100:00100000:3.0:1788872854.432067:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5991 00000100:00100000:3.0:1788872854.432126:0:92475:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969455 gen 2 00000100:00100000:3.0:1788872854.432136:0:92475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df454e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92475:1875765327783168:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788872854.432154:0:92475:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x361:0x0]-[0x2c0000401:0x381:0x0] 00010000:00010000:3.0:1788872854.842336:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788872855.066301:0:92792:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788872855.066507:0:92792:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788872855.869967:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788872856.124038:0:92842:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788872856.124258:0:92842:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788872856.301429:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872856.301528:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311204224 00000100:00100000:1.0:1788872856.301538:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311204224 00000100:00100000:1.0:1788872856.301689:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1360 00000100:00100000:1.0:1788872856.301701:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+7:71376:x1875765311204224:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:1.0:1788872856.301722:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872856.301768:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db15a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0e1 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788872856.301868:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788872856.304397:0:66192:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2575us 00010000:00010000:1.0:1788872856.320090:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db161 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.320119:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db161 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.320134:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db161 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.320149:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db168 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.320157:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.320164:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872856.320383:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66192:1875765327783552:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788872856.320459:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872856.320500:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872856.321402:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327783552 00000100:00100000:0.0:1788872856.321412:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327783552 00000100:00100000:0.0:1788872856.321467:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:0.0:1788872856.321482:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66192:x1875765327783552:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788872856.321610:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66192:x1875765327783552:12345-0@lo:1000:mdt00_001.0 Request processed in 128us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872856.321618:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00000100:00100000:1.0:1788872856.321702:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66192:1875765327783552:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788872856.321768:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db16f lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321781:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db16f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321791:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db16f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872856.321824:0:66192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db16f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321845:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db161 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321852:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db161 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321858:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db161 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321864:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db161 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321870:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872856.321875:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db161 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321882:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db161 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321894:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:1.0:1788872856.321897:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872856.321902:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db161 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321909:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db161 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321921:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321927:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db168 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321938:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db168 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321944:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872856.321947:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db168 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321953:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db168 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321962:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff98a9d14a2700) 00010000:00010000:1.0:1788872856.321964:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872856.321968:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db168 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.321974:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db168 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.322012:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db15a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0e1 expref: 9 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.322026:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db16f lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0e1 expref: 8 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.322033:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9d14a2b00) 00010000:00010000:1.0:1788872856.322035:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788872856.322038:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c400, rc 0) 00000100:00100000:1.0:1788872856.322096:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71376:x1875765311204224:12345-192.168.204.39@tcp:101:rm.0 Request processed in 20397us (20678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872856.322112:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1360 00000100:00100000:0.0:1788872856.329360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872856.339941:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311204352 00000100:00100000:3.0:1788872856.339956:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311204352 00000100:00100000:3.0:1788872856.340694:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1361 00000100:00100000:3.0:1788872856.340706:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+12:71376:x1875765311204352:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:3.0:1788872856.340744:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872856.340769:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01db176 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0e8 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.340834:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5000/0xe4e6e89fb01db17d lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.340851:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5000/0xe4e6e89fb01db17d lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.340866:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5000/0xe4e6e89fb01db17d lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872856.340917:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1788872856.340921:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788872856.340959:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01db176 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0e8 expref: 14 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.340975:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5000/0xe4e6e89fb01db17d lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0e8 expref: 13 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.340984:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9d1f7ab00) 00010000:00010000:3.0:1788872856.340987:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788872856.340991:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5000, rc 0) 00000100:00100000:3.0:1788872856.341058:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+13:71376:x1875765311204352:12345-192.168.204.39@tcp:101:rm.0 Request processed in 353us (11707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872856.341073:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1361 00000100:00080000:1.0:1788872856.341245:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872856.345204:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872856.353634:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311204608 00000100:00100000:1.0:1788872856.353651:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311204608 00000100:00100000:1.0:1788872856.353717:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1362 00000100:00100000:1.0:1788872856.353728:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+13:71376:x1875765311204608:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:1.0:1788872856.353759:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872856.353787:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db184 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0ef expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872856.353903:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1788872856.354022:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db184 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0ef expref: 15 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.354037:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9d14a2700) 00010000:00010000:1.0:1788872856.354040:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788872856.354044:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db184 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0ef expref: 15 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.354060:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9cc00, rc 0) 00000100:00100000:1.0:1788872856.354125:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+14:71376:x1875765311204608:12345-192.168.204.39@tcp:101:rm.0 Request processed in 398us (8930us total) trans 77309411448 rc 301/301 00000100:00100000:1.0:1788872856.354131:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1362 00000100:00100000:1.0:1788872856.359762:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872856.362234:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311204736 00000100:00100000:2.0:1788872856.362250:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311204736 00000100:00100000:2.0:1788872856.362349:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 233 00000100:00100000:2.0:1788872856.362360:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0950050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+14:71376:x1875765311204736:12345-192.168.204.39@tcp:37:rm.0 00000100:00100000:3.0:1788872856.371857:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0950050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+14:71376:x1875765311204736:12345-192.168.204.39@tcp:37:rm.0 Request processed in 9487us (12093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872856.371873:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 233 00000100:00100000:0.0:1788872856.376186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872856.376351:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311204992 00000100:00100000:2.0:1788872856.376361:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311204992 00000100:00100000:2.0:1788872856.376452:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 234 00000100:00100000:2.0:1788872856.376464:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+14:71376:x1875765311204992:12345-192.168.204.39@tcp:35:rm.0 00000100:00100000:2.0:1788872856.376745:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+15:71376:x1875765311204992:12345-192.168.204.39@tcp:35:rm.0 Request processed in 283us (569us total) trans 77309411449 rc 0/0 00000100:00100000:2.0:1788872856.376753:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 234 00000100:00100000:1.0:1788872856.379430:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872856.379511:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311205248 00000100:00100000:0.0:1788872856.379524:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311205248 00000100:00100000:0.0:1788872856.379625:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1363 00000100:00100000:0.0:1788872856.379635:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+15:71376:x1875765311205248:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:0.0:1788872856.379659:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872856.379689:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae400/0xe4e6e89fb01db192 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0f6 expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.380349:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db199 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.380412:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db199 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.380426:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db199 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872856.380439:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1788872856.383605:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae400/0xe4e6e89fb01db192 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0f6 expref: 18 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.383661:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db199 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0f6 expref: 17 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.383691:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9d1f7ab00) 00010000:00010000:0.0:1788872856.383694:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788872856.383698:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af000, rc 0) 00000100:00100000:0.0:1788872856.383785:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+17:71376:x1875765311205248:12345-192.168.204.39@tcp:101:rm.0 Request processed in 4150us (4363us total) trans 77309411450 rc 0/0 00000100:00100000:0.0:1788872856.383794:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1363 00000100:00100000:0.0:1788872856.395785:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872856.395911:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311205376 00000100:00100000:3.0:1788872856.395922:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311205376 00000100:00100000:3.0:1788872856.395994:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1364 00000100:00100000:3.0:1788872856.396005:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+17:71376:x1875765311205376:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:3.0:1788872856.396031:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872856.396055:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01db1a7 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb0fd expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.396137:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01db1ae lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.396151:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01db1ae lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.396163:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01db1ae lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872856.396217:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00000004:00200000:3.0:1788872856.396222:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872856.396241:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01db1ae lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.396266:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01db1a7 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0fd expref: 19 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.396303:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01db1ae lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0fd expref: 18 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.396312:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a8ca102100) 00010000:00010000:3.0:1788872856.396315:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872856.396318:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4a00, rc 0) 00000100:00100000:3.0:1788872856.396370:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+18:71376:x1875765311205376:12345-192.168.204.39@tcp:101:rm.0 Request processed in 367us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872856.396376:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1364 00000100:00100000:2.0:1788872856.409586:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872856.409783:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311205632 00000100:00100000:1.0:1788872856.409808:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311205632 00000100:00100000:1.0:1788872856.409859:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1365 00000100:00100000:1.0:1788872856.409869:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+18:71376:x1875765311205632:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:1.0:1788872856.409890:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872856.409911:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db1b5 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb104 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872856.410016:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1788872856.410138:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db1b5 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb104 expref: 20 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.410155:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9d1f7ab00) 00010000:00010000:1.0:1788872856.410158:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788872856.410163:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01db1b5 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb104 expref: 20 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.410177:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d400, rc 0) 00000100:00100000:1.0:1788872856.410695:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+19:71376:x1875765311205632:12345-192.168.204.39@tcp:101:rm.0 Request processed in 825us (1152us total) trans 77309411451 rc 301/301 00000100:00100000:1.0:1788872856.410703:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1365 00000100:00100000:1.0:1788872856.414004:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872856.414099:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311205760 00000100:00100000:3.0:1788872856.414111:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311205760 00000100:00100000:3.0:1788872856.414175:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 235 00000100:00100000:3.0:1788872856.414187:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+19:71376:x1875765311205760:12345-192.168.204.39@tcp:37:rm.0 00000100:00100000:2.0:1788872856.428694:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+19:71376:x1875765311205760:12345-192.168.204.39@tcp:37:rm.0 Request processed in 14498us (14690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872856.428707:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 235 00000100:00100000:0.0:1788872856.432702:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872856.432830:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311206016 00000100:00100000:2.0:1788872856.432841:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311206016 00000100:00100000:2.0:1788872856.432900:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 236 00000100:00100000:2.0:1788872856.432910:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+19:71376:x1875765311206016:12345-192.168.204.39@tcp:35:rm.0 00000100:00100000:2.0:1788872856.433290:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+20:71376:x1875765311206016:12345-192.168.204.39@tcp:35:rm.0 Request processed in 379us (595us total) trans 77309411452 rc 0/0 00000100:00100000:2.0:1788872856.433300:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 236 00000100:00100000:1.0:1788872856.436178:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872856.436446:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311206272 00000100:00100000:2.0:1788872856.436457:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311206272 00000100:00100000:2.0:1788872856.436529:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1366 00000100:00100000:2.0:1788872856.436541:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+20:71376:x1875765311206272:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:2.0:1788872856.436609:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872856.436631:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1c3 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb10b expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.436747:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899000/0xe4e6e89fb01db1ca lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.436763:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899000/0xe4e6e89fb01db1ca lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.436774:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899000/0xe4e6e89fb01db1ca lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872856.436786:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1788872856.436898:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1c3 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb10b expref: 23 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.436921:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899000/0xe4e6e89fb01db1ca lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb10b expref: 22 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.436931:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a8ca102100) 00010000:00010000:2.0:1788872856.436935:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788872856.436938:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899000, rc 0) 00000100:00100000:2.0:1788872856.437003:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+22:71376:x1875765311206272:12345-192.168.204.39@tcp:101:rm.0 Request processed in 454us (824us total) trans 77309411453 rc 0/0 00000100:00100000:2.0:1788872856.437012:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1366 00000100:00100000:0.0:1788872856.439754:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872856.439838:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311206400 00000100:00100000:3.0:1788872856.439848:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311206400 00000100:00100000:3.0:1788872856.439899:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1367 00000100:00100000:3.0:1788872856.439909:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71376:x1875765311206400:12345-192.168.204.39@tcp:41:rm.0 00000004:00000024:3.0:1788872856.439963:0:66979:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382962176 00000100:00100000:3.0:1788872856.440048:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71376:x1875765311206400:12345-192.168.204.39@tcp:41:rm.0 Request processed in 140us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872856.440055:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1367 00000100:00100000:1.0:1788872856.443064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872856.443145:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311206656 00000100:00100000:2.0:1788872856.443155:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311206656 00000100:00100000:2.0:1788872856.443209:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1368 00000100:00100000:2.0:1788872856.443242:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+22:71376:x1875765311206656:12345-192.168.204.39@tcp:36:rm.0 00010000:00010000:2.0:1788872856.443309:0:66193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788872856.443335:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b000/0xe4e6e89fb01daf77 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0cc expref: 22 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443356:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff98a9d1dc7e00) 00010000:00010000:2.0:1788872856.443371:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01db1ae lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0fd expref: 21 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443381:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a8ca102100) 00010000:00010000:2.0:1788872856.443385:0:66193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872856.443408:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1d8 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443422:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1d8 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443432:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1d8 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443442:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898600/0xe4e6e89fb01db1df lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443450:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898600/0xe4e6e89fb01db1df lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443456:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898600/0xe4e6e89fb01db1df lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443601:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db1e6 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443616:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db1e6 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443625:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db1e6 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788872856.443854:0:66193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x48:0x0].2, 64 off8320 00000004:00080000:2.0:1788872856.443864:0:66193:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3793570313619ns, next at 3794570311529ns, rc = 0 00010000:00010000:2.0:1788872856.443906:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db1ed lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443915:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db1ed lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443924:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db1ed lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443932:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db1ed lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443939:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db1ed lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443945:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db1ed lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443962:0:66193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872856.443978:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db1e6 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443985:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db1e6 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.443996:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db1e6 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444004:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872856.444008:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db1e6 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444016:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db1e6 lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444026:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff98a9efbc5500) 00010000:00010000:2.0:1788872856.444029:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788872856.444032:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db1e6 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444039:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db1e6 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444055:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1d8 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444062:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1d8 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444068:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1d8 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444075:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1d8 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444080:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872856.444087:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1d8 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444094:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1d8 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444102:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a8ca102100) 00010000:00010000:2.0:1788872856.444104:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872856.444107:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1d8 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444114:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db1d8 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872856.444122:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6a4c335 reply state 00000000f8347534 transno 77309411454 ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898600/0xe4e6e89fb01db1df lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444132:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898600/0xe4e6e89fb01db1df lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.444139:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xb1bed465 (ffff98a9d1dc7600) 00010000:00010000:2.0:1788872856.444141:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872856.444144:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872856.444207:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+22:71376:x1875765311206656:12345-192.168.204.39@tcp:36:rm.0 Request processed in 966us (1153us total) trans 77309411454 rc 0/0 00000100:00100000:2.0:1788872856.444216:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1368 00010000:00010000:1.0:1788872856.444470:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872856.444477:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db1ed lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.444485:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872856.444494:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db1ed lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.444501:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db1ed lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.444522:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff98a9efbc5500) 00010000:00010000:1.0:1788872856.444525:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788872856.444528:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db1ed lrc: 1/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.444534:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db1ed lrc: 0/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.444575:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872856.444577:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872856.444579:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872856.447441:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872856.447511:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311206912 00000100:00100000:2.0:1788872856.447529:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311206912 00000100:00100000:2.0:1788872856.447611:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 237 00000100:00100000:2.0:1788872856.447622:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+22:71376:x1875765311206912:12345-192.168.204.39@tcp:35:rm.0 00000100:00100000:2.0:1788872856.447849:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+23:71376:x1875765311206912:12345-192.168.204.39@tcp:35:rm.0 Request processed in 228us (417us total) trans 77309411455 rc 0/0 00000100:00100000:2.0:1788872856.447870:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 237 00000100:00100000:0.0:1788872856.450087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872856.450170:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311207168 00000100:00100000:2.0:1788872856.450179:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311207168 00000100:00100000:2.0:1788872856.450242:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1369 00000100:00100000:2.0:1788872856.450252:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+23:71376:x1875765311207168:12345-192.168.204.39@tcp:36:rm.0 00010000:00010000:2.0:1788872856.450309:0:66192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788872856.450337:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899000/0xe4e6e89fb01db1ca lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb10b expref: 23 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450359:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dacde lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb09b expref: 22 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450370:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a8ca102100) 00010000:00010000:2.0:1788872856.450388:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5000/0xe4e6e89fb01db17d lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0e8 expref: 21 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450397:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9d1f7ab00) 00010000:00010000:2.0:1788872856.450400:0:66192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872856.450425:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db1f4 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450439:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db1f4 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450449:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db1f4 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450463:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898200/0xe4e6e89fb01db1fb lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450483:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898200/0xe4e6e89fb01db1fb lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450490:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898200/0xe4e6e89fb01db1fb lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450632:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db202 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450642:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db202 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450649:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db202 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872856.450879:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1788872856.450894:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db202 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450901:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db202 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450907:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db202 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450913:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872856.450917:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db202 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450924:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db202 lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450944:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff98a9efbc5f00) 00010000:00010000:2.0:1788872856.450946:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788872856.450950:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db202 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450957:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db202 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450977:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db1f4 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450983:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db1f4 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450989:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db1f4 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450994:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db1f4 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.450999:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872856.451002:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db1f4 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.451007:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db1f4 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.451015:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9d1f7ab00) 00010000:00010000:2.0:1788872856.451017:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872856.451019:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db1f4 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.451034:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db1f4 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872856.451044:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001702335b reply state 000000009d3a71f7 transno 77309411456 ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898200/0xe4e6e89fb01db1fb lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.451055:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898200/0xe4e6e89fb01db1fb lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.451061:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff98a9efbc5600) 00010000:00010000:2.0:1788872856.451063:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872856.451066:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872856.451128:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+22:71376:x1875765311207168:12345-192.168.204.39@tcp:36:rm.0 Request processed in 877us (1048us total) trans 77309411456 rc 0/0 00000100:00100000:2.0:1788872856.451134:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1369 00000100:00100000:0.0:1788872856.454789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872856.454877:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311207296 00000100:00100000:2.0:1788872856.454887:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311207296 00000100:00100000:2.0:1788872856.454949:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 729 00000100:00100000:2.0:1788872856.454960:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df457b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2404:x1875765311207296:12345-192.168.204.39@tcp:103:rm.0 00010000:00010000:2.0:1788872856.454977:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872856.455015:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db16f lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0e1 expref: 8 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.455032:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9d14a2b00) 00010000:00010000:2.0:1788872856.455043:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872856.455106:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df457b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311207296:12345-192.168.204.39@tcp:103:rm.0 Request processed in 148us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872856.455131:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 729 00000100:00100000:1.0:1788872856.457141:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872856.457212:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311207552 00000100:00100000:2.0:1788872856.457220:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311207552 00000100:00100000:2.0:1788872856.457272:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 238 00000100:00100000:2.0:1788872856.457282:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+22:71376:x1875765311207552:12345-192.168.204.39@tcp:35:rm.0 00000100:00100000:2.0:1788872856.457501:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+23:71376:x1875765311207552:12345-192.168.204.39@tcp:35:rm.0 Request processed in 219us (367us total) trans 77309411457 rc 0/0 00000100:00100000:2.0:1788872856.457510:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 238 00000100:00100000:1.0:1788872856.460506:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872856.460696:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311207808 00000100:00100000:3.0:1788872856.460707:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311207808 00000100:00100000:3.0:1788872856.460775:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1370 00000100:00100000:3.0:1788872856.460785:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+23:71376:x1875765311207808:12345-192.168.204.39@tcp:36:rm.0 00010000:00010000:3.0:1788872856.460861:0:66979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788872856.460890:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db199 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0f6 expref: 23 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.460913:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dacc2 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb094 expref: 22 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.460927:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9d1f7ab00) 00010000:00010000:3.0:1788872856.460938:0:66979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872856.460986:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.461142:0:66979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.461155:0:66979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872856.461178:0:66979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66979:1875765327783680:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1788872856.461244:0:66979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872856.461280:0:66979:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56e29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872856.461328:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327783680 00000100:00100000:2.0:1788872856.461333:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327783680 00000100:00100000:2.0:1788872856.461383:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:2.0:1788872856.461391:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66979:x1875765327783680:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1788872856.461401:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872856.461416:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db210 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db209 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.461439:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01daf46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb086 expref: 6 pid: 92487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.461448:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db210 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db209 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.461471:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01daf46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb086 expref: 6 pid: 92487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.461484:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01daf46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb086 expref: 6 pid: 92487 timeout: 3893 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872856.461504:0:8447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8447:1875765327783808:192.168.204.39@tcp:104: 00000100:00100000:2.0:1788872856.461621:0:8447:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872856.465038:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872856.465175:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311207936 00000100:00100000:3.0:1788872856.465184:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311207936 00010000:00010000:3.0:1788872856.465231:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01daf46 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb086 expref: 7 pid: 92487 timeout: 3893 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872856.465274:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2564 00000100:00100000:3.0:1788872856.465284:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311207936:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788872856.465321:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872856.465329:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01daf46 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb086 expref: 7 pid: 92487 timeout: 3893 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.465344:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01daf46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb086 expref: 7 pid: 92487 timeout: 3893 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.465372:0:19657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:3.0:1788872856.465378:0:19657:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db210 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db209 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.465391:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db210 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xe4e6e89fb01db209 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.465400:0:19657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db210 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xe4e6e89fb01db209 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.465436:0:19657:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db210 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db209 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872856.465451:0:19657:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19657:1875765327783936:0@lo:105: 00000100:00100000:3.0:1788872856.465497:0:19657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872856.465581:0:19657:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5492780 going to sleep for 11 seconds 00010000:00010000:2.0:1788872856.465847:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5aa00/0xe4e6e89fb01daf46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb086 expref: 7 pid: 92487 timeout: 3893 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872856.465862:0:8447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8447:1875765327783808:192.168.204.39@tcp:104: 00010000:00010000:2.0:1788872856.465888:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db210 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db209 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.465896:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:2.0:1788872856.465898:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872856.465901:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa898400, rc 0) 00000100:00100000:2.0:1788872856.465950:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66979:x1875765327783680:12345-0@lo:101:mdt00_003.0 Request processed in 4560us (4705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872856.465958:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:1.0:1788872856.466171:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327783936 00000100:00100000:1.0:1788872856.466178:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327783936 00000100:00100000:1.0:1788872856.466227:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788872856.466235:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19657:x1875765327783936:12345-0@lo:105: 00010000:00010000:1.0:1788872856.466246:0:13343:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.466255:0:13343:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.466278:0:13343:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.466286:0:13343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.466292:0:13343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.466301:0:13343:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872856.466314:0:13343:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff98a9efac4c00) 00000100:00100000:1.0:1788872856.466358:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19657:x1875765327783936:12345-0@lo:105: Request processed in 124us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872856.466365:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788872856.466433:0:19657:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19657:1875765327783936:0@lo:105: 00010000:00010000:0.0:1788872856.466445:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872856.466494:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2405:x1875765311207936:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 1211us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872856.466503:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2564 00000100:00100000:3.0:1788872856.467222:0:66979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66979:1875765327783680:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1788872856.467254:0:66979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788872856.467289:0:66979:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788872856.467330:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4800/0xe4e6e89fb01db217 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.467336:0:66979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4800/0xe4e6e89fb01db217 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.467346:0:66979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4800/0xe4e6e89fb01db217 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872856.467362:0:66979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66979:1875765327784064:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1788872856.467399:0:66979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872856.467421:0:66979:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5492240 going to sleep for 11 seconds 00000100:00100000:0.0:1788872856.467484:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327784064 00000100:00100000:0.0:1788872856.467489:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327784064 00000100:00100000:0.0:1788872856.467537:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:0.0:1788872856.467545:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66979:x1875765327784064:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788872856.467590:0:23717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872856.467607:0:23717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db21e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db217 expref: -99 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.467629:0:23717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db21e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db217 expref: 10 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.467649:0:23717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db21e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db217 expref: 10 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.467657:0:23717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff98a9c2bf9900) 00010000:00010000:0.0:1788872856.467660:0:23717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872856.467662:0:23717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52ae800, rc 0) 00000100:00100000:0.0:1788872856.467717:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66979:x1875765327784064:12345-0@lo:101:mdt00_003.0 Request processed in 173us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872856.467723:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00000100:00100000:3.0:1788872856.467905:0:66979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66979:1875765327784064:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1788872856.467918:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4800/0xe4e6e89fb01db217 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db21e expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.467927:0:66979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4800/0xe4e6e89fb01db217 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db21e expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788872856.467941:0:66979:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1788872856.467978:0:66979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66979:1875765327784192:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788872856.468021:0:66979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872856.468038:0:66979:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5492d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872856.468332:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327784192 00000100:00100000:0.0:1788872856.468337:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327784192 00000100:00100000:0.0:1788872856.468376:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:0.0:1788872856.468384:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66979:x1875765327784192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788872856.468472:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66979:x1875765327784192:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872856.468480:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00000100:00100000:3.0:1788872856.468741:0:66979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66979:1875765327784192:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788872856.468790:0:66979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66979:1875765327784320:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788872856.468836:0:66979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872856.468849:0:66979:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5492d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872856.469096:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327784320 00000100:00100000:0.0:1788872856.469101:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327784320 00000100:00100000:0.0:1788872856.469133:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:0.0:1788872856.469140:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66979:x1875765327784320:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788872856.469352:0:66979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66979:1875765327784320:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788872856.469405:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.469415:0:66979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.469423:0:66979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872856.469436:0:66979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66979:1875765327784448:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1788872856.470429:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66979:x1875765327784320:12345-0@lo:1000:mdt00_003.0 Request processed in 1282us (1585us total) trans 0 rc 1/1 00000100:00100000:0.0:1788872856.470441:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:1.0:1788872856.470507:0:66979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872856.470718:0:66979:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5492240 going to sleep for 11 seconds 00000100:00100000:1.0:1788872856.470816:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327784448 00000100:00100000:1.0:1788872856.470824:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327784448 00000100:00100000:3.0:1788872856.470878:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:3.0:1788872856.470888:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66979:x1875765327784448:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1788872856.470905:0:30614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872856.470935:0:30614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db22c lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db225 expref: -99 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.470966:0:30614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db22c lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db225 expref: 11 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.470981:0:30614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db22c lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db225 expref: 11 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.470989:0:30614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9f016a300) 00010000:00010000:3.0:1788872856.471090:0:30614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788872856.471096:0:30614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5400, rc 0) 00000100:00100000:3.0:1788872856.471157:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66979:x1875765327784448:12345-0@lo:101:mdt00_003.0 Request processed in 271us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872856.471163:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00000100:00100000:0.0:1788872856.471250:0:66979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66979:1875765327784448:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788872856.471267:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db22c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.471285:0:66979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db22c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.471319:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db233 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.471329:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db233 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.471338:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db233 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788872856.471909:0:66979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].3, 432 off36352 00000040:00080000:0.0:1788872856.471959:0:66979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x2:0x0].3, 512 off36784 00000004:00080000:0.0:1788872856.471965:0:66979:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98a9ef3dbf00 with version 11 00000004:00080000:2.0:1788872856.472481:0:75625:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98a8c5c4f240 version 11 rpc_version 11 00000020:00100000:2.0:1788872856.472656:0:75625:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788872856.472667:0:75625:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98a8c4a16a00 x1875765327784704/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872856.472693:0:75625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327784704:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788872856.472764:0:75625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872856.472834:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73f6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872856.472885:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327784704 00000100:00100000:1.0:1788872856.472892:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327784704 00000100:00100000:1.0:1788872856.472971:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00100000:1.0:1788872856.472979:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fbfc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75625:x1875765327784704:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788872856.475985:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fbfc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75625:x1875765327784704:12345-0@lo:1000:osp_up0-1.0 Request processed in 2998us (3212us total) trans 120259084290 rc 0/0 00000100:00100000:1.0:1788872856.476160:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00000100:00100000:2.0:1788872856.476715:0:75625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327784704:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1788872856.476808:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1788872856.476832:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db233 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.476842:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db233 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.476850:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db233 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.476857:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872856.476862:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db233 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.476870:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db233 lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.476893:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9c2bf9c00) 00010000:00010000:0.0:1788872856.476896:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872856.476901:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db233 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.476908:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db233 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.476929:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db22c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.476938:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db22c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.476946:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db22c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.477071:0:66979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788872856.477087:0:66979:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788872856.477094:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.477102:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.477109:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.480459:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872856.480474:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01db22c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872856.480487:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5200 already unused, calling callback (ffffffffc19e46f0) 00010000:00010000:3.0:1788872856.480494:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01db22c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872856.480504:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01db22c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.480740:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db22c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.480762:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872856.480801:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 1/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db22c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.480809:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac5200/0xe4e6e89fb01db225 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db22c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.480830:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872856.480834:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.480840:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4c00 already unused, calling callback (ffffffffc19e46f0) 00010000:00010000:2.0:1788872856.480844:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872856.480850:0:6508:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.480872:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.480878:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872856.480892:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.480900:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872856.480904:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872856.480906:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872856.480968:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327784832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872856.481047:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872856.481110:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327784960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872856.481136:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872856.481176:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327784832 00000100:00100000:3.0:1788872856.481183:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327784832 00000100:00100000:3.0:1788872856.481369:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327784960 00000100:00100000:3.0:1788872856.481372:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327784960 00010000:00010000:0.0:1788872856.481442:0:66979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788872856.481456:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4c00/0xe4e6e89fb01db209 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db210 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788872856.481474:0:66979:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788872856.481492:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4800/0xe4e6e89fb01db217 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db21e expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872856.481499:0:66979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4800/0xe4e6e89fb01db217 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db21e expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872856.481606:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+22:71376:x1875765311207808:12345-192.168.204.39@tcp:36:rm.0 Request processed in 20819us (21105us total) trans 77309411458 rc 0/0 00000100:00100000:0.0:1788872856.481615:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1370 00000100:00100000:2.0:1788872856.487157:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1788872856.487178:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3647:x1875765327784832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872856.487199:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872856.487325:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db22c lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db225 expref: 13 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.487347:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff98a9f016a300) 00010000:00010000:2.0:1788872856.487359:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872856.487491:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3647:x1875765327784832:12345-0@lo:103:ldlm_bl.0 Request processed in 320us (6443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872856.487500:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1788872856.487592:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1788872856.487600:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3644:x1875765327784960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872856.487608:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872856.487620:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db210 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db209 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872856.487631:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:2.0:1788872856.487635:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872856.487667:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3644:x1875765327784960:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (6532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872856.487674:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00010000:00010000:3.0:1788872856.489283:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872856.489885:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327784960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872856.491869:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327784832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872856.894316:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872857.359171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872857.359246:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872857.359280:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872857.359309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872857.359337:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311208320 00000100:00100000:1.0:1788872857.359347:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311208320 00000100:00100000:1.0:1788872857.359401:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311208192 00000100:00100000:1.0:1788872857.359404:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311208192 00000100:00100000:1.0:1788872857.359428:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1361 00000100:00100000:1.0:1788872857.359439:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+22:2404:x1875765311208320:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872857.359529:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+22:2404:x1875765311208320:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872857.359537:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1361 00000100:00100000:1.0:1788872857.359573:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1362 00000100:00100000:1.0:1788872857.359580:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2404:x1875765311208192:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872857.359607:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2404:x1875765311208192:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872857.359613:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1362 00000100:00100000:1.0:1788872857.359648:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311208448 00000100:00100000:1.0:1788872857.359652:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311208448 00000100:00100000:1.0:1788872857.359686:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2675 00000100:00100000:1.0:1788872857.359693:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2404:x1875765311208448:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872857.359732:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2404:x1875765311208448:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 39us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872857.359737:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2675 00000100:00080000:1.0:1788872857.359942:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872857.361291:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311208064 00000100:00100000:2.0:1788872857.361300:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311208064 00000100:00100000:2.0:1788872857.361384:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 72 00000100:00100000:2.0:1788872857.361393:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311208064:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872857.361471:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311208064:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 78us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872857.361478:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 72 00010000:00010000:1.0:1788872857.912664:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872858.937836:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788872859.320733:0:75629:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3796447181452ns, next at 3797447178696ns, rc = 0 00000100:00100000:1.0:1788872859.321560:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327785216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872859.321722:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872859.321801:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872859.321812:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327785216 00000100:00100000:3.0:1788872859.321816:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327785088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872859.321834:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327785216 00000100:00100000:3.0:1788872859.321858:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872859.321889:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00100000:1.0:1788872859.321899:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3646:x1875765327785216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788872859.321940:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445105664 avail 1298866176 00000100:00100000:3.0:1788872859.321970:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327785088 00000100:00100000:3.0:1788872859.321976:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327785088 00000100:00100000:1.0:1788872859.321989:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3646:x1875765327785216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872859.321996:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00000100:00100000:3.0:1788872859.322026:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00080000:1.0:1788872859.322026:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872859.322053:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327785088:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872859.322068:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327785216:0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1788872859.322082:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872859.322124:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327785088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.322131:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:3.0:1788872859.322162:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327785088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872859.324475:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327785600:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.324542:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872859.324659:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327785344:0@lo:400:kworker.0 00000100:00100000:0.0:1788872859.324710:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872859.324768:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327785856:0@lo:400:kworker.0 00000100:00100000:0.0:1788872859.324799:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327785344 00000100:00100000:0.0:1788872859.324806:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327785344 00000100:00100000:0.0:1788872859.324863:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788872859.324870:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327785344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872859.324921:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327785344:12345-0@lo:400:kworker.0 Request processed in 52us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872859.324927:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788872859.325096:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327786112:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.325120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872859.325135:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1c9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327786624:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.325155:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872859.325176:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788872859.325183:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327785472:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.325203:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872859.325220:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327785984:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.325242:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872859.325276:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1c9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327786496:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.325366:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872859.325404:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327785600 00000100:00100000:1.0:1788872859.325408:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327785600 00000100:00100000:1.0:1788872859.325447:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327786112 00000100:00100000:1.0:1788872859.325450:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327786112 00000100:00100000:1.0:1788872859.325467:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327786624 00000100:00100000:1.0:1788872859.325470:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327786624 00000100:00100000:1.0:1788872859.325481:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327785472 00000100:00100000:1.0:1788872859.325483:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327785472 00000100:00100000:1.0:1788872859.325496:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:1.0:1788872859.325502:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327785600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.325542:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327785600:12345-0@lo:400:kworker.0 Request processed in 39us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872859.325569:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:3.0:1788872859.325757:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:3.0:1788872859.325766:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327786112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.325802:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327786112:12345-0@lo:400:kworker.0 Request processed in 38us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.325808:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:3.0:1788872859.325832:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:3.0:1788872859.325838:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327786624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.325864:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327786624:12345-0@lo:400:kworker.0 Request processed in 26us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.325870:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:3.0:1788872859.325882:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:3.0:1788872859.325888:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327785472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.325915:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327785472:12345-0@lo:400:kworker.0 Request processed in 28us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.325920:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:3.0:1788872859.325954:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327785984 00000100:00100000:3.0:1788872859.325959:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327785984 00000100:00100000:3.0:1788872859.325987:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327786496 00000100:00100000:3.0:1788872859.325991:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327786496 00000100:00100000:3.0:1788872859.326022:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:3.0:1788872859.326029:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327785984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.326061:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327785984:12345-0@lo:400:kworker.0 Request processed in 33us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.326068:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:3.0:1788872859.326079:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:3.0:1788872859.326085:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327786496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.326112:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327786496:12345-0@lo:400:kworker.0 Request processed in 27us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.326118:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00100000:3.0:1788872859.326151:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327785728:0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.326177:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872859.326196:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327786240:0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.326221:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872859.326239:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327786752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872859.326260:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872859.326287:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327786240 00000100:00100000:3.0:1788872859.326290:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327786240 00000100:00100000:3.0:1788872859.326330:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00100000:3.0:1788872859.326336:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327786240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.326369:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327786240:12345-0@lo:400:kworker.0 Request processed in 33us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.326375:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00100000:3.0:1788872859.326391:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327786752 00000100:00100000:3.0:1788872859.326394:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327786752 00000100:00100000:3.0:1788872859.326414:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:3.0:1788872859.326427:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327786752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872859.326447:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872859.326474:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327786752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.326479:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00100000:3.0:1788872859.326495:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327785728 00000100:00100000:3.0:1788872859.326498:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327785728 00000100:00100000:3.0:1788872859.326517:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:3.0:1788872859.326521:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327785728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.326547:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327785728:12345-0@lo:400:kworker.0 Request processed in 25us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.326574:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00080000:1.0:1788872859.327099:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872859.327106:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872859.327108:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872859.327150:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327785472:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.327167:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327785984:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.327178:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1c9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327786496:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.327190:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327785600:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.327202:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327786112:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.327214:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1c9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327786624:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.327279:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327785728:0@lo:400:kworker.0 00000100:00100000:1.0:1788872859.327421:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327786240:0@lo:400:kworker.0 00000100:00100000:0.0:1788872859.328682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872859.328834:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327785856 00000100:00100000:2.0:1788872859.328987:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327785856 00000100:00100000:3.0:1788872859.329092:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327786368:0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.329149:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872859.329178:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327786880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872859.329205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872859.329238:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327785344:0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.329279:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327786368 00000100:00100000:3.0:1788872859.329283:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327786368 00000100:00100000:3.0:1788872859.329321:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:3.0:1788872859.329329:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327786368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.329378:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327786368:12345-0@lo:400:kworker.0 Request processed in 50us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.329386:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:3.0:1788872859.329415:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327786368:0@lo:400:kworker.0 00000100:00080000:0.0:1788872859.332144:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872859.332169:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872859.332294:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1788872859.332311:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327785856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872859.332417:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327785856:12345-0@lo:400:kworker.0 Request processed in 113us (3746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872859.332424:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1788872859.332908:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327785856:0@lo:400:kworker.0 00000100:00100000:3.0:1788872859.332963:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327786880 00000100:00100000:3.0:1788872859.332969:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327786880 00000100:00100000:3.0:1788872859.333137:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00100000:3.0:1788872859.333146:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327786880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788872859.333174:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445490688 avail 1299251200 00000100:00100000:3.0:1788872859.333223:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327786880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (4017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.333230:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00000100:00100000:1.0:1788872859.334145:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327786752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872859.334208:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327786880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872859.834544:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327787008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872859.834675:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872859.834764:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327787008 00000100:00100000:0.0:1788872859.834772:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327787008 00000100:00100000:0.0:1788872859.834829:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157 00000100:00100000:0.0:1788872859.834838:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327787008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872859.834866:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872859.834920:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327787008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872859.834928:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157 00000100:00100000:0.0:1788872859.834981:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327787008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872859.835270:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327787136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872859.835301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872859.835476:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327787136 00000100:00100000:3.0:1788872859.835481:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327787136 00000100:00100000:3.0:1788872859.835517:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:3.0:1788872859.835525:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327787136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872859.835537:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872859.835592:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327787136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.835598:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00000100:00100000:0.0:1788872859.835683:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327787136:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788872859.838372:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969454 is committed 00000004:00080000:3.0:1788872859.857202:0:75620:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00010000:00010000:3.0:1788872859.857259:0:75620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4800/0xe4e6e89fb01db217 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01db21e expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872859.857275:0:75620:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4800/0xe4e6e89fb01db217 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01db21e expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857321:0:75620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4800/0xe4e6e89fb01db217 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db21e expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857340:0:75620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872859.857367:0:75620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9efac4800/0xe4e6e89fb01db217 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db21e expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788872859.857387:0:75620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411458 is committed 00000004:00080000:3.0:1788872859.857405:0:75620:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00010000:00010000:3.0:1788872859.857443:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b400/0xe4e6e89fb01daf70 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857452:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b400/0xe4e6e89fb01daf70 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857459:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b400/0xe4e6e89fb01daf70 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857465:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5b400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872859.857469:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b400/0xe4e6e89fb01daf70 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857476:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b400/0xe4e6e89fb01daf70 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857489:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xb1bed465 (ffff98a9d1dc7600) 00010000:00010000:3.0:1788872859.857493:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872859.857497:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b400/0xe4e6e89fb01daf70 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857504:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c5c5b400/0xe4e6e89fb01daf70 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857533:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898600/0xe4e6e89fb01db1df lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857541:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898600/0xe4e6e89fb01db1df lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857570:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898600/0xe4e6e89fb01db1df lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857576:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872859.857579:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898600/0xe4e6e89fb01db1df lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857585:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898600/0xe4e6e89fb01db1df lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857593:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xb1bed465 (ffff98a9d1dc7600) 00010000:00010000:3.0:1788872859.857596:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872859.857599:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898600/0xe4e6e89fb01db1df lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857621:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898600/0xe4e6e89fb01db1df lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857636:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898200/0xe4e6e89fb01db1fb lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857642:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898200/0xe4e6e89fb01db1fb lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857648:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898200/0xe4e6e89fb01db1fb lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857658:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872859.857670:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898200/0xe4e6e89fb01db1fb lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857677:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898200/0xe4e6e89fb01db1fb lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857685:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xf7117594 (ffff98a9efbc5600) 00010000:00010000:3.0:1788872859.857688:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872859.857691:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898200/0xe4e6e89fb01db1fb lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857697:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898200/0xe4e6e89fb01db1fb lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872859.857729:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327787264:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1788872859.857795:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872859.857853:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327787264 00000100:00100000:3.0:1788872859.857860:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327787264 00000100:00100000:3.0:1788872859.857906:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:3.0:1788872859.857915:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+10:3646:x1875765327787264:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1788872859.857928:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872859.857945:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db21e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db217 expref: 10 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872859.857957:0:26198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff98a9c2bf9900) 00010000:00010000:3.0:1788872859.857964:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872859.858004:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3646:x1875765327787264:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 89us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872859.858011:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:3.0:1788872859.858052:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327787264:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:1.0:1788872859.864324:0:92455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00000100:00100000:2.0:1788872859.869340:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327787392:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1788872859.869426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872859.870285:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327787392 00000100:00100000:0.0:1788872859.870296:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327787392 00000100:00100000:0.0:1788872859.870356:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5993 00000100:00100000:0.0:1788872859.870366:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327787392:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1788872859.870396:0:26183:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1538 count 1 00010000:00010000:0.0:1788872859.870421:0:26183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872859.870454:0:26183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0da expref: 5 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872859.870483:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x602:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1788872859.870488:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788872859.870493:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872859.870529:0:26183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0da expref: 5 pid: 26194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872859.870543:0:26183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0da expref: 5 pid: 26194 timeout: 3896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872859.870573:0:26183:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26183:1875765327787520:192.168.204.39@tcp:104: 00000100:00100000:0.0:1788872859.870659:0:26183:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5d106c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872859.872942:0:26183:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26183:1875765327787520:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788872859.872979:0:26183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872859.889412:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872859.889801:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311208576 00000100:00100000:2.0:1788872859.889813:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311208576 00000100:00080000:1.0:1788872859.890207:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788872859.890235:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0da expref: 6 pid: 26194 timeout: 3896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872859.890283:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2565 00000100:00100000:2.0:1788872859.890295:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2404:x1875765311208576:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788872859.890313:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872859.890319:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0da expref: 6 pid: 26194 timeout: 3896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872859.890353:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0da expref: 6 pid: 26194 timeout: 3896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872859.890381:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097377c59/0xe4e6e89fb01dafe0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0da expref: 6 pid: 26194 timeout: 3896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872859.890396:0:19657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1788872859.890401:0:19657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788872859.890406:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872859.890416:0:19657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872859.890451:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872859.890513:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2404:x1875765311208576:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 220us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872859.890522:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2565 00010000:00010000:1.0:1788872859.890723:0:26183:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872859.890736:0:26183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872859.890747:0:26183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872859.890756:0:26183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872859.890777:0:26183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788872859.890982:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327787392:12345-0@lo:6:osp-syn-0-1.0 Request processed in 20617us (21555us total) trans 4294969455 rc 0/0 00000100:00100000:1.0:1788872859.890991:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5993 00010000:00010000:1.0:1788872859.891014:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872859.891021:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872859.891043:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52aec00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872859.891047:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872859.891057:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872859.891071:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872859.891077:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb80ce2c/0xe4e6e89fb01db23a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872859.891095:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872859.891097:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872859.891099:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788872859.891137:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98a9ee81c380/2, rc 0, transno 4294969455 00000100:00100000:1.0:1788872859.891144:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327787392:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1788872859.961737:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872860.992155:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872862.009739:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872862.478050:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872862.478114:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872862.478149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872862.478196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872862.478238:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311209088 00000100:00100000:0.0:1788872862.478248:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311209088 00000100:00100000:0.0:1788872862.478307:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2679 00000100:00100000:0.0:1788872862.478317:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311209088:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872862.478388:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311209088:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 73us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872862.478414:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2679 00000100:00080000:0.0:1788872862.478435:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872862.478920:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311208704 00000100:00100000:2.0:1788872862.478926:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311208704 00000100:00100000:1.0:1788872862.478954:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311208960 00000100:00100000:1.0:1788872862.478961:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311208960 00000100:00100000:2.0:1788872862.478970:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 74 00000100:00100000:2.0:1788872862.478980:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311208704:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872862.479025:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311208704:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 47us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872862.479045:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 74 00000100:00100000:1.0:1788872862.479323:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311208832 00000100:00100000:1.0:1788872862.479328:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311208832 00000100:00100000:1.0:1788872862.479359:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1369 00000100:00100000:1.0:1788872862.479368:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311208960:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872862.479407:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311208960:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 41us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872862.479421:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1369 00000100:00100000:1.0:1788872862.479441:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1370 00000100:00100000:1.0:1788872862.479449:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2407:x1875765311208832:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872862.479478:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2407:x1875765311208832:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 31us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872862.479485:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1370 00000100:00080000:0.0:1788872862.480402:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872862.480411:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788872863.037421:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872864.057914:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788872864.061137:0:93038:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 09:07:42 (1788872862) 00000100:00100000:1.0:1788872864.442151:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327787648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872864.442245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872864.442289:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872864.442295:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327787776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872864.442320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872864.442655:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327787904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872864.444868:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327788288:0@lo:400:kworker.0 00000100:00100000:0.0:1788872864.444932:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872864.444982:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327788800:0@lo:400:kworker.0 00000100:00100000:3.0:1788872864.445046:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327788288 00000100:00100000:3.0:1788872864.445053:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327788288 00000100:00100000:3.0:1788872864.445122:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1788872864.445134:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327788288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872864.445200:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327788288:12345-0@lo:400:kworker.0 Request processed in 69us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872864.445208:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00080000:0.0:1788872864.445271:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788872864.445474:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327788160:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.445510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872864.445537:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327788672:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.445589:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872864.445609:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327789184:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.445630:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872864.445662:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327787648 00000100:00100000:1.0:1788872864.445667:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327787648 00000100:00100000:1.0:1788872864.445701:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:1.0:1788872864.445708:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327787648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872864.445730:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872864.445765:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327787648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (3519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.445782:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:1.0:1788872864.445803:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327788032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872864.445832:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872864.445851:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327788544:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.445869:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872864.445884:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327789056:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.445904:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872864.445920:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327789568:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.445937:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872864.445957:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788872864.445963:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327788416:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.445983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872864.445999:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327788928:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.446019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872864.446036:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327789440:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.446055:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872864.446082:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327788160 00000100:00100000:1.0:1788872864.446086:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327788160 00000100:00100000:1.0:1788872864.446112:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788872864.446119:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327788160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.446149:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327788160:12345-0@lo:400:kworker.0 Request processed in 31us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.446156:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788872864.446182:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327787776 00000100:00100000:1.0:1788872864.446192:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327787776 00000100:00100000:1.0:1788872864.446220:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327789184 00000100:00100000:1.0:1788872864.446222:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327789184 00000100:00100000:1.0:1788872864.446239:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00100000:1.0:1788872864.446243:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327787776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788872864.446268:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445105664 avail 1298866176 00000100:00100000:1.0:1788872864.446300:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327787776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (3978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.446306:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00000100:00100000:1.0:1788872864.446317:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:1.0:1788872864.446322:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327789184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.446350:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327789184:12345-0@lo:400:kworker.0 Request processed in 27us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.446356:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00000100:00100000:1.0:1788872864.446371:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327788032 00000100:00100000:1.0:1788872864.446374:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327788032 00000100:00100000:1.0:1788872864.446397:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:1.0:1788872864.446404:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327788032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872864.446419:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872864.446450:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327788032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.446456:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000100:00100000:1.0:1788872864.446489:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327788160:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.446502:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327789184:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.446511:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:1.0:1788872864.446518:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084290 00000004:00080000:1.0:1788872864.446583:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000020:00080000:1.0:1788872864.446591:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98a9ef3dbe40 refcount 2 committed 0 result 0 batchid 73014444091 00000020:00080000:1.0:1788872864.446595:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98a9eedfe100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98a9ef3dbf00 00000020:00080000:1.0:1788872864.446598:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000090a1:0x2:0x0].3 00000020:00080000:1.0:1788872864.446601:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98a9eedfe500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98a9f54a5c00 00000020:00080000:1.0:1788872864.446604:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].3 00000100:00100000:1.0:1788872864.446631:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327787776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872864.446651:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327787648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872864.446678:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327788672 00000100:00100000:1.0:1788872864.446681:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327788672 00000100:00100000:1.0:1788872864.446706:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327788544 00000100:00100000:1.0:1788872864.446710:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327788544 00000100:00100000:1.0:1788872864.446721:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327789056 00000100:00100000:1.0:1788872864.446724:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327789056 00000100:00100000:1.0:1788872864.446734:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327789568 00000100:00100000:1.0:1788872864.446736:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327789568 00000100:00100000:1.0:1788872864.446744:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327788416 00000100:00100000:1.0:1788872864.446747:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327788416 00000100:00100000:1.0:1788872864.446759:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:1.0:1788872864.446764:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327788672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.446799:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327788672:12345-0@lo:400:kworker.0 Request processed in 35us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.446806:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:1.0:1788872864.446818:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:1.0:1788872864.446824:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327788544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.446848:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327788544:12345-0@lo:400:kworker.0 Request processed in 24us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.446863:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:1.0:1788872864.446874:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1788872864.446879:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327789056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.446905:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327789056:12345-0@lo:400:kworker.0 Request processed in 26us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.446910:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1788872864.446920:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:1.0:1788872864.446925:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327789568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.446950:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327789568:12345-0@lo:400:kworker.0 Request processed in 25us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.446955:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:1.0:1788872864.446965:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:1.0:1788872864.446971:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327788416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.446995:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327788416:12345-0@lo:400:kworker.0 Request processed in 25us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.447001:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:1.0:1788872864.447020:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327788928 00000100:00100000:1.0:1788872864.447025:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327788928 00000100:00100000:1.0:1788872864.447047:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327789440 00000100:00100000:1.0:1788872864.447050:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327789440 00000100:00100000:1.0:1788872864.447078:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680 00000100:00100000:1.0:1788872864.447084:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327788928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.447116:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327788928:12345-0@lo:400:kworker.0 Request processed in 33us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.447122:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680 00000100:00100000:1.0:1788872864.447140:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1788872864.447146:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327789440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.447172:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327789440:12345-0@lo:400:kworker.0 Request processed in 27us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.447178:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1788872864.447219:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327788416:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.447230:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327788928:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.447239:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327789440:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.447251:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327788032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872864.447260:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327788544:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.447269:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327789056:0@lo:400:kworker.0 00000100:00100000:1.0:1788872864.447277:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327789568:0@lo:400:kworker.0 00000020:00080000:1.0:1788872864.447305:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444091 committed batchid 73014444090 00000020:00080000:1.0:1788872864.447373:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000100:00100000:1.0:1788872864.447392:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327788672:0@lo:400:kworker.0 00000100:00080000:1.0:1788872864.447419:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872864.447425:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872864.447428:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872864.447430:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872864.447476:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872864.447510:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327787904 00000100:00100000:1.0:1788872864.447513:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327787904 00000100:00100000:1.0:1788872864.447534:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00100000:1.0:1788872864.447540:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327787904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872864.447596:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872864.447629:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327787904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872864.447634:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00100000:1.0:1788872864.447660:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327787904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872864.447785:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872864.447830:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327789312:0@lo:400:kworker.0 00000100:00100000:0.0:1788872864.447860:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872864.447893:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327788288:0@lo:400:kworker.0 00000100:00100000:0.0:1788872864.447912:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327789312 00000100:00100000:0.0:1788872864.447915:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327789312 00000100:00100000:0.0:1788872864.447948:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:0.0:1788872864.447954:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327789312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872864.447993:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327789312:12345-0@lo:400:kworker.0 Request processed in 39us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872864.447999:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:0.0:1788872864.448023:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 2 00000100:00100000:0.0:1788872864.448035:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327789312:0@lo:400:kworker.0 00000100:00100000:3.0:1788872864.448334:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327788800 00000100:00100000:3.0:1788872864.448339:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327788800 00000100:00100000:3.0:1788872864.448366:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:3.0:1788872864.448373:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327788800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872864.448422:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327788800:12345-0@lo:400:kworker.0 Request processed in 49us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872864.448429:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000100:00100000:3.0:1788872864.448453:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327788800:0@lo:400:kworker.0 00000100:00080000:1.0:1788872864.451562:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872864.964579:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327789696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872864.964661:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872864.964781:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327789696 00000100:00100000:3.0:1788872864.964789:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327789696 00000100:00100000:3.0:1788872864.964840:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161 00000100:00100000:3.0:1788872864.964849:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327789696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872864.964873:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872864.964921:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327789696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872864.964929:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161 00000100:00100000:3.0:1788872864.964980:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327789696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872864.965791:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327789824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872864.965828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872864.965866:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327789824 00000100:00100000:3.0:1788872864.965871:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327789824 00000100:00100000:3.0:1788872864.965916:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:3.0:1788872864.965924:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327789824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788872864.965938:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872864.965979:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327789824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872864.965985:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000100:00100000:2.0:1788872864.967318:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327789824:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788872865.084948:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788872865.338288:0:93087:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffed8c01520 20000000:00000080:1.0:1788872865.338313:0:93087:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff98a9df44f000 uarg=0000000000000000 00000040:00100000:1.0:1788872865.339104:0:93087:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 49 00000040:00100000:1.0:1788872865.339114:0:93087:0:(llog.c:1072:llog_reverse_process()) index 47 : idx 1 00000040:00080000:1.0:1788872865.339222:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:1.0:1788872865.339244:0:93087:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:1.0:1788872865.339263:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:1.0:1788872865.339280:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:1.0:1788872865.339353:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:1.0:1788872865.339363:0:93087:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:1.0:1788872865.339378:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:1.0:1788872865.339828:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:1.0:1788872865.341010:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:1.0:1788872865.341035:0:93087:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:1.0:1788872865.341066:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:1.0:1788872865.341229:0:93087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:1.0:1788872865.341248:0:93087:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788872865.341271:0:93087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341291:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dad55 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341299:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dae2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae27 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341312:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae58 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341319:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9c56c9400/0xe4e6e89fb01dae7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae74 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341327:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c5c5b600/0xe4e6e89fb01daea5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dae9e expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341335:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c5c5b200/0xe4e6e89fb01daeb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daeac expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341354:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9df4d2a00/0xe4e6e89fb01daecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daec8 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341361:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9df4d2400/0xe4e6e89fb01daedd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daed6 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341367:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01daf07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daf00 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341376:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9df4d3400/0xe4e6e89fb01daf1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0b7 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341384:0:93087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c4f9d600/0xe4e6e89fb01daf2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0c5 expref: 9 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341392:0:93087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341643:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c4f9d600/0xe4e6e89fb01daf2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0c5 expref: 9 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341659:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c4f9d600/0xe4e6e89fb01daf2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0c5 expref: 9 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.341674:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3853100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327789952:192.168.204.39@tcp:104: 00010000:00010000:1.0:1788872865.341779:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9df4d3400/0xe4e6e89fb01daf1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0b7 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341790:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9df4d3400/0xe4e6e89fb01daf1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0b7 expref: 9 pid: 92461 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.341799:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3852d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790080:192.168.204.39@tcp:104: 00010000:00010000:1.0:1788872865.341832:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01daf07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01daf00 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341840:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01daf07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01daf00 expref: 23 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.341850:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3853b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790208:0@lo:104: 00000100:00100000:1.0:1788872865.341891:0:93087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788872865.341926:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9df4d2400/0xe4e6e89fb01daedd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01daed6 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341935:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9df4d2400/0xe4e6e89fb01daedd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01daed6 expref: 23 pid: 92461 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.341955:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3851500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790336:0@lo:104: 00010000:00010000:1.0:1788872865.341983:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9df4d2a00/0xe4e6e89fb01daecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01daec8 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.341990:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9df4d2a00/0xe4e6e89fb01daecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01daec8 expref: 23 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.341997:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3851880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790464:0@lo:104: 00010000:00010000:1.0:1788872865.342018:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c5c5b200/0xe4e6e89fb01daeb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01daeac expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.342026:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c5c5b200/0xe4e6e89fb01daeb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01daeac expref: 23 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.342033:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa59180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790592:0@lo:104: 00010000:00010000:1.0:1788872865.342056:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c5c5b600/0xe4e6e89fb01daea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dae9e expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.342065:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c5c5b600/0xe4e6e89fb01daea5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae9e expref: 23 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.342072:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa5b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790720:0@lo:104: 00010000:00010000:1.0:1788872865.342092:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9c56c9400/0xe4e6e89fb01dae7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dae74 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.342099:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9c56c9400/0xe4e6e89fb01dae7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae74 expref: 23 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.342118:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790848:0@lo:104: 00010000:00010000:1.0:1788872865.342143:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dae58 expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.342151:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae58 expref: 23 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.342159:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5a4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790976:0@lo:104: 00010000:00010000:1.0:1788872865.342181:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dae2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dae27 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.342189:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dae2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae27 expref: 23 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.342196:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327791104:0@lo:104: 00010000:00010000:1.0:1788872865.342217:0:93087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dad55 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872865.342224:0:93087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dad55 expref: 23 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.342232:0:93087:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327791232:0@lo:104: 00000100:00100000:1.0:1788872865.342249:0:93087:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c1254840 going to sleep for 11 seconds 00000100:00100000:3.0:1788872865.342947:0:13343:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788872865.342977:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872865.343058:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872865.347232:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872865.347476:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327790208 00000100:00100000:2.0:1788872865.347491:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327790208 00000100:00100000:2.0:1788872865.347652:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327790336 00000100:00100000:2.0:1788872865.347657:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327790336 00000100:00100000:2.0:1788872865.347674:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327790464 00000100:00100000:2.0:1788872865.347678:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327790464 00000100:00100000:2.0:1788872865.347767:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788872865.347787:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df558c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:93087:x1875765327790208:12345-0@lo:104: 00010000:00010000:2.0:1788872865.347812:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01daf07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.347899:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788872865.347906:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df558c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:93087:x1875765327790208:12345-0@lo:104: Request processed in 128us (6015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872865.347914:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788872865.347972:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788872865.347980:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:93087:x1875765327790336:12345-0@lo:104: 00010000:00010000:2.0:1788872865.347990:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01daedd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.348027:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788872865.348032:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:93087:x1875765327790336:12345-0@lo:104: Request processed in 54us (5055us total) trans 0 rc 0/0 00010000:00010000:0.0:1788872865.348128:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872865.348137:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01daf07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872865.348157:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3e00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872865.348162:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01daf07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872865.348170:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01daf07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872865.348178:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01daf07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872865.348184:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872865.348229:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daf07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872865.348236:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872865.348261:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daf07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872865.348268:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3e00/0xe4e6e89fb01daf00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daf07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872865.348285:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872865.348288:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01daedd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872865.348295:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872865.348297:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01daedd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872865.348315:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01daedd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872865.348322:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01daedd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872865.348327:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872865.348351:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daedd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872865.348358:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872865.348365:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daedd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872865.348371:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9600/0xe4e6e89fb01daed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daedd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872865.348380:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872865.348382:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872865.348384:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872865.348406:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327791488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872865.348448:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872865.348515:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872865.348522:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327791360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872865.348544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872865.348865:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788872865.348883:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788872865.348891:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:93087:x1875765327790464:12345-0@lo:104: 00010000:00010000:2.0:1788872865.348900:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01daecf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.348947:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788872865.348953:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:93087:x1875765327790464:12345-0@lo:104: Request processed in 64us (5895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872865.348958:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00010000:00010000:2.0:1788872865.348976:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872865.348980:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01daecf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.348986:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872865.348990:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01daecf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.348996:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01daecf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872865.349002:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01daecf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872865.349008:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872865.349031:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daecf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.349037:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872865.349068:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daecf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.349073:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9200/0xe4e6e89fb01daec8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daecf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.349083:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872865.349084:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872865.349086:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872865.349097:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327791616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872865.349122:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872865.349154:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327791488 00000100:00100000:2.0:1788872865.349159:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327791488 00010000:00010000:2.0:1788872865.349180:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9df4d2400/0xe4e6e89fb01daedd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01daed6 expref: 24 pid: 92461 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.349201:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327791360 00000100:00100000:2.0:1788872865.349204:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327791360 00010000:00010000:2.0:1788872865.349215:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01daf07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01daf00 expref: 25 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.349231:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327791616 00000100:00100000:2.0:1788872865.349233:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327791616 00010000:00010000:2.0:1788872865.349243:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9df4d2a00/0xe4e6e89fb01daecf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01daec8 expref: 26 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.349260:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1788872865.349266:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+26:3647:x1875765327791488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872865.349277:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872865.349282:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9df4d2400/0xe4e6e89fb01daedd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01daed6 expref: 26 pid: 92461 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.349297:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9df4d2400/0xe4e6e89fb01daedd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01daed6 expref: 26 pid: 92461 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.349315:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872865.349458:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+26:3647:x1875765327791488:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872865.349465:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1788872865.349480:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1788872865.349486:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3647:x1875765327791360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872865.349494:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872865.349627:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872865.349834:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01daf07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01daf00 expref: 25 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.349844:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01daf07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01daf00 expref: 25 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.349855:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872865.349883:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3647:x1875765327791360:12345-0@lo:103:ldlm_bl.0 Request processed in 397us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872865.349888:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1788872865.349903:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1788872865.349909:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327791616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872865.349917:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872865.349921:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9df4d2a00/0xe4e6e89fb01daecf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01daec8 expref: 24 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.349929:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9df4d2a00/0xe4e6e89fb01daecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01daec8 expref: 24 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.349947:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872865.350018:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327791616:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872865.350024:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1788872865.350075:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327791360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872865.350085:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327791488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872865.350251:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3853100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327789952:192.168.204.39@tcp:104: 00000100:00100000:1.0:1788872865.350263:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3852d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790080:192.168.204.39@tcp:104: 00010000:00010000:1.0:1788872865.350273:0:93087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3c00/0xe4e6e89fb01daf07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01daf00 expref: 23 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.350293:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3853b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790208:0@lo:104: 00010000:00010000:1.0:1788872865.350308:0:93087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d2400/0xe4e6e89fb01daedd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01daed6 expref: 22 pid: 92461 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.350317:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3851500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790336:0@lo:104: 00010000:00010000:1.0:1788872865.350326:0:93087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d2a00/0xe4e6e89fb01daecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01daec8 expref: 21 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872865.350333:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3851880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790464:0@lo:104: 00000100:00100000:3.0:1788872865.350606:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872865.350631:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872865.350642:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872865.350652:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872865.350662:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327790592 00000100:00100000:3.0:1788872865.350666:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327790592 00000100:00100000:3.0:1788872865.350768:0:13343:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788872865.350789:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872865.350798:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327790720 00000100:00100000:3.0:1788872865.350801:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327790720 00000100:00100000:3.0:1788872865.350816:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327790848 00000100:00100000:3.0:1788872865.350818:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327790848 00000100:00100000:3.0:1788872865.350827:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327790976 00000100:00100000:3.0:1788872865.350829:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327790976 00000100:00100000:3.0:1788872865.350837:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327791104 00000100:00100000:3.0:1788872865.350839:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327791104 00000100:00100000:3.0:1788872865.350846:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327791232 00000100:00100000:3.0:1788872865.350848:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327791232 00000100:00100000:3.0:1788872865.350859:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788872865.350866:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:93087:x1875765327790592:12345-0@lo:104: 00010000:00010000:3.0:1788872865.350877:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01daeb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.350924:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788872865.350929:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:93087:x1875765327790592:12345-0@lo:104: Request processed in 64us (3705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872865.350935:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788872865.350950:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788872865.350956:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:93087:x1875765327790720:12345-0@lo:104: 00010000:00010000:3.0:1788872865.350962:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01daea5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351009:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788872865.351014:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:93087:x1875765327790720:12345-0@lo:104: Request processed in 58us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872865.351020:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788872865.351032:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788872865.351037:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:93087:x1875765327790848:12345-0@lo:104: 00010000:00010000:3.0:1788872865.351043:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dae7b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351074:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788872865.351078:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:93087:x1875765327790848:12345-0@lo:104: Request processed in 42us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872865.351083:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788872865.351095:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788872865.351100:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:93087:x1875765327790976:12345-0@lo:104: 00010000:00010000:3.0:1788872865.351106:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dae5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351136:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788872865.351141:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:93087:x1875765327790976:12345-0@lo:104: Request processed in 41us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872865.351147:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788872865.351158:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788872865.351164:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7312c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:93087:x1875765327791104:12345-0@lo:104: 00010000:00010000:3.0:1788872865.351170:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dae2e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351203:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788872865.351208:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7312c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:93087:x1875765327791104:12345-0@lo:104: Request processed in 44us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872865.351213:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788872865.351260:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788872865.351266:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:93087:x1875765327791232:12345-0@lo:104: 00010000:00010000:3.0:1788872865.351273:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dad5c expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351300:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788872865.351305:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:93087:x1875765327791232:12345-0@lo:104: Request processed in 40us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872865.351310:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00010000:00010000:3.0:1788872865.351332:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788872865.351464:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788872865.351470:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01daea5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.351477:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8c00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872865.351481:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01daea5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.351489:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01daea5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872865.351507:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01daea5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872865.351513:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872865.351545:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daea5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.351579:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872865.351594:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daea5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.351612:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8c00/0xe4e6e89fb01dae9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daea5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.351624:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788872865.351627:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dae7b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.351633:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872865.351636:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dae7b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.351643:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dae7b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872865.351649:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dae7b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872865.351654:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872865.351668:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dae7b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.351674:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872865.351687:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dae7b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.351694:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8400/0xe4e6e89fb01dae74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dae7b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351886:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01daeb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351894:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c5c5be00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872865.351896:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01daeb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351903:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01daeb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872865.351909:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01daeb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872865.351914:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872865.351936:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daeb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351941:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872865.351948:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daeb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351954:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5be00/0xe4e6e89fb01daeac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01daeb3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351964:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788872865.351967:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dae5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351972:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8e00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872865.351974:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dae5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.351980:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dae5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872865.351986:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dae5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872865.351991:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872865.352002:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dae5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352008:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872865.352013:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dae5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352028:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8e00/0xe4e6e89fb01dae58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dae5f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352038:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872865.352040:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dae2e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352045:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ce00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872865.352049:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dae2e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352055:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dae2e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872865.352061:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dae2e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872865.352065:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872865.352079:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dae2e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352083:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872865.352088:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dae2e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352093:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01dae27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dae2e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352101:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872865.352109:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dad5c expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352115:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872865.352117:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dad5c expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352122:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dad5c expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872865.352128:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dad5c expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872865.352134:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872865.352146:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dad5c expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352151:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872865.352156:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dad5c expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352163:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c200/0xe4e6e89fb01dad55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dad5c expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.352172:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872865.352173:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872865.352175:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872865.352182:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872865.352187:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872865.352240:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872865.352246:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872865.352248:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872865.352268:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327791872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872865.352387:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327791616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872865.352408:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327792128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872865.352901:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872865.352975:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327792384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872865.353002:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872865.353152:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa59180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790592:0@lo:104: 00000100:00100000:1.0:1788872865.353163:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa5b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790720:0@lo:104: 00000100:00100000:1.0:1788872865.353171:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790848:0@lo:104: 00000100:00100000:1.0:1788872865.353178:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5a4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327790976:0@lo:104: 00000100:00100000:1.0:1788872865.353186:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327791104:0@lo:104: 00000100:00100000:1.0:1788872865.353193:0:93087:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93087:1875765327791232:0@lo:104: 00010000:00010000:1.0:1788872865.353235:0:93087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.353873:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872865.353882:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327792000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872865.353908:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872865.353958:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327791872 00000100:00100000:3.0:1788872865.353966:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327791872 00010000:00010000:3.0:1788872865.354006:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9c56c9400/0xe4e6e89fb01dae7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae74 expref: 21 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872865.354039:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327792384 00000100:00100000:3.0:1788872865.354043:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327792384 00010000:00010000:3.0:1788872865.354063:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dad55 expref: 22 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872865.354084:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:3.0:1788872865.354091:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3646:x1875765327791872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872865.354104:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872865.354109:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9c56c9400/0xe4e6e89fb01dae7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae74 expref: 22 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.354118:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9c56c9400/0xe4e6e89fb01dae7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae74 expref: 22 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.354134:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c9400/0xe4e6e89fb01dae7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dae74 expref: 22 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.354148:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872865.354179:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3646:x1875765327791872:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872865.354186:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:3.0:1788872865.354229:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:3.0:1788872865.354236:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3646:x1875765327792384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872865.354243:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872865.354246:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dad55 expref: 20 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.354265:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dad55 expref: 20 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.354278:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5c5a200/0xe4e6e89fb01dad5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dad55 expref: 20 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.354286:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872865.354309:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:3646:x1875765327792384:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872865.354315:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:2.0:1788872865.354509:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327791872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872865.354518:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327792384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872865.354587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872865.354616:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327791744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872865.354641:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872865.354658:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327792256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872865.354676:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872865.354719:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327792000 00000100:00100000:2.0:1788872865.354723:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327792000 00010000:00010000:2.0:1788872865.354742:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c5c5b200/0xe4e6e89fb01daeb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01daeac expref: 19 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.354757:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311209216 00000100:00100000:2.0:1788872865.354760:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311209216 00010000:00010000:2.0:1788872865.354771:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c4f9d600/0xe4e6e89fb01daf2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0c5 expref: 10 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.354781:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327791744 00000100:00100000:2.0:1788872865.354791:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327791744 00010000:00010000:2.0:1788872865.354804:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c5c5b600/0xe4e6e89fb01daea5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae9e expref: 20 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.354816:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327792256 00000100:00100000:2.0:1788872865.354819:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327792256 00010000:00010000:2.0:1788872865.354829:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dae2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae27 expref: 21 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.354841:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:2.0:1788872865.354847:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3646:x1875765327792000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872865.354856:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872865.354860:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c5c5b200/0xe4e6e89fb01daeb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01daeac expref: 21 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.354868:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c5c5b200/0xe4e6e89fb01daeb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01daeac expref: 21 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.354878:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5c5b200/0xe4e6e89fb01daeb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01daeac expref: 21 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.354888:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872865.354891:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2572 00000100:00100000:0.0:1788872865.354900:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311209216:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788872865.354910:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872865.354914:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c4f9d600/0xe4e6e89fb01daf2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0c5 expref: 10 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.354916:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3646:x1875765327792000:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872865.354922:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00010000:00010000:0.0:1788872865.354925:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c4f9d600/0xe4e6e89fb01daf2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0c5 expref: 10 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.354935:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00010000:00010000:0.0:1788872865.354936:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9d600/0xe4e6e89fb01daf2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0c5 expref: 10 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.354940:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:3645:x1875765327791744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872865.354946:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872865.354947:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872865.354951:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c5c5b600/0xe4e6e89fb01daea5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae9e expref: 19 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.354967:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c5c5b600/0xe4e6e89fb01daea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae9e expref: 19 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.354976:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c5c5b600/0xe4e6e89fb01daea5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dae9e expref: 19 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.354984:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872865.354985:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c67645b7-2296-4087-92b1-886500c47477+9:2405:x1875765311209216:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 87us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872865.354991:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2572 00000100:00100000:0.0:1788872865.355006:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:2.0:1788872865.355008:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:3645:x1875765327791744:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872865.355012:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:3645:x1875765327792256:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872865.355014:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00010000:00010000:0.0:1788872865.355019:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872865.355023:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dae2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae27 expref: 17 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872865.355031:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dae2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae27 expref: 17 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.355035:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327791744:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872865.355041:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01dae2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dae27 expref: 17 pid: 92460 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872865.355061:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872865.355076:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872865.355844:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327792128 00000100:00100000:3.0:1788872865.355851:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327792128 00010000:00010000:3.0:1788872865.355878:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae58 expref: 17 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872865.355908:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:3.0:1788872865.355915:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:3644:x1875765327792128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872865.355924:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872865.355928:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae58 expref: 17 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.355937:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dae58 expref: 17 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.355950:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3200/0xe4e6e89fb01dae5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dae58 expref: 17 pid: 92459 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.355962:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872865.357404:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327792256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872865.357455:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327792000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872865.358031:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:3644:x1875765327792128:12345-0@lo:103:ldlm_bl.0 Request processed in 2115us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872865.358110:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:3.0:1788872865.358174:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327792128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872865.360839:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:3645:x1875765327792256:12345-0@lo:103:ldlm_bl.0 Request processed in 5817us (6152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872865.360920:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:0.0:1788872865.370331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872865.370478:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311209344 00000100:00100000:2.0:1788872865.370489:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311209344 00010000:00010000:2.0:1788872865.370533:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9df4d3400/0xe4e6e89fb01daf1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0b7 expref: 9 pid: 92461 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872865.370622:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2576 00000100:00100000:2.0:1788872865.370633:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c67645b7-2296-4087-92b1-886500c47477+9:2404:x1875765311209344:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788872865.370649:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872865.370667:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9df4d3400/0xe4e6e89fb01daf1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0b7 expref: 9 pid: 92461 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.370679:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9df4d3400/0xe4e6e89fb01daf1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0b7 expref: 9 pid: 92461 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.370808:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3400/0xe4e6e89fb01daf1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0b7 expref: 9 pid: 92461 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.370828:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.370837:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.370854:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.370861:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.370868:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.370875:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.370881:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9cc00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872865.370885:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.370893:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.370925:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872865.370936:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872865.370987:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c67645b7-2296-4087-92b1-886500c47477+8:2404:x1875765311209344:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 355us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872865.370994:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2576 00010000:00010000:3.0:1788872865.371101:0:93087:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.371110:0:93087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872865.371115:0:93087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9cc00/0xe4e6e89fb01db241 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788872865.981263:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969455 is committed 00010000:00010000:3.0:1788872866.104960:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872866.443405:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872866.443927:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311209472 00000100:00100000:1.0:1788872866.443940:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311209472 00000100:00100000:1.0:1788872866.444148:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 76 00000100:00100000:1.0:1788872866.444170:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+8:71021:x1875765311209472:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872866.444188:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872866.444210:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01db248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb112 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872866.445395:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01db248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb112 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872866.445417:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01db248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb112 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872866.445428:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c800, rc 0) 00000100:00100000:1.0:1788872866.445543:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311209472:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 1373us (2137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872866.445568:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 76 00000100:00100000:0.0:1788872866.458102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872866.458351:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311209600 00000100:00100000:1.0:1788872866.458366:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311209600 00000100:00100000:1.0:1788872866.458445:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 77 00000100:00100000:1.0:1788872866.458458:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311209600:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872866.458936:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311209600:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 477us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872866.458946:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 77 00000100:00100000:0.0:1788872866.472812:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872866.473013:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311209728 00000100:00100000:1.0:1788872866.473031:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311209728 00000100:00100000:1.0:1788872866.473117:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 78 00000100:00100000:1.0:1788872866.473132:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311209728:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872866.473377:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311209728:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 248us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872866.473387:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 78 00000100:00100000:0.0:1788872866.481824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872866.492685:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311209856 00000100:00100000:1.0:1788872866.492738:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311209856 00000100:00100000:1.0:1788872866.492838:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 79 00000100:00100000:1.0:1788872866.492855:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71969:x1875765311209856:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788872866.493426:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71969:x1875765311209856:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 571us (11617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872866.493438:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 79 00000100:00100000:2.0:1788872866.499734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872866.500089:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311209984 00000100:00100000:0.0:1788872866.500108:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311209984 00000100:00100000:0.0:1788872866.500207:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 80 00000100:00100000:0.0:1788872866.500220:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+9:71969:x1875765311209984:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788872866.500461:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+9:71969:x1875765311209984:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 242us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872866.500471:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 80 00000100:00100000:3.0:1788872866.519688:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872866.522088:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311210112 00000100:00100000:0.0:1788872866.522115:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311210112 00000100:00100000:0.0:1788872866.522229:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 81 00000100:00100000:0.0:1788872866.522244:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311210112:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872866.522270:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872866.522301:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01db24f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb119 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872866.522342:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01db24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb119 expref: 10 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872866.522380:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01db24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb119 expref: 10 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872866.522392:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af400, rc 0) 00000100:00100000:0.0:1788872866.522498:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311210112:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 257us (2823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872866.522506:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 81 00000100:00100000:2.0:1788872866.531337:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872866.531465:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311210240 00000100:00100000:1.0:1788872866.531480:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311210240 00000100:00100000:1.0:1788872866.531617:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 82 00000100:00100000:1.0:1788872866.531633:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311210240:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872866.531824:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311210240:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 195us (501us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788872866.531835:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 82 10000000:01000000:2.0:1788872867.000929:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788872867.000942:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff63e800 from 52 10000000:01000000:2.0:1788872867.000950:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788872867.001021:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.001036:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.001050:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872867.001091:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327792512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.001216:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.001299:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d0d95600 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.001466:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327792512 00000100:00100000:1.0:1788872867.001478:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327792512 00000100:00100000:1.0:1788872867.001599:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788872867.001611:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327792512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872867.001628:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872867.001767:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01db25d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db256 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.001806:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01db25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db256 expref: 16 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.001819:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01db25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db256 expref: 16 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.001855:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d400, rc 0) 00000100:00100000:1.0:1788872867.001967:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327792512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 357us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.001975:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788872867.005853:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327792512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872867.005907:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.005962:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872867.006126:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327792640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.006232:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.006532:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d0d95600 going to sleep for 11 seconds 00000100:00100000:0.0:1788872867.008476:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327792640 00000100:00100000:0.0:1788872867.008499:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327792640 00000100:00100000:0.0:1788872867.008651:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788872867.008665:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327792640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.008953:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327792640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (2720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.008963:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788872867.009580:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327792640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.009675:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327792768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.009758:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872867.009813:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788872867.009942:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327792768 00000100:00100000:2.0:1788872867.009949:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327792768 00000100:00100000:2.0:1788872867.009995:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788872867.010004:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327792768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.010148:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327792768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872867.010156:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788872867.010657:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327792768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.013685:0:93088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93088:1875765327792896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872867.013815:0:93088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872867.013886:0:93088:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788872867.014046:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327792896 00000100:00100000:2.0:1788872867.014058:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327792896 00000100:00100000:2.0:1788872867.014131:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788872867.014142:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:93088:x1875765327792896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872867.014343:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:93088:x1875765327792896:12345-0@lo:502:llog_process_th.0 Request processed in 202us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872867.014352:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788872867.014798:0:93088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93088:1875765327792896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872867.014873:0:93088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93088:1875765327793024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872867.014923:0:93088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872867.014968:0:93088:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5492240 going to sleep for 11 seconds 00000100:00100000:0.0:1788872867.016472:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327793024 00000100:00100000:0.0:1788872867.016495:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327793024 00000100:00100000:0.0:1788872867.016719:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788872867.016733:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:93088:x1875765327793024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872867.017003:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:93088:x1875765327793024:12345-0@lo:502:llog_process_th.0 Request processed in 273us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.017012:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788872867.017880:0:93088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93088:1875765327793024:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788872867.017949:0:93088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1788872867.018210:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1788872867.018361:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788872867.018376:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.018388:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872867.018410:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788872867.018413:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:2.0:1788872867.018417:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788872867.018847:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.018860:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.018874:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872867.018912:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327793152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.019006:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.019123:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d0d95840 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.026485:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327793152 00000100:00100000:1.0:1788872867.026506:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327793152 00000100:00100000:1.0:1788872867.026821:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788872867.026837:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327793152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872867.026864:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872867.026891:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9c000/0xe4e6e89fb01db26b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db264 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.026931:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9c000/0xe4e6e89fb01db26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db264 expref: 17 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.026944:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9c000/0xe4e6e89fb01db26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db264 expref: 17 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.026955:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c000, rc 0) 00000100:00100000:1.0:1788872867.027070:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327793152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (8064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.027078:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788872867.027199:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327793152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872867.027222:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db26b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.027244:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db26b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872867.027357:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327793280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.027400:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.041245:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d0d95840 going to sleep for 11 seconds 00000100:00100000:0.0:1788872867.047643:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327793280 00000100:00100000:0.0:1788872867.047663:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327793280 00000100:00100000:1.0:1788872867.049732:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788872867.049769:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327793280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872867.050142:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327793280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 391us (22739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.050201:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788872867.050535:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327793280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.050657:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327793408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.050734:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.050769:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d0d95840 going to sleep for 11 seconds 00000100:00100000:3.0:1788872867.054743:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327793408 00000100:00100000:3.0:1788872867.054768:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327793408 00000100:00100000:3.0:1788872867.054858:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788872867.054871:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327793408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.055117:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327793408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (4382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872867.055127:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788872867.058796:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327793408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.059245:0:93089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93089:1875765327793536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872867.059349:0:93089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.067281:0:93089:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d0d95840 going to sleep for 11 seconds 00000100:00100000:0.0:1788872867.067839:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327793536 00000100:00100000:0.0:1788872867.067866:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327793536 00000100:00100000:0.0:1788872867.069736:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788872867.069787:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:93089:x1875765327793536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872867.070653:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:93089:x1875765327793536:12345-0@lo:502:llog_process_th.0 Request processed in 873us (11299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.070665:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788872867.071650:0:93089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93089:1875765327793536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788872867.071729:0:93089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872867.071748:0:93089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872867.071751:0:93089:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:2.0:1788872867.071761:0:93089:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1788872867.071888:0:93089:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:2.0:1788872867.079456:0:93089:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:0.0:1788872867.113234:0:93089:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00080000:10000000:0.0:1788872867.119678:0:93089:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00000100:00100000:0.0:1788872867.123252:0:93089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93089:1875765327793664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872867.123361:0:93089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872867.123418:0:93089:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.123725:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327793664 00000100:00100000:1.0:1788872867.123733:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327793664 00000100:00100000:1.0:1788872867.123788:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788872867.123799:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:93089:x1875765327793664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872867.123945:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:93089:x1875765327793664:12345-0@lo:502:llog_process_th.0 Request processed in 147us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.123953:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788872867.124465:0:93089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93089:1875765327793664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872867.124534:0:93089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93089:1875765327793792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872867.124616:0:93089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872867.124653:0:93089:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872867.124698:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327793792 00000100:00100000:2.0:1788872867.124720:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327793792 00000100:00100000:3.0:1788872867.124955:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788872867.124969:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:93089:x1875765327793792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872867.125977:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:93089:x1875765327793792:12345-0@lo:502:llog_process_th.0 Request processed in 1005us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872867.125990:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:3.0:1788872867.128851:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872867.130134:0:93089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93089:1875765327793792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788872867.130246:0:93089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872867.130261:0:93089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872867.130264:0:93089:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:0.0:1788872867.130270:0:93089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:2.0:1788872867.130851:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:2.0:1788872867.130894:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788872867.130916:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db26b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.130934:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db26b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872867.130953:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788872867.130957:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9d0cfb000 from 52 10000000:01000000:2.0:1788872867.130961:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788872867.131027:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.131060:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.131073:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872867.131105:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327793920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.131207:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.131272:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.133813:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327793920 00000100:00100000:1.0:1788872867.133832:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327793920 00000100:00100000:1.0:1788872867.133911:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788872867.133922:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327793920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872867.133944:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872867.133978:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db272 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.134014:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db272 expref: 18 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.134029:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db272 expref: 18 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.134040:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d800, rc 0) 00000100:00100000:1.0:1788872867.134161:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327793920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (2954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.134169:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788872867.134610:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327793920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872867.134633:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db279 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.134643:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db279 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872867.134723:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327794048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.134760:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.134795:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872867.134930:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327794048 00000100:00100000:3.0:1788872867.134935:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327794048 00000100:00100000:3.0:1788872867.134981:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788872867.134989:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327794048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.135149:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327794048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872867.135156:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788872867.135509:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327794048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.135599:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327794176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.135653:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.135673:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.135797:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327794176 00000100:00100000:1.0:1788872867.135809:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327794176 00000100:00100000:1.0:1788872867.135845:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788872867.135852:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327794176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872867.135955:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327794176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.135971:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788872867.136099:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327794176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.141994:0:93090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93090:1875765327794304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872867.142094:0:93090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872867.142143:0:93090:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788872867.142516:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327794304 00000100:00100000:0.0:1788872867.142544:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327794304 00000100:00100000:0.0:1788872867.142745:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788872867.142763:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:93090:x1875765327794304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872867.143067:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:93090:x1875765327794304:12345-0@lo:502:llog_process_th.0 Request processed in 309us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.143076:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788872867.143232:0:93090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93090:1875765327794304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872867.143336:0:93090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93090:1875765327794432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872867.143392:0:93090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872867.146265:0:93090:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ca268b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.146574:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327794432 00000100:00100000:1.0:1788872867.146587:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327794432 00000100:00100000:1.0:1788872867.146662:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788872867.146673:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:93090:x1875765327794432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872867.147142:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:93090:x1875765327794432:12345-0@lo:502:llog_process_th.0 Request processed in 470us (3748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.147152:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788872867.147876:0:93090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93090:1875765327794432:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788872867.147945:0:93090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1788872867.148759:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1788872867.148804:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872867.148821:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db279 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.148837:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db279 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872867.148852:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788872867.148856:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1788872867.148860:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788872867.148930:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.148940:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.148952:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872867.148986:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327794560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.149151:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872867.153813:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.153931:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327794560 00000100:00100000:1.0:1788872867.153944:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327794560 00000100:00100000:1.0:1788872867.154134:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788872867.154148:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc823850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327794560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872867.154189:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872867.154218:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01db287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db280 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.154267:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01db287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db280 expref: 19 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.154444:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01db287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db280 expref: 19 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.154467:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9de00, rc 0) 00000100:00100000:1.0:1788872867.154634:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc823850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327794560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 489us (5482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.154642:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788872867.154921:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327794560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872867.154951:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db287 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872867.154963:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db287 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872867.155086:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327794688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.155138:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872867.155169:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.155493:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327794688 00000100:00100000:1.0:1788872867.155499:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327794688 00000100:00100000:1.0:1788872867.155543:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788872867.155586:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327794688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872867.156413:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327794688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 859us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.156423:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788872867.156929:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327794688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.157000:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327794816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.157145:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872867.157266:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.157440:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327794816 00000100:00100000:1.0:1788872867.157448:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327794816 00000100:00100000:1.0:1788872867.157500:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788872867.157510:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327794816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872867.157973:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327794816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 464us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.157983:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788872867.158138:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327794816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.159610:0:93091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93091:1875765327794944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872867.159759:0:93091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872867.159869:0:93091:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788872867.159920:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327794944 00000100:00100000:2.0:1788872867.159934:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327794944 00000100:00100000:2.0:1788872867.160082:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788872867.160095:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc822c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:93091:x1875765327794944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872867.160953:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc822c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:93091:x1875765327794944:12345-0@lo:502:llog_process_th.0 Request processed in 855us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872867.160964:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788872867.161128:0:93091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93091:1875765327794944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872867.161178:0:93091:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788872867.161205:0:93091:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872867.161208:0:93091:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:1.0:1788872867.161216:0:93091:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1788872867.161317:0:93091:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:1.0:1788872867.161358:0:93091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93091:1875765327795072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872867.161409:0:93091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872867.161824:0:93091:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ff5bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872867.161958:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327795072 00000100:00100000:3.0:1788872867.161967:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327795072 00000100:00100000:3.0:1788872867.162026:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788872867.162045:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:93091:x1875765327795072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872867.162193:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:93091:x1875765327795072:12345-0@lo:502:llog_process_th.0 Request processed in 149us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872867.162202:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788872867.162577:0:93091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93091:1875765327795072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872867.162657:0:93091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93091:1875765327795200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872867.162711:0:93091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872867.162738:0:93091:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ff5bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872867.162813:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327795200 00000100:00100000:3.0:1788872867.162818:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327795200 00000100:00100000:3.0:1788872867.162841:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788872867.162849:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:93091:x1875765327795200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872867.162929:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:93091:x1875765327795200:12345-0@lo:502:llog_process_th.0 Request processed in 80us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872867.162937:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788872867.163124:0:93091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93091:1875765327795200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872867.163148:0:93091:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872867.163159:0:93091:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872867.163162:0:93091:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:1.0:1788872867.163167:0:93091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:3.0:1788872867.164592:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:3.0:1788872867.164633:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788872867.164646:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db287 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872867.164661:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db287 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872867.164674:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788872867.164678:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff5b1000 from 52 10000000:01000000:3.0:1788872867.164682:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788872867.164737:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872867.164746:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872867.164758:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872867.164806:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327795328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.164893:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872867.170316:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788872867.170611:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327795328 00000100:00100000:2.0:1788872867.170624:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327795328 00000100:00100000:2.0:1788872867.170701:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788872867.170713:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327795328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872867.170735:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872867.170763:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db28e expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.170802:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db28e expref: 20 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.170816:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db28e expref: 20 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.170828:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899800, rc 0) 00000100:00100000:2.0:1788872867.170943:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327795328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (6050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872867.170950:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788872867.171042:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327795328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872867.171066:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.171100:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872867.171208:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327795456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.171254:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872867.171443:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c6585540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872867.172629:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327795456 00000100:00100000:2.0:1788872867.172646:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327795456 00000100:00100000:2.0:1788872867.172717:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788872867.172727:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327795456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.175968:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327795456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3229us (4698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872867.175989:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788872867.176385:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327795456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.178161:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327795584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.178905:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872867.178978:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c6585540 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.179115:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327795584 00000100:00100000:1.0:1788872867.179128:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327795584 00000100:00100000:1.0:1788872867.179392:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788872867.179408:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327795584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872867.179646:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327795584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.179655:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788872867.179790:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327795584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872867.181588:0:93092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93092:1875765327795712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872867.181703:0:93092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872867.181759:0:93092:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ff5bf300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872867.181874:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327795712 00000100:00100000:2.0:1788872867.181883:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327795712 00000100:00100000:2.0:1788872867.182115:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788872867.182128:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:93092:x1875765327795712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872867.182532:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:93092:x1875765327795712:12345-0@lo:502:llog_process_th.0 Request processed in 395us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872867.182542:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788872867.186095:0:93092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93092:1875765327795712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872867.186501:0:93092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93092:1875765327795840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872867.186665:0:93092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872867.186723:0:93092:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ff5bf300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872867.186912:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327795840 00000100:00100000:2.0:1788872867.186923:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327795840 00000100:00100000:2.0:1788872867.187121:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788872867.187135:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:93092:x1875765327795840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872867.188120:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:93092:x1875765327795840:12345-0@lo:502:llog_process_th.0 Request processed in 984us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872867.188124:0:93092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93092:1875765327795840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872867.188132:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000040:00080000:3.0:1788872867.188187:0:93092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1788872867.189191:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1788872867.189233:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872867.189248:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.189262:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872867.189274:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788872867.189277:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788872867.189281:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788872867.189338:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.189347:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.189378:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872867.189414:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327795968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.189496:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872867.191867:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e1f43300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.192180:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327795968 00000100:00100000:1.0:1788872867.192253:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327795968 00000100:00100000:1.0:1788872867.192333:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788872867.192366:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327795968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872867.192392:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872867.192421:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9c600/0xe4e6e89fb01db2a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db29c expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.192818:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9c600/0xe4e6e89fb01db2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db29c expref: 21 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.192834:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9c600/0xe4e6e89fb01db2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db29c expref: 21 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.192845:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c600, rc 0) 00000100:00100000:1.0:1788872867.193170:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327795968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 806us (3671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.193180:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788872867.193367:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327795968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872867.193393:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.193406:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872867.193514:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327796096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.193618:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872867.193670:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e1f43300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872867.193688:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327796096 00000100:00100000:0.0:1788872867.193693:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327796096 00000100:00100000:0.0:1788872867.193722:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788872867.193729:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327796096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.193898:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327796096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.193906:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788872867.194368:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327796096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.194411:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327796224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.194486:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872867.194502:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e1f43300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872867.194540:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327796224 00000100:00100000:0.0:1788872867.194545:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327796224 00000100:00100000:0.0:1788872867.194603:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788872867.194850:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327796224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.195300:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327796224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 688us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.195310:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788872867.195446:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327796224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872867.196894:0:93093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788872867.197529:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788872867.197733:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788872867.197749:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.197767:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872867.197781:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788872867.197784:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ef97c000 from 52 10000000:01000000:0.0:1788872867.197788:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788872867.197848:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.197858:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.197872:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872867.197909:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327796352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.198397:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872867.198545:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef2dbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.198914:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327796352 00000100:00100000:1.0:1788872867.199105:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327796352 00000100:00100000:0.0:1788872867.199404:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788872867.199417:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327796352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872867.199439:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872867.199465:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db2b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db2aa expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.199512:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2aa expref: 22 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.199537:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2aa expref: 22 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.199579:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52aea00, rc 0) 00000100:00100000:0.0:1788872867.199673:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327796352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 257us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.199680:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788872867.199800:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327796352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872867.199824:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.199835:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872867.199962:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327796480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872867.200035:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872867.200394:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ff5bf300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872867.200484:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327796480 00000100:00100000:2.0:1788872867.200493:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327796480 00000100:00100000:2.0:1788872867.200540:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788872867.200574:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327796480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.200752:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327796480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872867.200760:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788872867.201184:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327796480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.201307:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327796608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.201373:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872867.201417:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef2dbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.201527:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327796608 00000100:00100000:1.0:1788872867.201534:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327796608 00000100:00100000:1.0:1788872867.201597:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788872867.201605:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327796608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872867.201731:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327796608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.201738:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788872867.201829:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327796608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.202486:0:93094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93094:1875765327796736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872867.202594:0:93094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872867.202637:0:93094:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9eedbc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.202719:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327796736 00000100:00100000:1.0:1788872867.202725:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327796736 00000100:00100000:1.0:1788872867.202755:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788872867.202763:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f664d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:93094:x1875765327796736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872867.202903:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f664d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:93094:x1875765327796736:12345-0@lo:502:llog_process_th.0 Request processed in 140us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872867.202910:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788872867.203173:0:93094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93094:1875765327796736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872867.203235:0:93094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93094:1875765327796864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872867.203276:0:93094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.203313:0:93094:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5504480 going to sleep for 11 seconds 00000100:00100000:3.0:1788872867.206129:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327796864 00000100:00100000:3.0:1788872867.206155:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327796864 00000100:00100000:0.0:1788872867.208436:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788872867.208466:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:93094:x1875765327796864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872867.208828:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:93094:x1875765327796864:12345-0@lo:502:llog_process_th.0 Request processed in 377us (5549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.208837:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788872867.209475:0:93094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93094:1875765327796864:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788872867.209595:0:93094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1788872867.209766:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1788872867.209800:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788872867.209815:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.209828:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872867.209839:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788872867.209842:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788872867.209846:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788872867.209892:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.209901:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.209911:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872867.209940:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327796992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.210070:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.210121:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5504480 going to sleep for 11 seconds 00000100:00100000:1.0:1788872867.211116:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327796992 00000100:00100000:1.0:1788872867.211131:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327796992 00000100:00100000:1.0:1788872867.211275:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788872867.211287:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327796992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872867.211306:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872867.211331:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d200/0xe4e6e89fb01db2bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db2b8 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.212289:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d200/0xe4e6e89fb01db2bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2b8 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.212331:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9d200/0xe4e6e89fb01db2bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2b8 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872867.212343:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d200, rc 0) 00000100:00100000:0.0:1788872867.212963:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327796992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1672us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.212984:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788872867.213150:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327796992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872867.213294:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.213310:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db2bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872867.215962:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327797120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.216144:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.216274:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5504480 going to sleep for 11 seconds 00000100:00100000:0.0:1788872867.216450:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327797120 00000100:00100000:0.0:1788872867.216461:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327797120 00000100:00100000:0.0:1788872867.216652:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788872867.216664:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df43a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327797120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.216877:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df43a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327797120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.216885:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788872867.216968:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327797120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.217035:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327797248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.217105:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.218744:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327797248 00000100:00100000:2.0:1788872867.218761:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327797248 00000100:00100000:2.0:1788872867.218825:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788872867.218838:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327797248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.219593:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327797248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 753us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872867.219604:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788872867.220913:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872867.221059:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327797248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872867.222877:0:93095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1788872867.223776:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788872867.223813:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788872867.223828:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.223843:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872867.223856:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788872867.223859:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98a9e9b999c0 from 1 10000000:01000000:2.0:1788872867.223862:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788872867.223923:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.223933:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872867.224037:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872867.224073:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327797376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872867.224168:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872867.224338:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5504900 going to sleep for 11 seconds 00000100:00100000:0.0:1788872867.224393:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327797376 00000100:00100000:0.0:1788872867.224406:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327797376 00000100:00100000:0.0:1788872867.224516:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788872867.224541:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327797376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872867.224774:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872867.224795:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01db2cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db2c6 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.224832:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01db2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2c6 expref: 24 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.224845:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01db2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2c6 expref: 24 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872867.224869:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52ae800, rc 0) 00000100:00100000:0.0:1788872867.224942:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327797376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 405us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.224950:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788872867.225073:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327797376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872867.225093:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872867.225103:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db2cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872867.225201:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327797504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872867.225246:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872867.225419:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98aa002d8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872867.225499:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327797504 00000100:00100000:0.0:1788872867.225503:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327797504 00000100:00100000:0.0:1788872867.225539:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788872867.225546:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327797504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872867.225682:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327797504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (435us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788872867.225701:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788872867.226095:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327797504:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788872867.226133:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788872867.226141:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872867.226152:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872867.609202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872867.609268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872867.609309:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872867.609338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872867.609410:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311210752 00000100:00100000:2.0:1788872867.609424:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311210752 00000100:00100000:2.0:1788872867.609507:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2683 00000100:00100000:2.0:1788872867.609537:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311210752:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872867.609652:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311210752:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 117us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872867.609662:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2683 00000100:00100000:0.0:1788872867.610664:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311210496 00000100:00100000:0.0:1788872867.610688:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311210496 00000100:00100000:0.0:1788872867.610765:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311210624 00000100:00100000:0.0:1788872867.610770:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311210624 00000100:00100000:0.0:1788872867.610806:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1377 00000100:00100000:0.0:1788872867.610816:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2406:x1875765311210496:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872867.610911:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2406:x1875765311210496:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 96us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.610918:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1377 00000100:00100000:0.0:1788872867.610935:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1378 00000100:00100000:0.0:1788872867.610942:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311210624:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872867.610990:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311210624:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 48us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.611019:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1378 00000100:00100000:0.0:1788872867.611191:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311210368 00000100:00100000:0.0:1788872867.611197:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311210368 00000100:00100000:0.0:1788872867.611228:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 123 00000100:00100000:0.0:1788872867.611235:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311210368:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872867.611269:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311210368:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 34us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872867.611276:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 123 00000100:00080000:0.0:1788872867.614508:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872867.614534:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872867.614540:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788872868.153071:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872869.176732:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872869.569816:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327797632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872869.569857:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327797760:0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.570021:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872869.570083:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327798272:0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.570114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872869.570137:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327798784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872869.570166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872869.570186:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327799296:0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.570208:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872869.570237:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788872869.570244:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327797888:0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.570269:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872869.570290:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327798528:0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.570314:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872869.570333:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327798912:0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.570383:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872869.570412:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327799424:0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.570434:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872869.570540:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327798784 00000100:00100000:3.0:1788872869.570568:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327798784 00000100:00100000:3.0:1788872869.570621:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327799296 00000100:00100000:3.0:1788872869.570625:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327799296 00000100:00100000:0.0:1788872869.570649:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327798912 00000100:00100000:3.0:1788872869.570655:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:0.0:1788872869.570656:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327798912 00000100:00100000:3.0:1788872869.570668:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327798784:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872869.570703:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327799424 00000100:00100000:0.0:1788872869.570708:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327799424 00000004:00000024:3.0:1788872869.570718:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445044224 avail 1298804736 00000100:00100000:0.0:1788872869.570734:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:0.0:1788872869.570743:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327798912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.570782:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327798784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872869.570790:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00100000:0.0:1788872869.570808:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327798912:12345-0@lo:400:kworker.0 Request processed in 66us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872869.570815:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:0.0:1788872869.570820:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00100000:3.0:1788872869.570825:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327799296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872869.570840:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:0.0:1788872869.570849:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327799424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.570863:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327799296:12345-0@lo:400:kworker.0 Request processed in 40us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872869.570871:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00100000:0.0:1788872869.570888:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327799424:12345-0@lo:400:kworker.0 Request processed in 40us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872869.570894:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327798272 00000100:00100000:0.0:1788872869.570897:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000100:00100000:3.0:1788872869.570900:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327798272 00000100:00080000:0.0:1788872869.570919:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872869.570931:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327797888 00000100:00080000:0.0:1788872869.570935:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872869.570936:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327797888 00000100:00080000:0.0:1788872869.570958:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872869.570969:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327798528 00000100:00100000:3.0:1788872869.570973:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327798528 00000100:00100000:3.0:1788872869.571003:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1788872869.571009:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327798272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.571040:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327798272:12345-0@lo:400:kworker.0 Request processed in 31us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872869.571052:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1788872869.571064:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1788872869.571069:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327797888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.571099:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327797888:12345-0@lo:400:kworker.0 Request processed in 30us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872869.571104:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1788872869.571115:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1788872869.571121:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327798528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.571149:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327798528:12345-0@lo:400:kworker.0 Request processed in 28us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872869.571155:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1788872869.571223:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327797888:0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.571237:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327798528:0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.571245:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969455 gen 2 00000004:00080000:3.0:1788872869.571252:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98a9ee81c380, transno 4294969455 00000100:00100000:3.0:1788872869.571266:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327798912:0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.571277:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327799424:0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.571286:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327798272:0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.571303:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327798784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872869.571313:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327799296:0@lo:400:kworker.0 00000100:00100000:2.0:1788872869.571581:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327797760 00000100:00100000:2.0:1788872869.571587:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327797760 00000100:00100000:2.0:1788872869.571622:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788872869.571628:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327797760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872869.571671:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327797760:12345-0@lo:400:kworker.0 Request processed in 43us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872869.571677:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788872869.571738:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327797760:0@lo:400:kworker.0 00000100:00080000:0.0:1788872869.572238:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872869.573188:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327798144:0@lo:400:kworker.0 00000100:00100000:0.0:1788872869.573403:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872869.573461:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327798400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872869.573503:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872869.573528:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327799040:0@lo:400:kworker.0 00000100:00100000:0.0:1788872869.573570:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872869.573590:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327799552:0@lo:400:kworker.0 00000100:00100000:0.0:1788872869.573617:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872869.573651:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788872869.573658:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327799168:0@lo:400:kworker.0 00000100:00100000:0.0:1788872869.573683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872869.573701:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327799680:0@lo:400:kworker.0 00000100:00100000:0.0:1788872869.573724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872869.573741:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327798144 00000100:00100000:2.0:1788872869.573752:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327798144 00000100:00100000:2.0:1788872869.573835:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327799168 00000100:00100000:2.0:1788872869.573838:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327799168 00000100:00100000:2.0:1788872869.573852:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327799680 00000100:00100000:2.0:1788872869.573855:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327799680 00000100:00100000:2.0:1788872869.573872:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:2.0:1788872869.573881:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327798144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872869.573907:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1788872869.573918:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327799168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872869.573960:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327798144:12345-0@lo:400:kworker.0 Request processed in 78us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872869.573969:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327799168:12345-0@lo:400:kworker.0 Request processed in 51us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872869.573975:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:0.0:1788872869.573983:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:2.0:1788872869.574000:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1788872869.574201:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327798400 00000100:00100000:1.0:1788872869.574203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872869.574206:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327798400 00000100:00100000:1.0:1788872869.574243:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327799040 00000100:00100000:1.0:1788872869.574248:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327799040 00000100:00100000:3.0:1788872869.574264:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163 00000100:00100000:3.0:1788872869.574272:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327798400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872869.574300:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872869.574342:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875765327798400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872869.574349:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163 00000100:00100000:3.0:1788872869.574370:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327799552 00000100:00100000:3.0:1788872869.574374:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327799552 00000100:00100000:3.0:1788872869.574401:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:3.0:1788872869.574407:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327799552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872869.574438:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327799552:12345-0@lo:400:kworker.0 Request processed in 31us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872869.574614:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327799680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872869.574650:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327799680:12345-0@lo:400:kworker.0 Request processed in 642us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872869.574693:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1788872869.576414:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1788872869.576430:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327799040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872869.576575:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327799040:12345-0@lo:400:kworker.0 Request processed in 149us (3003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872869.576583:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1788872869.576849:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327797632 00000100:00100000:1.0:1788872869.576860:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327797632 00000100:00100000:1.0:1788872869.576899:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:1.0:1788872869.576906:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327797632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872869.576944:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1788872869.576985:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327797632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (2783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872869.576991:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00100000:1.0:1788872869.579212:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327797632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872869.579238:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327798016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872869.579336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872869.579454:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327798016 00000100:00100000:1.0:1788872869.579495:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327798016 00000100:00100000:1.0:1788872869.579579:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164 00000100:00100000:1.0:1788872869.579588:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327798016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788872869.579628:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872869.579673:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327798016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872869.579681:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164 00000100:00100000:1.0:1788872869.579733:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327798016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872869.579743:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327798656:0@lo:400:kworker.0 00000100:00100000:1.0:1788872869.579902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872869.585191:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327798656 00000100:00100000:0.0:1788872869.585220:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327798656 00000100:00100000:0.0:1788872869.585320:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:0.0:1788872869.585333:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327798656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872869.585430:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00080000:2.0:1788872869.585494:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872869.585504:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872869.585590:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327799168:0@lo:400:kworker.0 00000100:00100000:2.0:1788872869.585619:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327799680:0@lo:400:kworker.0 00000100:00100000:2.0:1788872869.585636:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327798144:0@lo:400:kworker.0 00000100:00100000:2.0:1788872869.585667:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327798400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872869.585673:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327798656:12345-0@lo:400:kworker.0 Request processed in 341us (5898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872869.585683:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327799040:0@lo:400:kworker.0 00000100:00100000:2.0:1788872869.585696:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327799552:0@lo:400:kworker.0 00000100:00100000:0.0:1788872869.585697:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00100000:1.0:1788872869.587162:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327798656:0@lo:400:kworker.0 00000020:00080000:3.0:1788872869.593677:0:75620:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444091 batchid updated 00000020:00080000:0.0:1788872869.594975:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444091 00000004:00080000:1.0:1788872869.595139:0:75640:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98a8c4812180 with version 12 00000020:00080000:1.0:1788872869.595157:0:75640:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444091 cancel update log [0x2000090a1:0x2:0x0].3: rc = 0 00000020:00080000:1.0:1788872869.595270:0:75640:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444091 cancel update log [0x2400088d0:0x2:0x0].3: rc = 0 00000020:00080000:1.0:1788872869.595281:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444091 00000004:00080000:2.0:1788872869.595323:0:75625:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98a8c5c4f240 version 12 rpc_version 12 00000020:00100000:2.0:1788872869.595371:0:75625:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788872869.595385:0:75625:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98a8c4a16300 x1875765327799936/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872869.595416:0:75625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327799936:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788872869.595522:0:75625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872869.595583:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c79f6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872869.595671:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327799936 00000100:00100000:1.0:1788872869.595682:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327799936 00000100:00100000:1.0:1788872869.595742:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:1.0:1788872869.595751:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75625:x1875765327799936:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788872869.595910:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75625:x1875765327799936:12345-0@lo:1000:osp_up0-1.0 Request processed in 159us (388us total) trans 120259084291 rc 0/0 00000100:00100000:1.0:1788872869.595920:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00000100:00100000:0.0:1788872869.596689:0:75625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327799936:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788872870.073169:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872870.073204:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327800064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872870.073303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872870.073371:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327800064 00000100:00100000:3.0:1788872870.073382:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327800064 00000100:00100000:3.0:1788872870.073446:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165 00000100:00100000:3.0:1788872870.073456:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327800064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872870.073498:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872870.073579:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327800064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872870.073587:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165 00000100:00100000:3.0:1788872870.073644:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327800064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872870.074086:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872870.074102:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327800192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872870.074150:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872870.074225:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327800192 00000100:00100000:1.0:1788872870.074231:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327800192 00000100:00100000:1.0:1788872870.074278:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:1.0:1788872870.074287:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327800192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872870.074325:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872870.074373:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327800192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872870.074379:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:2.0:1788872870.074453:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327800192:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788872870.201328:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788872870.546094:0:93193:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd263a3680 20000000:00000080:3.0:1788872870.546130:0:93193:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff98a8c7311c00 uarg=0000000000000000 00000040:00100000:3.0:1788872870.548078:0:93193:0:(llog.c:1072:llog_reverse_process()) index 54 : idx 49 20000000:01000000:3.0:1788872870.548095:0:93193:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:3.0:1788872870.548230:0:93193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:3.0:1788872870.548266:0:93193:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1788872870.548287:0:93193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:3.0:1788872870.548306:0:93193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:3.0:1788872870.548395:0:93193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:3.0:1788872870.548403:0:93193:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1788872870.548416:0:93193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:3.0:1788872870.548433:0:93193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:3.0:1788872870.548520:0:93193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:3.0:1788872870.548529:0:93193:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1788872870.548542:0:93193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:3.0:1788872870.548585:0:93193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:3.0:1788872870.548600:0:93193:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788872870.548627:0:93193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.548654:0:93193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01db248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb112 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.548663:0:93193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01db24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb119 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.548671:0:93193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01db25d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db256 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.548678:0:93193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c4f9c000/0xe4e6e89fb01db26b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db264 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.549045:0:93193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db272 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.549053:0:93193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01db287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db280 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.549062:0:93193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db28e expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.549069:0:93193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c4f9c600/0xe4e6e89fb01db2a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db29c expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.549076:0:93193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db2b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2aa expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.549083:0:93193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c4f9d200/0xe4e6e89fb01db2bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2b8 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.549089:0:93193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01db2cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2c6 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.549097:0:93193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.549148:0:93193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01db2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db2c6 expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.549166:0:93193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01db2cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db2c6 expref: 23 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.549197:0:93193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327800320:0@lo:104: 00000100:00100000:3.0:1788872870.549635:0:93193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788872870.549717:0:93193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c4f9d200/0xe4e6e89fb01db2bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db2b8 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.549728:0:93193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c4f9d200/0xe4e6e89fb01db2bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db2b8 expref: 23 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.549737:0:93193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327800448:0@lo:104: 00000100:00100000:3.0:1788872870.549761:0:93193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788872870.550057:0:93193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db2aa expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.550066:0:93193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db2b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db2aa expref: 23 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.550075:0:93193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327800576:0@lo:104: 00000100:00100000:3.0:1788872870.550098:0:93193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872870.550140:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327800320 00000100:00100000:3.0:1788872870.550149:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327800320 00000100:00100000:3.0:1788872870.550203:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327800448 00000100:00100000:3.0:1788872870.550206:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327800448 00000100:00100000:3.0:1788872870.550217:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327800576 00000100:00100000:3.0:1788872870.550220:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327800576 00000100:00100000:3.0:1788872870.550306:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788872870.550320:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:93193:x1875765327800320:12345-0@lo:104: 00010000:00010000:3.0:1788872870.550337:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db2cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.551825:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788872870.551845:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:93193:x1875765327800320:12345-0@lo:104: Request processed in 1522us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872870.551858:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788872870.551905:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788872870.551915:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:93193:x1875765327800448:12345-0@lo:104: 00010000:00010000:3.0:1788872870.551934:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db2bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872870.552077:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788872870.552089:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:93193:x1875765327800576:12345-0@lo:104: 00010000:00010000:0.0:1788872870.552101:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872870.552196:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788872870.552201:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:93193:x1875765327800576:12345-0@lo:104: Request processed in 116us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872870.552208:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:3.0:1788872870.552475:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788872870.552482:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:93193:x1875765327800448:12345-0@lo:104: Request processed in 571us (2719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872870.552488:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00010000:3.0:1788872870.552512:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788872870.552519:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db2cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552528:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898a00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872870.552533:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db2cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552543:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db2cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872870.552579:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db2cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872870.552587:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872870.552657:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db2cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552664:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872870.552693:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db2cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552701:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01db2c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db2cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552719:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872870.552723:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552729:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52afa00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872870.552731:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552739:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872870.552745:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872870.552750:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872870.552764:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552770:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872870.552777:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552794:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52afa00/0xe4e6e89fb01db2aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552805:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872870.552808:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db2bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552815:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872870.552818:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db2bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552826:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db2bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872870.552832:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db2bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872870.552837:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872870.552851:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db2bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552857:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872870.552873:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db2bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552880:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db2b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db2bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.552890:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872870.552897:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872870.552899:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872870.552907:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872870.552926:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788872870.553054:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872870.553128:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327800832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872870.553187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872870.553266:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872870.553273:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327800704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872870.553297:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872870.553319:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327800960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872870.553396:0:93193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c4f9c600/0xe4e6e89fb01db2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db29c expref: 23 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.553411:0:93193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c4f9c600/0xe4e6e89fb01db2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db29c expref: 23 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.553422:0:93193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327801088:0@lo:104: 00000100:00100000:3.0:1788872870.553463:0:93193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872870.553498:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327801088 00000100:00100000:3.0:1788872870.553506:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327801088 00000100:00100000:3.0:1788872870.553570:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788872870.553578:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:93193:x1875765327801088:12345-0@lo:104: 00010000:00010000:3.0:1788872870.553589:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.553638:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788872870.553644:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:93193:x1875765327801088:12345-0@lo:104: Request processed in 67us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872870.553650:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00010000:2.0:1788872870.553670:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872870.553678:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872870.553685:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872870.553688:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.553694:0:93193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db28e expref: 23 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872870.553697:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.553703:0:93193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db28e expref: 23 pid: 92459 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.553727:0:93193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7832a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327801216:0@lo:104: 00000100:00100000:3.0:1788872870.553753:0:93193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788872870.553780:0:93193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01db287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db280 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872870.553785:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.553789:0:93193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01db287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db280 expref: 23 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872870.553794:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788872870.553797:0:93193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7831f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327801344:0@lo:104: 00010000:00010000:2.0:1788872870.553820:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.553821:0:93193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788872870.553838:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788872870.553853:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1788872870.553854:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872870.553860:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52af000/0xe4e6e89fb01db29c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.553863:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327801216 00000100:00100000:3.0:1788872870.553865:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327801216 00010000:00010000:2.0:1788872870.553874:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872870.553876:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872870.553878:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872870.553884:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327801344 00000100:00100000:3.0:1788872870.553887:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327801344 00000100:00100000:2.0:1788872870.553889:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788872870.553897:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:93193:x1875765327801216:12345-0@lo:104: 00000100:00100000:3.0:1788872870.553898:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788872870.553902:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7310c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:93193:x1875765327801344:12345-0@lo:104: 00010000:00010000:2.0:1788872870.553906:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.553909:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db287 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.553955:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788872870.553961:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7310c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:93193:x1875765327801344:12345-0@lo:104: Request processed in 58us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872870.553968:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788872870.554544:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327800832 00000100:00100000:0.0:1788872870.554571:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327800832 00000100:00100000:0.0:1788872870.555708:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327800704 00000100:00100000:0.0:1788872870.555723:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327800704 00010000:00010000:0.0:1788872870.555785:0:26197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01db2cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db2c6 expref: 25 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872870.555842:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:0.0:1788872870.555853:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3647:x1875765327800704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872870.555871:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872870.555877:0:26197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01db2cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db2c6 expref: 25 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872870.555891:0:26197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01db2cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db2c6 expref: 25 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872870.555931:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872870.556053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872870.556114:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327801472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872870.556182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872870.556220:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327800960 00000100:00100000:1.0:1788872870.556225:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327800960 00010000:00010000:1.0:1788872870.556254:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c4f9d200/0xe4e6e89fb01db2bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db2b8 expref: 26 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872870.556275:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327801472 00000100:00100000:1.0:1788872870.556277:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327801472 00010000:00010000:1.0:1788872870.556289:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c4f9c600/0xe4e6e89fb01db2a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db29c expref: 27 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872870.556308:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1788872870.556314:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+27:3645:x1875765327800960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872870.556323:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872870.556327:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c4f9d200/0xe4e6e89fb01db2bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db2b8 expref: 27 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.556348:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c4f9d200/0xe4e6e89fb01db2bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db2b8 expref: 27 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.556373:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872870.556409:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+27:3645:x1875765327800960:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872870.556418:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1788872870.556436:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1788872870.556442:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+26:3645:x1875765327801472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872870.556450:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872870.556466:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c4f9c600/0xe4e6e89fb01db2a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db29c expref: 26 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.556476:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c4f9c600/0xe4e6e89fb01db2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db29c expref: 26 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.556487:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872870.556508:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+26:3645:x1875765327801472:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872870.556515:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1788872870.556582:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327801472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872870.556593:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327800960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872870.557093:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3647:x1875765327800704:12345-0@lo:103:ldlm_bl.0 Request processed in 1239us (3791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872870.557101:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00010000:00010000:1.0:1788872870.557164:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db2b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db2aa expref: 24 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872870.557200:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1788872870.557206:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327800832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872870.557218:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872870.557224:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db2b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db2aa expref: 24 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872870.557326:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327800704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872870.557431:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db2b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db2aa expref: 24 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.557446:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872870.557767:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788872870.557779:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:93193:x1875765327801216:12345-0@lo:104: Request processed in 3879us (4022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872870.557789:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00010000:00010000:0.0:1788872870.557826:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872870.557837:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db287 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872870.557846:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872870.557851:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db287 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872870.557860:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db287 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872870.557868:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db287 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872870.557875:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872870.557925:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db287 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872870.557933:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872870.557970:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db287 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872870.557978:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae200/0xe4e6e89fb01db280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db287 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872870.557997:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872870.558000:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872870.558008:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327801600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872870.558017:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872870.558020:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872870.558026:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872870.558033:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872870.558038:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872870.558056:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872870.558062:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788872870.558066:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788872870.558068:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872870.558074:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9efac4800/0xe4e6e89fb01db28e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872870.558084:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872870.558085:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872870.558087:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872870.558097:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327801728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872870.558114:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327801600 00000100:00100000:2.0:1788872870.558121:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327801600 00000100:00100000:0.0:1788872870.558124:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788872870.558141:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01db287 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db280 expref: 25 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872870.558161:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327801728 00000100:00100000:2.0:1788872870.558164:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327801728 00010000:00010000:2.0:1788872870.558185:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db295 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db28e expref: 26 pid: 92459 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872870.558360:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:2.0:1788872870.558369:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+26:3646:x1875765327801600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872870.558379:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872870.558384:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01db287 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db280 expref: 26 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872870.558393:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01db287 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db280 expref: 26 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872870.558406:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872870.558439:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+26:3646:x1875765327801600:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872870.558446:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:2.0:1788872870.558475:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:2.0:1788872870.558481:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3647:x1875765327801728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872870.558490:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872870.558495:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db295 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db28e expref: 25 pid: 92459 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872870.558504:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db28e expref: 25 pid: 92459 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872870.558513:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872870.558538:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3647:x1875765327801728:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872870.558545:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00010000:00010000:3.0:1788872870.558575:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872870.558600:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327801600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872870.558621:0:93193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db272 expref: 24 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.558707:0:93193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db279 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db272 expref: 24 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.558720:0:93193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327801856:0@lo:104: 00000100:00100000:3.0:1788872870.558753:0:93193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788872870.558795:0:93193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c4f9c000/0xe4e6e89fb01db26b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db264 expref: 24 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.558802:0:93193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c4f9c000/0xe4e6e89fb01db26b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db264 expref: 24 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.558810:0:93193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327801984:0@lo:104: 00000100:00100000:3.0:1788872870.558829:0:93193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788872870.558853:0:93193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01db25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db256 expref: 24 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.558860:0:93193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01db25d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db256 expref: 24 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.558869:0:93193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327802112:0@lo:104: 00000100:00100000:3.0:1788872870.558887:0:93193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872870.558909:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327801856 00000100:00100000:3.0:1788872870.558913:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327801856 00000100:00100000:3.0:1788872870.558934:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327801984 00000100:00100000:3.0:1788872870.558937:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327801984 00000100:00100000:3.0:1788872870.558958:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327802112 00000100:00100000:3.0:1788872870.558960:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327802112 00000100:00100000:3.0:1788872870.558970:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788872870.558976:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:93193:x1875765327801856:12345-0@lo:104: 00010000:00010000:3.0:1788872870.558994:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db279 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.559036:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788872870.559041:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:93193:x1875765327801856:12345-0@lo:104: Request processed in 65us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872870.559048:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788872870.559065:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788872870.559071:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:93193:x1875765327801984:12345-0@lo:104: 00010000:00010000:3.0:1788872870.559078:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db26b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.559110:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788872870.559115:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:93193:x1875765327801984:12345-0@lo:104: Request processed in 45us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872870.559120:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788872870.559134:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788872870.559139:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:93193:x1875765327802112:12345-0@lo:104: 00010000:00010000:3.0:1788872870.559147:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.559179:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788872870.559184:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:93193:x1875765327802112:12345-0@lo:104: Request processed in 45us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872870.559190:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00010000:3.0:1788872870.559206:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788872870.559211:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db279 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.559226:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872870.559229:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db279 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.559352:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db279 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872870.559483:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db279 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872870.559490:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872870.559579:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db279 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.559587:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872870.559606:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db279 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.559614:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db279 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.559629:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872870.559632:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db26b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.559638:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872870.559641:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db26b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.559660:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db26b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872870.559667:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db26b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872870.559673:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788872870.559809:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327800832:12345-0@lo:103:ldlm_bl.0 Request processed in 2601us (6619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872870.559819:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1788872870.559856:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327802240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872870.559892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872870.559931:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327802240 00000100:00100000:1.0:1788872870.559936:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327802240 00010000:00010000:1.0:1788872870.560442:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db279 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db272 expref: 24 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872870.560487:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1788872870.560496:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327802240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872870.560510:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872870.560516:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db279 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db272 expref: 24 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.560527:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db279 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db272 expref: 24 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.560690:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872870.560735:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327802240:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872870.560742:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1788872870.560821:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327802240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872870.561435:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db26b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.561447:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872870.561483:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db26b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.561492:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa898000/0xe4e6e89fb01db264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db26b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.561508:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872870.561512:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.561519:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872870.561524:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.561533:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872870.561540:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872870.561579:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788872870.561657:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327802368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872870.561705:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872870.561759:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327802368 00000100:00100000:1.0:1788872870.561766:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327802368 00010000:00010000:1.0:1788872870.561790:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c4f9c000/0xe4e6e89fb01db26b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db264 expref: 24 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872870.561816:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:1.0:1788872870.561823:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327802368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872870.561833:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872870.561839:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c4f9c000/0xe4e6e89fb01db26b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db264 expref: 24 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.561849:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c4f9c000/0xe4e6e89fb01db26b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db264 expref: 24 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.561865:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872870.561896:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327802368:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872870.561903:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:1.0:1788872870.561935:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327802368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872870.562312:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.562320:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872870.562345:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.562353:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa898200/0xe4e6e89fb01db256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db25d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.562461:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872870.562464:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872870.562467:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872870.562477:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872870.562528:0:93193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01db24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb119 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.562541:0:93193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01db24f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb119 expref: 9 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.562585:0:93193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327802624:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788872870.562679:0:93193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01db248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb112 expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.562688:0:93193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01db248 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb112 expref: 9 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.562697:0:93193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327802752:192.168.204.39@tcp:104: 00000100:00100000:3.0:1788872870.562735:0:93193:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c76700c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788872870.562758:0:93193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52ae800/0xe4e6e89fb01db2cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db2c6 expref: 23 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.562772:0:93193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327800320:0@lo:104: 00010000:00010000:3.0:1788872870.562786:0:93193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9d200/0xe4e6e89fb01db2bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db2b8 expref: 22 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.562796:0:93193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327800448:0@lo:104: 00010000:00010000:3.0:1788872870.562805:0:93193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db2b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db2aa expref: 21 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.562814:0:93193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327800576:0@lo:104: 00010000:00010000:3.0:1788872870.562824:0:93193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9c600/0xe4e6e89fb01db2a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db29c expref: 20 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.562832:0:93193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327801088:0@lo:104: 00010000:00010000:3.0:1788872870.562842:0:93193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db28e expref: 19 pid: 92459 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.562851:0:93193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7832a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327801216:0@lo:104: 00010000:00010000:3.0:1788872870.562861:0:93193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9de00/0xe4e6e89fb01db287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db280 expref: 18 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.562868:0:93193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7831f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327801344:0@lo:104: 00010000:00010000:3.0:1788872870.562878:0:93193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db272 expref: 17 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.562899:0:93193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327801856:0@lo:104: 00010000:00010000:3.0:1788872870.562911:0:93193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9c000/0xe4e6e89fb01db26b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db264 expref: 16 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.562920:0:93193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327801984:0@lo:104: 00000100:00100000:3.0:1788872870.562929:0:93193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327802112:0@lo:104: 00000100:00100000:1.0:1788872870.563076:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327802496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872870.563117:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872870.563166:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327802496 00000100:00100000:1.0:1788872870.563173:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327802496 00010000:00010000:1.0:1788872870.563507:0:26198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01db25d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db256 expref: 16 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872870.563538:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:1.0:1788872870.563566:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:3646:x1875765327802496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872870.563581:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872870.563587:0:26198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01db25d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db256 expref: 16 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.563600:0:26198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01db25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db256 expref: 16 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.563615:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9d400/0xe4e6e89fb01db25d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db256 expref: 16 pid: 92460 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.563629:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872870.563669:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:3646:x1875765327802496:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872870.563676:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:1.0:1788872870.563710:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327802496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872870.563838:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872870.566860:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327801728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872870.566897:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327800832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872870.568003:0:93193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327802624:192.168.204.39@tcp:104: 00000100:00100000:0.0:1788872870.569986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872870.570099:0:93193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93193:1875765327802752:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788872870.570180:0:93193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872870.570443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872870.581438:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311211008 00000100:00100000:2.0:1788872870.581477:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311211008 00000100:00100000:1.0:1788872870.581578:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311210880 00000100:00100000:1.0:1788872870.581584:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311210880 00010000:00010000:1.0:1788872870.581653:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01db24f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb119 expref: 11 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872870.581749:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2586 00000100:00100000:1.0:1788872870.581762:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67645b7-2296-4087-92b1-886500c47477+11:2407:x1875765311210880:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788872870.581783:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872870.581790:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01db24f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb119 expref: 11 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.581806:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01db24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb119 expref: 11 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.581831:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52af400/0xe4e6e89fb01db24f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb119 expref: 11 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.581854:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872870.581956:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311210880:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 197us (11984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872870.581965:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2586 00010000:00010000:3.0:1788872870.584781:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01db248 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb112 expref: 9 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872870.584846:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2587 00000100:00100000:3.0:1788872870.584860:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c67645b7-2296-4087-92b1-886500c47477+9:2407:x1875765311211008:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788872870.584879:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872870.584885:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01db248 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb112 expref: 9 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.584900:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01db248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb112 expref: 9 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.584924:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9c800/0xe4e6e89fb01db248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb112 expref: 9 pid: 92461 timeout: 3907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.585078:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.585087:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.585109:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.585116:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.585123:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.585131:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.585138:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872870.585143:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.585152:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.585800:0:93193:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872870.585813:0:93193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.586044:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.586056:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872870.586093:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872870.586345:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c67645b7-2296-4087-92b1-886500c47477+8:2407:x1875765311211008:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 1484us (15896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872870.586366:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2587 00010000:00010000:3.0:1788872871.225100:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872871.629942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872871.630260:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311211136 00000100:00100000:2.0:1788872871.630286:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311211136 00000100:00100000:2.0:1788872871.630474:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 125 00000100:00100000:2.0:1788872871.630487:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+8:71021:x1875765311211136:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872871.630528:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872871.630612:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa899e00/0xe4e6e89fb01db2db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb120 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872871.630658:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa899e00/0xe4e6e89fb01db2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb120 expref: 9 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872871.630674:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa899e00/0xe4e6e89fb01db2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb120 expref: 9 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872871.630686:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899e00, rc 0) 00000100:00100000:2.0:1788872871.630807:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311211136:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 322us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872871.630829:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 125 00000100:00100000:3.0:1788872871.637047:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872871.637793:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311211264 00000100:00100000:2.0:1788872871.637810:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311211264 00000100:00100000:2.0:1788872871.638049:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 126 00000100:00100000:2.0:1788872871.638067:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311211264:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872871.639145:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311211264:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 1071us (2274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872871.639160:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 126 00000100:00100000:0.0:1788872871.645240:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872871.646483:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311211392 00000100:00100000:3.0:1788872871.646505:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311211392 00000100:00100000:3.0:1788872871.647651:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 127 00000100:00100000:3.0:1788872871.647674:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311211392:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872871.649620:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311211392:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 1933us (4383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872871.649641:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 127 00000100:00100000:0.0:1788872871.659262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872871.661113:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311211520 00000100:00100000:2.0:1788872871.661137:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311211520 00000100:00100000:2.0:1788872871.661242:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 128 00000100:00100000:2.0:1788872871.661258:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:72013:x1875765311211520:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788872871.661525:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:72013:x1875765311211520:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 270us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872871.661537:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 128 00000100:00100000:0.0:1788872871.668182:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872871.668769:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311211648 00000100:00100000:3.0:1788872871.668784:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311211648 00000100:00100000:3.0:1788872871.668866:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 129 00000100:00100000:3.0:1788872871.668889:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+9:72013:x1875765311211648:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788872871.669131:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+9:72013:x1875765311211648:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 253us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872871.669140:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 129 00000100:00100000:0.0:1788872871.680630:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872871.682074:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311211776 00000100:00100000:2.0:1788872871.682100:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311211776 00000100:00100000:2.0:1788872871.682208:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 130 00000100:00100000:2.0:1788872871.682233:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311211776:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872871.682260:0:92459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872871.682293:0:92459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db2e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb127 expref: -99 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872871.682347:0:92459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb127 expref: 10 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872871.682360:0:92459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb127 expref: 10 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872871.682371:0:92459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899a00, rc 0) 00000100:00100000:2.0:1788872871.682469:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311211776:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 240us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872871.682520:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 130 00000100:00100000:0.0:1788872871.690516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872871.692043:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311211904 00000100:00100000:2.0:1788872871.692063:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311211904 00000100:00100000:2.0:1788872871.692162:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 131 00000100:00100000:2.0:1788872871.692174:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311211904:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872871.692529:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311211904:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 355us (2028us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788872871.692538:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 131 10000000:01000000:0.0:1788872871.929998:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788872871.930015:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff63e800 from 55 10000000:01000000:0.0:1788872871.930025:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788872871.930119:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872871.930135:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872871.930147:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872871.930187:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327802880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872871.930300:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872871.930523:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9ec69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872871.930995:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327802880 00000100:00100000:3.0:1788872871.931010:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327802880 00000100:00100000:3.0:1788872871.931101:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788872871.931114:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327802880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872871.931135:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872871.931190:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db2e9 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872871.931307:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2e9 expref: 16 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872871.931323:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2e9 expref: 16 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872871.931416:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5600, rc 0) 00000100:00100000:3.0:1788872871.932327:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327802880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1205us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872871.932351:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788872871.942137:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327802880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872871.942187:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872871.942204:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872871.942523:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327803008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872871.942812:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872871.942877:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c8e55000 going to sleep for 11 seconds 00000100:00100000:0.0:1788872871.942993:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327803008 00000100:00100000:0.0:1788872871.943004:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327803008 00000100:00100000:0.0:1788872871.943061:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788872871.943072:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327803008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872871.943249:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327803008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872871.943257:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788872871.943352:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327803008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872871.943407:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327803136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872871.943471:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872871.943491:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c8e55000 going to sleep for 11 seconds 00000100:00100000:2.0:1788872871.943619:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327803136 00000100:00100000:2.0:1788872871.943629:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327803136 00000100:00100000:2.0:1788872871.943688:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788872871.943698:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327803136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872871.943886:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327803136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872871.943893:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788872871.944714:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327803136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872871.958609:0:93194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93194:1875765327803264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872871.958740:0:93194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872871.958793:0:93194:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7670540 going to sleep for 11 seconds 00000100:00100000:0.0:1788872871.958941:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327803264 00000100:00100000:0.0:1788872871.958956:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327803264 00000100:00100000:0.0:1788872871.959009:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788872871.959019:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:93194:x1875765327803264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872871.959182:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:93194:x1875765327803264:12345-0@lo:502:llog_process_th.0 Request processed in 163us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872871.959195:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788872871.959364:0:93194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93194:1875765327803264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872871.959417:0:93194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93194:1875765327803392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872871.959461:0:93194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872871.959484:0:93194:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c8e55000 going to sleep for 11 seconds 00000100:00100000:3.0:1788872871.959544:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327803392 00000100:00100000:3.0:1788872871.959569:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327803392 00000100:00100000:3.0:1788872871.959604:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788872871.959612:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:93194:x1875765327803392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872871.959685:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:93194:x1875765327803392:12345-0@lo:502:llog_process_th.0 Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872871.959693:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788872871.959832:0:93194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93194:1875765327803392:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788872871.959856:0:93194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1788872871.961217:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1788872871.961254:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788872871.961266:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872871.961280:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872871.961305:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788872871.961308:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:3.0:1788872871.961312:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788872871.961345:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872871.961354:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872871.961365:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872871.961389:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327803520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872871.961450:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872871.961491:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7670cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872871.961654:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327803520 00000100:00100000:2.0:1788872871.961661:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327803520 00000100:00100000:2.0:1788872871.961708:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788872871.961716:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327803520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872871.961730:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872871.961744:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa898800/0xe4e6e89fb01db2fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db2f7 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872871.961768:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa898800/0xe4e6e89fb01db2fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2f7 expref: 17 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872871.961792:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa898800/0xe4e6e89fb01db2fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db2f7 expref: 17 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872871.961800:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa898800, rc 0) 00000100:00100000:2.0:1788872871.961845:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327803520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872871.961852:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788872871.961966:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327803520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872871.961979:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872871.961988:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872871.962044:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327803648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872871.962068:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872871.962097:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7670cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872871.962165:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327803648 00000100:00100000:0.0:1788872871.962170:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327803648 00000100:00100000:0.0:1788872871.962203:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788872871.962211:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327803648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872871.962353:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327803648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872871.962360:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788872871.962480:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327803648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872871.962508:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327803776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872871.962694:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872871.962782:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7670cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872871.971149:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327803776 00000100:00100000:1.0:1788872871.971167:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327803776 00000100:00100000:1.0:1788872871.971230:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788872871.971241:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327803776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872871.971449:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327803776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (8753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872871.971458:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788872871.971666:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327803776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872871.972317:0:93195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93195:1875765327803904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872871.972364:0:93195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872871.972402:0:93195:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c76706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872871.973677:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327803904 00000100:00100000:1.0:1788872871.973701:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327803904 00000100:00100000:1.0:1788872871.973756:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788872871.973765:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:93195:x1875765327803904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872871.973948:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:93195:x1875765327803904:12345-0@lo:502:llog_process_th.0 Request processed in 182us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872871.973956:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788872871.976790:0:93195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93195:1875765327803904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788872871.976844:0:93195:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872871.976860:0:93195:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872871.976863:0:93195:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1788872871.976869:0:93195:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1788872871.976888:0:93195:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:1.0:1788872871.977645:0:93195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93195:1875765327804032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872871.977731:0:93195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872871.977768:0:93195:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d26ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872871.977887:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327804032 00000100:00100000:0.0:1788872871.977895:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327804032 00000100:00100000:0.0:1788872871.977946:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788872871.977954:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:93195:x1875765327804032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872871.978100:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:93195:x1875765327804032:12345-0@lo:502:llog_process_th.0 Request processed in 146us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872871.978108:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788872871.978594:0:93195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93195:1875765327804032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872871.978624:0:93195:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872871.978631:0:93195:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872871.978633:0:93195:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1788872871.978639:0:93195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:1.0:1788872871.978699:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:1.0:1788872871.978725:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788872871.978735:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872871.978747:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872871.978757:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788872871.978759:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9d0cfb000 from 55 10000000:01000000:1.0:1788872871.978762:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788872871.978789:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d400/0xe4e6e89fb01db305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872871.978811:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d400/0xe4e6e89fb01db305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872871.978821:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d400/0xe4e6e89fb01db305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872871.978838:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327804160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872871.978873:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872871.978895:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d26ede40 going to sleep for 11 seconds 00000100:00100000:2.0:1788872871.979131:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327804160 00000100:00100000:2.0:1788872871.979137:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327804160 00000100:00100000:2.0:1788872871.979175:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788872871.979183:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327804160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872871.979196:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872871.979211:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db30c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db305 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872871.979233:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db30c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db305 expref: 18 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872871.979243:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db30c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db305 expref: 18 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872871.979250:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899800, rc 0) 00000100:00100000:2.0:1788872871.979290:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327804160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872871.979296:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000020:01000004:3.0:1788872871.979475:0:93196:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9ff63e800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788872871.979480:0:93196:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9ff63e800 4 00000100:00100000:1.0:1788872871.979738:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327804160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872871.979771:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d400/0xe4e6e89fb01db305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db30c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872871.979783:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d400/0xe4e6e89fb01db305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db30c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872871.979838:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327804288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872871.979867:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872871.979899:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d26ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872871.980829:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327804288 00000100:00100000:3.0:1788872871.980838:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327804288 00000100:00100000:3.0:1788872871.980884:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788872871.980892:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327804288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872871.981032:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327804288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872871.981040:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788872871.981411:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327804288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872871.981470:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327804416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872871.981768:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872871.981806:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d26ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872871.981860:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327804416 00000100:00100000:0.0:1788872871.981865:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327804416 00000100:00100000:0.0:1788872871.981901:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788872871.981909:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327804416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872871.982017:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327804416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872871.982035:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788872871.982137:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327804416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872871.982777:0:93197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93197:1875765327804544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872871.982821:0:93197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872871.982853:0:93197:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7670540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872871.982906:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327804544 00000100:00100000:2.0:1788872871.982911:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327804544 00000100:00100000:2.0:1788872871.982954:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788872871.982961:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:93197:x1875765327804544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872871.983066:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:93197:x1875765327804544:12345-0@lo:502:llog_process_th.0 Request processed in 105us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872871.983073:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788872871.983177:0:93197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93197:1875765327804544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872871.983214:0:93197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93197:1875765327804672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872871.983248:0:93197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872871.983269:0:93197:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7670540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872871.983309:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327804672 00000100:00100000:2.0:1788872871.983313:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327804672 00000100:00100000:2.0:1788872871.983339:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788872871.983345:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:93197:x1875765327804672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872871.983407:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:93197:x1875765327804672:12345-0@lo:502:llog_process_th.0 Request processed in 61us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872871.983413:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788872871.983504:0:93197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93197:1875765327804672:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788872871.983534:0:93197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1788872871.983869:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1788872871.983906:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788872871.983918:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d400/0xe4e6e89fb01db305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db30c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872871.983928:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d400/0xe4e6e89fb01db305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db30c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872871.983939:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788872871.983941:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:1.0:1788872871.983944:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788872871.983969:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872871.983976:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872871.983985:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872871.983998:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327804800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872871.984029:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872871.984049:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d26ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872871.984098:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327804800 00000100:00100000:0.0:1788872871.984103:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327804800 00000100:00100000:0.0:1788872871.984135:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788872871.984142:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327804800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872871.984150:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872871.984163:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01db31a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db313 expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872871.984184:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01db31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db313 expref: 19 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872871.984193:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01db31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db313 expref: 19 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872871.984201:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52afc00, rc 0) 00000100:00100000:0.0:1788872871.984243:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327804800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872871.984249:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788872871.984539:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327804800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872871.984586:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db31a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872871.984596:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db31a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872871.984646:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327804928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872871.984680:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872871.984696:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d26ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872871.985545:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327804928 00000100:00100000:0.0:1788872871.985584:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327804928 00000100:00100000:0.0:1788872871.985629:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788872871.985636:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327804928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872871.985794:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327804928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872871.985801:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788872871.985965:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327804928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872871.986004:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327805056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872871.986049:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872871.986073:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7670540 going to sleep for 11 seconds 00000100:00100000:0.0:1788872871.986123:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327805056 00000100:00100000:0.0:1788872871.986133:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327805056 00000100:00100000:0.0:1788872871.986149:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788872871.986154:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327805056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872871.986235:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327805056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872871.986241:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788872871.986303:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327805056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872871.986894:0:93198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93198:1875765327805184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872871.986935:0:93198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872871.986964:0:93198:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c79f66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872871.987114:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327805184 00000100:00100000:1.0:1788872871.987119:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327805184 00000100:00100000:1.0:1788872871.987154:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788872871.987161:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:93198:x1875765327805184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872871.988348:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:93198:x1875765327805184:12345-0@lo:502:llog_process_th.0 Request processed in 1181us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872871.988360:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788872871.992867:0:93198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93198:1875765327805184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788872871.998285:0:93198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872871.998308:0:93198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872871.998311:0:93198:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1788872871.998322:0:93198:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1788872871.998342:0:93198:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1788872871.998395:0:93198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93198:1875765327805312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872871.998501:0:93198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872871.998762:0:93198:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c79f66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872872.002867:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327805312 00000100:00100000:0.0:1788872872.002888:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327805312 00000100:00100000:0.0:1788872872.002963:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788872872.002973:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9faa72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:93198:x1875765327805312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872872.003775:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9faa72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:93198:x1875765327805312:12345-0@lo:502:llog_process_th.0 Request processed in 799us (5269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872872.003785:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788872872.005725:0:93198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93198:1875765327805312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788872872.005775:0:93198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872872.005785:0:93198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872872.005798:0:93198:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1788872872.005803:0:93198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:3.0:1788872872.005989:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:3.0:1788872872.006024:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788872872.006035:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db31a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872872.006047:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db31a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872872.006058:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788872872.006073:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff5b1000 from 55 10000000:01000000:3.0:1788872872.006076:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788872872.006112:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872872.006119:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872872.006139:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872872.006162:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327805440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872872.006223:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872872.006265:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c76706c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872872.006848:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327805440 00000100:00100000:2.0:1788872872.006856:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327805440 00000100:00100000:2.0:1788872872.006898:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788872872.006906:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327805440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872872.006918:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872872.006931:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db321 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872872.006954:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db321 expref: 20 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872872.006965:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db321 expref: 20 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872872.006973:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa898200, rc 0) 00000100:00100000:2.0:1788872872.007024:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327805440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872872.007030:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788872872.008813:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327805440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872872.008839:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.008852:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872872.008940:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327805568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872872.008992:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872872.009047:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9cb374240 going to sleep for 11 seconds 00000100:00100000:2.0:1788872872.009155:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327805568 00000100:00100000:2.0:1788872872.009162:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327805568 00000100:00100000:2.0:1788872872.009207:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788872872.009214:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327805568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872872.009335:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327805568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872872.009342:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788872872.009403:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327805568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.009444:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327805696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.009489:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872872.009517:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d26ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872872.009703:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327805696 00000100:00100000:0.0:1788872872.009707:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327805696 00000100:00100000:0.0:1788872872.009741:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788872872.009748:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327805696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872872.009839:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327805696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872872.009847:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788872872.009918:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327805696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.010437:0:93199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93199:1875765327805824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872872.010479:0:93199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872872.010519:0:93199:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5f69b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872872.010661:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327805824 00000100:00100000:0.0:1788872872.010666:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327805824 00000100:00100000:0.0:1788872872.010696:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788872872.010702:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:93199:x1875765327805824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872872.010807:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:93199:x1875765327805824:12345-0@lo:502:llog_process_th.0 Request processed in 104us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872872.010813:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788872872.010888:0:93199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93199:1875765327805824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872872.010940:0:93199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93199:1875765327805952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872872.010976:0:93199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872872.011004:0:93199:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c38926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872872.011048:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327805952 00000100:00100000:0.0:1788872872.011052:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327805952 00000100:00100000:0.0:1788872872.011083:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788872872.011090:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:93199:x1875765327805952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872872.011169:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:93199:x1875765327805952:12345-0@lo:502:llog_process_th.0 Request processed in 79us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872872.011175:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788872872.011350:0:93199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93199:1875765327805952:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788872872.011371:0:93199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1788872872.013235:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1788872872.013275:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872872.013288:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db321 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.013300:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872872.013311:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788872872.013313:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788872872.013331:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788872872.013369:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01db32f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.013377:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01db32f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.013388:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01db32f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872872.013414:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327806080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872872.015398:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872872.015475:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d01f1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788872872.015585:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327806080 00000100:00100000:2.0:1788872872.015594:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327806080 00000100:00100000:2.0:1788872872.015642:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788872872.015651:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327806080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872872.015665:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872872.015685:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db32f expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872872.015724:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db32f expref: 21 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872872.015733:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db32f expref: 21 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872872.015743:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa898000, rc 0) 00000100:00100000:2.0:1788872872.015788:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327806080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872872.015795:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788872872.015934:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327806080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872872.015950:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01db32f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872872.015959:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01db32f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872872.016043:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327806208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.016088:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872872.016115:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5f69900 going to sleep for 11 seconds 00000100:00100000:2.0:1788872872.016308:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327806208 00000100:00100000:2.0:1788872872.016313:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327806208 00000100:00100000:2.0:1788872872.016348:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788872872.016355:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327806208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872872.016503:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327806208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872872.016523:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788872872.016680:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327806208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.016724:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327806336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.016765:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872872.016792:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5f69900 going to sleep for 11 seconds 00000100:00100000:1.0:1788872872.016805:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327806336 00000100:00100000:1.0:1788872872.016808:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327806336 00000100:00100000:1.0:1788872872.016827:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788872872.016833:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327806336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.016918:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327806336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872872.016926:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788872872.016963:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327806336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872872.020389:0:93200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788872872.021873:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788872872.021910:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788872872.021923:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01db32f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.021936:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01db32f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872872.021949:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788872872.021951:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ef97c000 from 55 10000000:01000000:0.0:1788872872.021955:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788872872.022000:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01db33d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.022087:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01db33d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.022100:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01db33d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872872.022141:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327806464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872872.022212:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872872.022273:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d01f1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788872872.022830:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327806464 00000100:00100000:1.0:1788872872.022840:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327806464 00000100:00100000:1.0:1788872872.022896:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788872872.022908:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327806464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872872.022922:0:92461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872872.022938:0:92461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db33d expref: -99 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872872.022964:0:92461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db33d expref: 22 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872872.022987:0:92461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db33d expref: 22 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872872.022997:0:92461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c200, rc 0) 00000100:00100000:1.0:1788872872.023212:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327806464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 306us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872872.023220:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788872872.023399:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327806464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872872.023419:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01db33d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db344 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.023437:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01db33d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db344 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872872.023505:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327806592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872872.023858:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872872.023940:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d01f1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788872872.037467:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327806592 00000100:00100000:2.0:1788872872.037487:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327806592 00000100:00100000:2.0:1788872872.037871:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788872872.037885:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327806592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872872.038205:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327806592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (14345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872872.038214:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788872872.038319:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327806592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.038370:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327806720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.038436:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872872.038473:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5f69180 going to sleep for 11 seconds 00000100:00100000:2.0:1788872872.039119:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327806720 00000100:00100000:2.0:1788872872.039127:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327806720 00000100:00100000:2.0:1788872872.039170:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788872872.039178:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327806720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872872.039288:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327806720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872872.039296:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788872872.039409:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327806720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872872.040442:0:93201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93201:1875765327806848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872872.040503:0:93201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872872.040578:0:93201:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7670540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872872.040814:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327806848 00000100:00100000:2.0:1788872872.040820:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327806848 00000100:00100000:2.0:1788872872.040863:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788872872.040870:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc823850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:93201:x1875765327806848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872872.040985:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc823850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:93201:x1875765327806848:12345-0@lo:502:llog_process_th.0 Request processed in 115us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872872.040994:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788872872.041174:0:93201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93201:1875765327806848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872872.041221:0:93201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93201:1875765327806976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872872.041257:0:93201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872872.041286:0:93201:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7670540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872872.041361:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327806976 00000100:00100000:2.0:1788872872.041365:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327806976 00000100:00100000:2.0:1788872872.041405:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788872872.041411:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:93201:x1875765327806976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872872.041494:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:93201:x1875765327806976:12345-0@lo:502:llog_process_th.0 Request processed in 82us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872872.041500:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788872872.041650:0:93201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:93201:1875765327806976:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788872872.041668:0:93201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1788872872.041883:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1788872872.041906:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788872872.041916:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01db33d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db344 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872872.041927:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01db33d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db344 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872872.041936:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788872872.041938:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788872872.041941:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788872872.041965:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db34b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872872.041985:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db34b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872872.041996:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db34b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872872.042024:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327807104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.042055:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872872.042078:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5f69180 going to sleep for 11 seconds 00000100:00100000:2.0:1788872872.043209:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327807104 00000100:00100000:2.0:1788872872.043222:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327807104 00000100:00100000:2.0:1788872872.043270:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788872872.043279:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327807104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872872.043292:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872872.043307:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa898600/0xe4e6e89fb01db352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db34b expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872872.043331:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa898600/0xe4e6e89fb01db352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db34b expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872872.043342:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa898600/0xe4e6e89fb01db352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db34b expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872872.043350:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa898600, rc 0) 00000100:00100000:2.0:1788872872.043407:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327807104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872872.043414:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788872872.043590:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327807104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872872.043606:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db34b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db352 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872872.043616:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db34b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db352 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872872.043682:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327807232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.043813:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872872.043844:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5f69180 going to sleep for 11 seconds 00000100:00100000:2.0:1788872872.043960:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327807232 00000100:00100000:2.0:1788872872.043965:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327807232 00000100:00100000:2.0:1788872872.044050:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788872872.044058:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8cc822c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327807232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872872.044181:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8cc822c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327807232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872872.044203:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788872872.044258:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327807232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.044285:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327807360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872872.044323:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872872.059369:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5f69180 going to sleep for 11 seconds 00000100:00100000:0.0:1788872872.068402:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327807360 00000100:00100000:0.0:1788872872.068421:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327807360 00000100:00100000:0.0:1788872872.068499:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788872872.068520:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327807360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872872.068738:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327807360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (24414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872872.068746:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788872872.070130:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327807360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872872.075853:0:93202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788872872.079390:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788872872.079443:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788872872.079456:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db34b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db352 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.079472:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db34b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db352 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872872.079503:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788872872.079516:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98a9e9b999c0 from 1 10000000:01000000:0.0:1788872872.079519:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788872872.079574:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52aec00/0xe4e6e89fb01db359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.079583:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52aec00/0xe4e6e89fb01db359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.079594:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52aec00/0xe4e6e89fb01db359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872872.079620:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327807488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872872.079705:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872872.079762:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d01f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788872872.079791:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327807488 00000100:00100000:0.0:1788872872.079798:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327807488 00000100:00100000:0.0:1788872872.079837:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788872872.079845:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327807488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872872.079859:0:92460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872872.079873:0:92460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52ae000/0xe4e6e89fb01db360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db359 expref: -99 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.079894:0:92460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52ae000/0xe4e6e89fb01db360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db359 expref: 24 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.079905:0:92460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52ae000/0xe4e6e89fb01db360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db359 expref: 24 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.079925:0:92460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52ae000, rc 0) 00000100:00100000:0.0:1788872872.079966:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327807488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872872.079972:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788872872.080207:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327807488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872872.080224:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52aec00/0xe4e6e89fb01db359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.080235:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52aec00/0xe4e6e89fb01db359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872872.080294:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327807616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872872.080323:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872872.080341:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c665ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872872.080354:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327807616 00000100:00100000:0.0:1788872872.080357:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327807616 00000100:00100000:0.0:1788872872.080376:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788872872.080381:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327807616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872872.080479:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327807616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (156us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788872872.080486:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788872872.080595:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327807616:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788872872.080622:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788872872.080628:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52aec00/0xe4e6e89fb01db359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872872.080642:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52aec00/0xe4e6e89fb01db359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872872.249297:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872872.714466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872872.714537:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872872.714588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872872.714626:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872872.714662:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311212288 00000100:00100000:0.0:1788872872.714675:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311212288 00000100:00100000:0.0:1788872872.714755:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311212160 00000100:00100000:0.0:1788872872.714759:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311212160 00000100:00100000:0.0:1788872872.714789:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1385 00000100:00100000:0.0:1788872872.714801:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311212288:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872872.715052:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311212032 00000100:00100000:2.0:1788872872.715057:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311212032 00000100:00100000:2.0:1788872872.715093:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 170 00000100:00100000:2.0:1788872872.715101:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311212032:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872872.715198:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311212032:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 96us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872872.715207:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 170 00000100:00100000:0.0:1788872872.715385:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311212288:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 585us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872872.715394:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1385 00000100:00100000:0.0:1788872872.715419:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1386 00000100:00100000:0.0:1788872872.715428:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2405:x1875765311212160:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872872.715456:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2405:x1875765311212160:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 29us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872872.715461:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1386 00000100:00080000:0.0:1788872872.715481:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872872.715488:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872872.716196:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311212416 00000100:00100000:3.0:1788872872.716207:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311212416 00000100:00100000:3.0:1788872872.716282:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2688 00000100:00100000:3.0:1788872872.716291:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311212416:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872872.716344:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311212416:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 55us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872872.716352:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2688 00000100:00080000:0.0:1788872872.717115:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788872873.282537:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872874.037211:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872874.038166:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311212544 00000100:00100000:3.0:1788872874.038191:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311212544 00000100:00100000:3.0:1788872874.038452:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1371 00000100:00100000:3.0:1788872874.038465:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+6:72033:x1875765311212544:12345-192.168.204.39@tcp:101:mkdir.0 00010000:00010000:3.0:1788872874.038492:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872874.038524:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db367 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb12e expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.038633:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db36e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.038651:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db36e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.038668:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db36e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872874.038736:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872874.038741:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872874.038782:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db36e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.038879:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db367 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb12e expref: 8 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.038900:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db36e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb12e expref: 7 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.038910:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:3.0:1788872874.038914:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872874.038918:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5800, rc 0) 00000100:00100000:3.0:1788872874.039085:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72033:x1875765311212544:12345-192.168.204.39@tcp:101:mkdir.0 Request processed in 622us (4111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.039094:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1371 00000100:00080000:0.0:1788872874.039675:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788872874.056832:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872874.059060:0:92363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311212672 00000100:00100000:0.0:1788872874.059081:0:92363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311212672 00000100:00100000:0.0:1788872874.064878:0:92363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 15 00000100:00100000:0.0:1788872874.064906:0:92363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72033:x1875765311212672:12345-192.168.204.39@tcp:700:mkdir.0 00000100:00100000:0.0:1788872874.065089:0:92363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72033:x1875765311212672:12345-192.168.204.39@tcp:700:mkdir.0 Request processed in 192us (8275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.065098:0:92363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 15 00000100:00100000:0.0:1788872874.079902:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872874.082170:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311212928 00000100:00100000:3.0:1788872874.082191:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311212928 00000100:00100000:3.0:1788872874.082290:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1372 00000100:00100000:3.0:1788872874.082301:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72033:x1875765311212928:12345-192.168.204.39@tcp:36:mkdir.0 00010000:00010000:3.0:1788872874.082375:0:68674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872874.082423:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db36e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb12e expref: 7 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.082446:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:3.0:1788872874.082452:0:68674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872874.082540:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db375 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.082578:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db375 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.082590:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db375 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.082607:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db37c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.082613:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db37c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.082620:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db37c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085007:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085043:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085057:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872874.085092:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bcd8a1ec reply state 00000000f164c717 transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085103:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085111:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f016ad00) 00010000:00010000:3.0:1788872874.085115:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872874.085119:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788872874.085127:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788872874.085141:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db375 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085148:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db375 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085154:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db375 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085161:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db375 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085239:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872874.085259:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db375 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085268:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db375 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085281:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:3.0:1788872874.085284:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872874.085288:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db375 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085296:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db375 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872874.085311:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bcd8a1ec reply state 00000000f164c717 transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db37c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085320:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db37c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.085326:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff98a9f016a300) 00010000:00010000:3.0:1788872874.085329:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872874.085331:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788872874.085499:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+8:72033:x1875765311212928:12345-192.168.204.39@tcp:36:mkdir.0 Request processed in 3192us (5607us total) trans 120259084292 rc 0/0 00000100:00100000:3.0:1788872874.085510:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1372 00000100:00100000:0.0:1788872874.094218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872874.094666:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311213056 00000100:00100000:2.0:1788872874.094682:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311213056 00000100:00100000:2.0:1788872874.094774:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1373 00000100:00100000:2.0:1788872874.094973:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+8:72033:x1875765311213056:12345-192.168.204.39@tcp:101:mkdir.0 00010000:00010000:2.0:1788872874.095003:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872874.095032:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db38a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb135 expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.095134:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db391 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.095151:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db391 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.095166:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db391 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872874.095233:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788872874.095256:0:83669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788872874.095290:0:83669:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db391 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.095325:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db38a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb135 expref: 10 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.095350:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db391 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb135 expref: 9 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.095361:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:2.0:1788872874.095365:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788872874.095369:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa898400, rc 0) 00000100:00100000:2.0:1788872874.095475:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72033:x1875765311213056:12345-192.168.204.39@tcp:101:mkdir.0 Request processed in 691us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872874.095485:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1373 00000100:00100000:2.0:1788872874.104895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872874.105037:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311213312 00000100:00100000:0.0:1788872874.105051:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311213312 00000100:00100000:0.0:1788872874.105129:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1374 00000100:00100000:0.0:1788872874.105141:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72033:x1875765311213312:12345-192.168.204.39@tcp:101:mkdir.0 00010000:00010000:0.0:1788872874.105184:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872874.105213:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01db398 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb13c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.105315:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db39f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.105334:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db39f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.105348:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db39f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.105361:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.105403:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.105410:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872874.105594:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788872874.105697:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db39f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.105706:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db39f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.105713:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db39f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.105720:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db39f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.105726:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872874.105731:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db39f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.105739:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db39f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.105752:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:0.0:1788872874.105755:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872874.105760:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db39f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.106367:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db39f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.106398:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.106405:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.106411:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.106416:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52afa00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872874.106421:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.106427:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.106436:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff98a9f016a300) 00010000:00010000:0.0:1788872874.106439:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872874.106443:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.106448:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.106505:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01db398 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb13c expref: 11 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.106532:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:0.0:1788872874.106535:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788872874.106538:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af800/0xe4e6e89fb01db398 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb13c expref: 11 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.108407:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af800, rc 0) 00000100:00100000:0.0:1788872874.108545:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72033:x1875765311213312:12345-192.168.204.39@tcp:101:mkdir.0 Request processed in 3398us (3658us total) trans 120259084293 rc 301/301 00000100:00100000:0.0:1788872874.109275:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1374 00000100:00100000:0.0:1788872874.124311:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872874.124443:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311213440 00000100:00100000:3.0:1788872874.124458:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311213440 00000100:00100000:3.0:1788872874.124599:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 14 00000100:00100000:3.0:1788872874.124613:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0804304d-5904-48ad-87f2-bcbc7642a62a+5:72033:x1875765311213440:12345-192.168.204.39@tcp:900:mkdir.0 00000100:00100000:3.0:1788872874.124742:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0804304d-5904-48ad-87f2-bcbc7642a62a+5:72033:x1875765311213440:12345-192.168.204.39@tcp:900:mkdir.0 Request processed in 132us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.124769:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 14 00000100:00080000:0.0:1788872874.124845:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872874.131951:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872874.132090:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311213696 00000100:00100000:0.0:1788872874.132104:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311213696 00000100:00100000:0.0:1788872874.132182:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 239 00000100:00100000:0.0:1788872874.132196:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0951850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72033:x1875765311213696:12345-192.168.204.39@tcp:35:mkdir.0 00000100:00100000:1.0:1788872874.138337:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0951850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+11:72033:x1875765311213696:12345-192.168.204.39@tcp:35:mkdir.0 Request processed in 6127us (6384us total) trans 120259084294 rc 0/0 00000100:00100000:1.0:1788872874.138357:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 239 00000100:00100000:0.0:1788872874.150765:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872874.151046:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311213952 00000100:00100000:2.0:1788872874.151061:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311213952 00000100:00100000:2.0:1788872874.151254:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1375 00000100:00100000:2.0:1788872874.151267:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+5:72033:x1875765311213952:12345-192.168.204.39@tcp:36:mkdir.0 00000100:00100000:2.0:1788872874.151462:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327807744:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788872874.151537:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.151676:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872874.151935:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327807744 00000100:00100000:1.0:1788872874.151943:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327807744 00000100:00100000:1.0:1788872874.152128:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:1.0:1788872874.152144:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66192:x1875765327807744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788872874.152468:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66192:x1875765327807744:12345-0@lo:1000:mdt00_001.0 Request processed in 330us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872874.152477:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00100000:2.0:1788872874.152591:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327807744:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788872874.152696:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327807872:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788872874.152752:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.153080:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.153254:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327807872 00000100:00100000:0.0:1788872874.153262:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327807872 00000100:00100000:0.0:1788872874.153312:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:0.0:1788872874.153320:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66192:x1875765327807872:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788872874.153437:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66192:x1875765327807872:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.153443:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00000100:00100000:2.0:1788872874.153523:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327807872:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788872874.153614:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808000:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788872874.153862:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.153915:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872874.154041:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327808000 00000100:00100000:1.0:1788872874.154047:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327808000 00000100:00100000:3.0:1788872874.154118:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:3.0:1788872874.154131:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66192:x1875765327808000:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788872874.154260:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66192:x1875765327808000:12345-0@lo:1000:mdt00_001.0 Request processed in 132us (397us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788872874.154268:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00100000:2.0:1788872874.154336:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808000:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788872874.154419:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.154431:0:66192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.154444:0:66192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872874.154458:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808128:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1788872874.154488:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.155174:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.155248:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327808128 00000100:00100000:0.0:1788872874.155256:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327808128 00000100:00100000:0.0:1788872874.155321:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:0.0:1788872874.155329:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66192:x1875765327808128:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788872874.155349:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872874.155372:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3bb lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db3b4 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.155417:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 2/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.155429:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3bb lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db3b4 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.155450:0:8447:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1788872874.155484:0:8447:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1788872874.155531:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3bb lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db3b4 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.155541:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f016ad00) 00010000:00010000:0.0:1788872874.155544:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872874.155566:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3bb lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db3b4 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.155576:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52afa00, rc 0) 00000100:00100000:0.0:1788872874.155713:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327808128:12345-0@lo:101:mdt00_001.0 Request processed in 384us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.155720:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000100:00100000:2.0:1788872874.156486:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808128:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1788872874.156510:0:66192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.156521:0:66192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788872874.159465:0:92455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084294 is committed 00000001:00080000:1.0:1788872874.159497:0:92455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084291 is committed 00010000:00010000:0.0:1788872874.159532:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db37c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.159876:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db37c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.159885:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db37c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.159892:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872874.159897:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db37c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.159906:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db37c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.159927:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff98a9f016a300) 00010000:00010000:0.0:1788872874.159932:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872874.159937:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db37c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.159944:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db37c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.159967:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.160036:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.160043:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.160048:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872874.160058:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.160064:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.160073:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f016ad00) 00010000:00010000:0.0:1788872874.160076:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872874.160084:0:3630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3bb lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db3b4 expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.160098:0:3630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3bb lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xe4e6e89fb01db3b4 expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.160107:0:3630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3bb lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xe4e6e89fb01db3b4 expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.160166:0:3630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3bb lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db3b4 expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872874.160187:0:3630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df455500 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3630:1875765327808256:0@lo:105: 00000100:00100000:0.0:1788872874.160285:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.160842:0:3630:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c665fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872874.162086:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327808256 00000100:00100000:3.0:1788872874.162103:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327808256 00000100:00100000:3.0:1788872874.162214:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788872874.162227:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df457480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3630:x1875765327808256:12345-0@lo:105: 00010000:00010000:3.0:1788872874.162246:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.162262:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.162274:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.162285:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.162293:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.162302:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.162351:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff98a9fa899c00) 00000100:00100000:3.0:1788872874.162448:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df457480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3630:x1875765327808256:12345-0@lo:105: Request processed in 224us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.162455:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788872874.162570:0:3630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df455500 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3630:1875765327808256:0@lo:105: 00010000:00010000:1.0:1788872874.162603:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872874.162612:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db383 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.163416:0:66192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.163454:0:66192:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788872874.163489:0:66192:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1788872874.163541:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.163583:0:66192:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.163597:0:66192:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872874.163623:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808384:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1788872874.163694:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.163747:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788872874.164079:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327808384 00000100:00100000:1.0:1788872874.164088:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327808384 00000100:00100000:1.0:1788872874.164152:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1788872874.164162:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66192:x1875765327808384:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788872874.164189:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872874.164207:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db3c9 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db3c2 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872874.164258:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db3c9 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db3c2 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872874.164272:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db3c9 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db3c2 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872874.164280:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff98a9c29bf700) 00010000:00010000:1.0:1788872874.164283:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872874.164287:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9cc00, rc 0) 00000100:00100000:1.0:1788872874.164340:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327808384:12345-0@lo:101:mdt00_001.0 Request processed in 180us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872874.164347:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00100000:3.0:1788872874.165421:0:66192:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084291 gen 3 00000004:00080000:3.0:1788872874.165436:0:66192:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084291 committed transno 120259084291 00000100:00100000:3.0:1788872874.165468:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808384:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1788872874.165497:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db3c9 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.165514:0:66192:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db3c9 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788872874.165538:0:66192:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:3.0:1788872874.165967:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808512:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788872874.166113:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872874.168092:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c76703c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872874.172021:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327808512 00000100:00100000:1.0:1788872874.172040:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327808512 00000100:00100000:1.0:1788872874.172143:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:1.0:1788872874.172155:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327808512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788872874.172400:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327808512:12345-0@lo:1000:mdt00_001.0 Request processed in 246us (6286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872874.172411:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:3.0:1788872874.172481:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808512:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788872874.172657:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808640:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788872874.172741:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.172849:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327808640 00000100:00100000:2.0:1788872874.172857:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327808640 00000100:00100000:3.0:1788872874.172956:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c76703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872874.173011:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:2.0:1788872874.173023:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327808640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788872874.173247:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808640:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788872874.173368:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808768:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788872874.173368:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327808640:12345-0@lo:1000:mdt00_001.0 Request processed in 143us (421us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788872874.173401:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00000100:00100000:3.0:1788872874.173431:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872874.173485:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c76703c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.173593:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327808768 00000100:00100000:0.0:1788872874.173601:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327808768 00000100:00100000:0.0:1788872874.173667:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:0.0:1788872874.173679:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327808768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788872874.174063:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327808768:12345-0@lo:1000:mdt00_001.0 Request processed in 386us (631us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788872874.174083:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:3.0:1788872874.174233:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808768:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788872874.174302:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808896:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788872874.174333:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872874.174357:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c76703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872874.174423:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327808896 00000100:00100000:2.0:1788872874.174434:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327808896 00000100:00100000:2.0:1788872874.174490:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:2.0:1788872874.174499:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327808896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788872874.174664:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327808896:12345-0@lo:1000:mdt00_001.0 Request processed in 166us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872874.174671:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00000100:00100000:3.0:1788872874.174845:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327808896:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788872874.175039:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327809024:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788872874.175076:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872874.175099:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c76703c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872874.175142:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327809024 00000100:00100000:1.0:1788872874.175150:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327809024 00000100:00100000:1.0:1788872874.175199:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:1.0:1788872874.175393:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327809024:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788872874.175493:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327809024:12345-0@lo:1000:mdt00_001.0 Request processed in 287us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872874.175500:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00000100:00100000:3.0:1788872874.175597:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327809024:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788872874.175674:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327809152:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788872874.175763:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872874.175778:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c76703c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.175961:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327809152 00000100:00100000:0.0:1788872874.175969:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327809152 00000100:00100000:0.0:1788872874.176090:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:0.0:1788872874.176099:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327809152:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788872874.176211:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66192:x1875765327809152:12345-0@lo:1000:mdt00_001.0 Request processed in 113us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.176219:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00000100:00100000:3.0:1788872874.176427:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66192:1875765327809152:0@lo:1000:mdt00_001.0 00000040:00080000:3.0:1788872874.177534:0:66192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].4, 968 off37320 00000040:00080000:3.0:1788872874.177672:0:66192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x2:0x0].4, 1120 off37904 00000004:00080000:3.0:1788872874.177679:0:66192:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98a8c76700c0 with version 13 00000004:00080000:2.0:1788872874.178295:0:75625:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98a8c5c4f240 version 13 rpc_version 13 00000020:00100000:2.0:1788872874.178342:0:75625:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788872874.178355:0:75625:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98a9f5b35c00 x1875765327809408/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872874.178397:0:75625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327809408:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788872874.178478:0:75625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.178522:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.179949:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327809408 00000100:00100000:0.0:1788872874.180115:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327809408 00000100:00100000:0.0:1788872874.180220:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:0.0:1788872874.180233:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75625:x1875765327809408:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788872874.181329:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:75625:x1875765327809408:12345-0@lo:1000:osp_up0-1.0 Request processed in 1089us (2840us total) trans 120259084295 rc 0/0 00000100:00100000:0.0:1788872874.181343:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00000100:00100000:2.0:1788872874.181953:0:75625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327809408:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1788872874.182327:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db3d0 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.182350:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db3d0 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.182368:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db3d0 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872874.183061:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000455a6618 reply state 000000007bd2f094 transno 77309411459 ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db3d0 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.183101:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db3d0 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.183111:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9f016a500) 00010000:00010000:3.0:1788872874.183114:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872874.183119:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788872874.183127:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00080000:3.0:1788872874.183143:0:66192:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:3.0:1788872874.183156:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.183165:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.183173:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.183365:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872874.183373:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.183391:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899c00 already unused, calling callback (ffffffffc19e46f0) 00010000:00010000:2.0:1788872874.183397:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872874.183406:0:6509:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.183458:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.183464:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872874.183494:0:66192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788872874.183500:0:66192:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:3.0:1788872874.183506:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db3c9 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.183513:0:66192:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db3c9 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.184775:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872874.185069:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327809536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872874.186163:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72033:x1875765311213952:12345-192.168.204.39@tcp:36:mkdir.0 Request processed in 34887us (35402us total) trans 77309411459 rc 0/0 00000100:00100000:3.0:1788872874.186177:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1375 00010000:00010000:2.0:1788872874.186504:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db3b4 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db3bb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.186538:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872874.186540:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872874.186543:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872874.195945:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.198321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872874.198481:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311214208 00000100:00100000:3.0:1788872874.198495:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311214208 00000100:00100000:3.0:1788872874.198604:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1376 00000100:00100000:3.0:1788872874.198616:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72033:x1875765311214208:12345-192.168.204.39@tcp:36:mkdir.0 00010000:00010000:3.0:1788872874.198715:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872874.198756:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db391 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb135 expref: 7 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.199237:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:3.0:1788872874.199246:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872874.199435:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+6:72033:x1875765311214208:12345-192.168.204.39@tcp:36:mkdir.0 Request processed in 819us (1124us total) trans 0 rc -17/-17 00000100:00100000:3.0:1788872874.199443:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1376 00000100:00100000:2.0:1788872874.206872:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327809536 00000100:00100000:2.0:1788872874.206897:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327809536 00000100:00100000:2.0:1788872874.207138:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1788872874.207152:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3647:x1875765327809536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872874.207174:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872874.207209:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01db3bb lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db3b4 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.207234:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f016ad00) 00010000:00010000:2.0:1788872874.207248:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872874.207792:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1875765327809536:12345-0@lo:103:ldlm_bl.0 Request processed in 631us (12010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872874.207802:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1788872874.208363:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872874.209602:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311214336 00000100:00100000:2.0:1788872874.209621:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311214336 00000100:00100000:2.0:1788872874.209720:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1377 00000100:00100000:2.0:1788872874.209733:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+6:72033:x1875765311214336:12345-192.168.204.39@tcp:101:mkdir.0 00010000:00010000:2.0:1788872874.209759:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872874.209799:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db3d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb143 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.209918:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db3de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.209937:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db3de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.209951:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db3de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872874.210224:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788872874.210230:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788872874.210256:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db3de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.210290:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db3d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb143 expref: 8 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.210315:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db3de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb143 expref: 7 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.210326:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:2.0:1788872874.210329:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788872874.210334:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899600, rc 0) 00000100:00100000:2.0:1788872874.210443:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72033:x1875765311214336:12345-192.168.204.39@tcp:101:mkdir.0 Request processed in 712us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872874.210453:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1377 00000100:00100000:0.0:1788872874.214177:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327809536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872874.233935:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872874.234111:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311214464 00000100:00100000:3.0:1788872874.234127:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311214464 00000100:00100000:3.0:1788872874.234215:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1378 00000100:00100000:3.0:1788872874.234229:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72033:x1875765311214464:12345-192.168.204.39@tcp:101:mkdir.0 00010000:00010000:3.0:1788872874.234260:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872874.234291:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db3e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb14a expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234392:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db3ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234412:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db3ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234427:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db3ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234467:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db3f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234475:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234482:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234615:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db3fa lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234624:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db3fa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234631:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db3fa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872874.234686:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872874.234690:0:68674:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872874.234713:0:68674:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db3fa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234730:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db3ec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234737:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db3ec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234744:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db3ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234765:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db3ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.234772:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872874.235899:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db3ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.235923:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db3ec lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.235944:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:3.0:1788872874.235948:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872874.235953:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db3ec lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.235962:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db3ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.235994:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.236002:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db3f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.236008:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.236015:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872874.236018:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.236045:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db3f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.236054:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff98a9f016a800) 00010000:00010000:3.0:1788872874.236056:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872874.236059:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db3f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.236065:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db3f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.236121:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db3e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb14a expref: 9 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.236136:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db3fa lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb14a expref: 8 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.236143:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f016ab00) 00010000:00010000:3.0:1788872874.236146:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872874.236148:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4200, rc 0) 00000100:00100000:3.0:1788872874.236245:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+8:72033:x1875765311214464:12345-192.168.204.39@tcp:101:mkdir.0 Request processed in 2019us (2326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.236256:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1378 00000100:00100000:1.0:1788872874.245684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872874.245776:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311214720 00000100:00100000:0.0:1788872874.245807:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311214720 00000100:00100000:0.0:1788872874.245883:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1379 00000100:00100000:0.0:1788872874.245895:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72033:x1875765311214720:12345-192.168.204.39@tcp:36:mkdir.0 00000100:00100000:0.0:1788872874.246071:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df455500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327809664:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788872874.246170:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.246222:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c665fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788872874.246439:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327809664 00000100:00100000:2.0:1788872874.246452:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327809664 00000100:00100000:2.0:1788872874.246502:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00100000:2.0:1788872874.246510:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66190:x1875765327809664:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872874.246638:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66190:x1875765327809664:12345-0@lo:1000:mdt00_000.0 Request processed in 129us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872874.246646:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00000100:00100000:1.0:1788872874.248484:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df455500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327809664:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872874.248645:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327809792:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872874.248717:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872874.248757:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5f69c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.248967:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327809792 00000100:00100000:0.0:1788872874.249054:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327809792 00000100:00100000:0.0:1788872874.249128:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:0.0:1788872874.249139:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66190:x1875765327809792:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788872874.249375:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66190:x1875765327809792:12345-0@lo:1000:mdt00_000.0 Request processed in 237us (657us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788872874.249394:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00000100:00100000:2.0:1788872874.254124:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327809792:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788872874.254261:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.254275:0:66190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.254289:0:66190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872874.254317:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327809920:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1788872874.254433:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.254487:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.254744:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327809920 00000100:00100000:0.0:1788872874.254755:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327809920 00000100:00100000:0.0:1788872874.254841:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:0.0:1788872874.254853:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66190:x1875765327809920:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788872874.254876:0:30614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872874.254897:0:30614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db408 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db401 expref: -99 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.254931:0:30614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db3fa lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb14a expref: 7 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.254943:0:30614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db408 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db401 expref: 10 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.255096:0:30614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db3fa lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb14a expref: 7 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.255114:0:30614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db3fa lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb14a expref: 7 pid: 68674 timeout: 3911 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872874.255157:0:30614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df455500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:30614:1875765327810048:192.168.204.39@tcp:104: 00000100:00100000:0.0:1788872874.255262:0:30614:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c665fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788872874.260207:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872874.260215:0:30614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df455500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:30614:1875765327810048:192.168.204.39@tcp:104: 00010000:00010000:0.0:1788872874.260273:0:30614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db408 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db401 expref: 10 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.260290:0:30614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f016ab00) 00010000:00010000:0.0:1788872874.260294:0:30614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872874.260298:0:30614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db408 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db401 expref: 10 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.260311:0:30614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af000, rc 0) 00000100:00100000:0.0:1788872874.260424:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66190:x1875765327809920:12345-0@lo:101:mdt00_000.0 Request processed in 5572us (5991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.260435:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00000100:00100000:3.0:1788872874.261216:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311214848 00000100:00100000:3.0:1788872874.261231:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311214848 00010000:00010000:3.0:1788872874.261290:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db3fa lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb14a expref: 8 pid: 68674 timeout: 3911 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872874.261373:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2588 00000100:00100000:3.0:1788872874.261395:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2405:x1875765311214848:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788872874.261417:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872874.261425:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db3fa lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb14a expref: 8 pid: 68674 timeout: 3911 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.261441:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db3fa lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb14a expref: 8 pid: 68674 timeout: 3911 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.261470:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db3fa lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb14a expref: 8 pid: 68674 timeout: 3911 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.261490:0:19657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f016ab00) 00010000:00010000:3.0:1788872874.261496:0:19657:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db408 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db401 expref: 9 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.261508:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db408 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xe4e6e89fb01db401 expref: 9 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.261517:0:19657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db408 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xe4e6e89fb01db401 expref: 9 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.261616:0:19657:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db408 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db401 expref: 9 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872874.261635:0:19657:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19657:1875765327810176:0@lo:105: 00000100:00100000:3.0:1788872874.261709:0:19657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872874.261756:0:19657:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5d10f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872874.261790:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327810176 00000100:00100000:3.0:1788872874.261795:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327810176 00000100:00100000:3.0:1788872874.261826:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788872874.261832:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19657:x1875765327810176:12345-0@lo:105: 00010000:00010000:3.0:1788872874.261846:0:13343:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.261858:0:13343:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872874.262429:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327809920:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788872874.262472:0:13343:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.262484:0:13343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.262493:0:13343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.262505:0:13343:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.268290:0:66190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788872874.268360:0:66190:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1788872874.268448:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.268457:0:66190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.268501:0:66190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872874.268537:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327810304:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1788872874.268651:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.268714:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.268838:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327810304 00000100:00100000:0.0:1788872874.268849:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327810304 00000100:00100000:0.0:1788872874.268932:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00100000:0.0:1788872874.268945:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66190:x1875765327810304:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788872874.268968:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872874.269002:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db416 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db40f expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.269037:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db416 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db40f expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.269068:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db416 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db40f expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.269079:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff98a8ca103100) 00010000:00010000:0.0:1788872874.269082:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872874.269087:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52ae800, rc 0) 00000100:00100000:0.0:1788872874.269157:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327810304:12345-0@lo:101:mdt00_000.0 Request processed in 215us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.269175:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000100:00100000:2.0:1788872874.269404:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327810304:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788872874.269424:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db416 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.269435:0:66190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db416 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788872874.269457:0:66190:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:2.0:1788872874.269504:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327810432:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872874.269536:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.269584:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788872874.269685:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327810432 00000100:00100000:1.0:1788872874.269701:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327810432 00000100:00100000:1.0:1788872874.269784:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00100000:1.0:1788872874.269796:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327810432:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872874.269933:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327810432:12345-0@lo:1000:mdt00_000.0 Request processed in 138us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872874.270179:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327810432:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872874.270181:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00000100:00100000:2.0:1788872874.270256:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327810560:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872874.270295:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.270323:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788872874.270344:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327810560 00000100:00100000:2.0:1788872874.270349:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327810560 00000100:00100000:2.0:1788872874.270409:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00100000:2.0:1788872874.270424:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327810560:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872874.270533:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327810560:12345-0@lo:1000:mdt00_000.0 Request processed in 114us (237us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788872874.270586:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000100:00100000:1.0:1788872874.271685:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327810560:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872874.271818:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327810688:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872874.271877:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872874.271923:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5f69c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.272068:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327810688 00000100:00100000:0.0:1788872874.272075:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327810688 00000100:00100000:0.0:1788872874.272120:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00100000:0.0:1788872874.272129:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327810688:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788872874.272236:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327810688:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (357us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788872874.272247:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00100000:2.0:1788872874.272303:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327810688:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872874.272447:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327810816:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872874.272497:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.272530:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.272838:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327810816 00000100:00100000:0.0:1788872874.272846:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327810816 00000100:00100000:0.0:1788872874.272884:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:0.0:1788872874.272893:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327810816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788872874.272975:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327810816:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.272981:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00000100:00100000:2.0:1788872874.273142:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327810816:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872874.273218:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327810944:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788872874.273252:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.273274:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.274252:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327810944 00000100:00100000:0.0:1788872874.274262:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327810944 00000100:00100000:0.0:1788872874.274319:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:0.0:1788872874.274348:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327810944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788872874.274486:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327810944:12345-0@lo:1000:mdt00_000.0 Request processed in 140us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.274493:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00000100:00100000:1.0:1788872874.275146:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327810944:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872874.275234:0:66190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327811072:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788872874.275277:0:66190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872874.275306:0:66190:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5f69d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.275363:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327811072 00000100:00100000:0.0:1788872874.275368:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327811072 00000100:00100000:0.0:1788872874.275416:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00100000:0.0:1788872874.275424:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327811072:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788872874.275500:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66190:x1875765327811072:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.275508:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00000100:00100000:2.0:1788872874.275626:0:66190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66190:1875765327811072:0@lo:1000:mdt00_000.0 00000040:00080000:2.0:1788872874.276098:0:66190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].5, 968 off38288 00000040:00080000:2.0:1788872874.276157:0:66190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x2:0x0].5, 1120 off39024 00000004:00080000:2.0:1788872874.276162:0:66190:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98a8c743ba80 with version 14 00000004:00080000:0.0:1788872874.276631:0:75625:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98a8c5c4f240 version 14 rpc_version 14 00000020:00100000:0.0:1788872874.276660:0:75625:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788872874.276669:0:75625:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98a9df455500 x1875765327811328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872874.276687:0:75625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df455500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327811328:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788872874.276730:0:75625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.276809:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c665fd80 going to sleep for 11 seconds 00010000:00010000:3.0:1788872874.277111:0:13343:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff98a9fa899c00) 00000100:00100000:0.0:1788872874.277668:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19657:x1875765327810176:12345-0@lo:105: Request processed in 15830us (15954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.277679:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788872874.278330:0:19657:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19657:1875765327810176:0@lo:105: 00010000:00010000:3.0:1788872874.278360:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872874.278453:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311214848:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 17067us (18252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.278484:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2588 00000100:00100000:1.0:1788872874.279938:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327811328 00000100:00100000:1.0:1788872874.279954:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327811328 00000100:00100000:1.0:1788872874.280016:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00100000:1.0:1788872874.280027:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75625:x1875765327811328:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788872874.280519:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75625:x1875765327811328:12345-0@lo:1000:osp_up0-1.0 Request processed in 494us (3787us total) trans 120259084296 rc 0/0 00000100:00100000:0.0:1788872874.281713:0:75625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df455500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327811328:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1788872874.281923:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01db41d lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.281940:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01db41d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.281953:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01db41d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872874.281974:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001deb8ed0 reply state 00000000f82c785d transno 77309411460 ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01db41d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.281986:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01db41d lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.282009:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9f9e3ff00) 00010000:00010000:2.0:1788872874.282011:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872874.282015:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788872874.282022:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00080000:2.0:1788872874.282033:0:66190:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1788872874.282044:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.282054:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.282062:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872874.282441:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00010000:00010000:2.0:1788872874.282502:0:66190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788872874.282510:0:66190:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1788872874.282517:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db416 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.282535:0:66190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db416 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872874.282674:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72033:x1875765311214720:12345-192.168.204.39@tcp:36:mkdir.0 Request processed in 36779us (36997us total) trans 77309411460 rc 0/0 00000100:00100000:2.0:1788872874.282682:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1379 00010000:00010000:3.0:1788872874.283341:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872874.283350:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.283359:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899c00 already unused, calling callback (ffffffffc19e46f0) 00010000:00010000:3.0:1788872874.283365:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872874.283374:0:20230:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.283424:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.283431:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788872874.283495:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327811456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872874.283681:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788872874.283768:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.283777:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899c00/0xe4e6e89fb01db401 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db408 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.283801:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872874.283803:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872874.283804:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872874.283939:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327811456 00000100:00100000:0.0:1788872874.283947:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327811456 00000100:00100000:0.0:1788872874.284129:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1788872874.284139:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3644:x1875765327811456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872874.284164:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872874.284182:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db408 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db401 expref: 12 pid: 30614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.284195:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f016ab00) 00010000:00010000:0.0:1788872874.284203:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872874.284255:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3644:x1875765327811456:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.284262:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1788872874.284354:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327811456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872874.296912:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872874.303946:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872874.304058:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311214976 00000100:00100000:2.0:1788872874.304082:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311214976 00000100:00100000:2.0:1788872874.304141:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1380 00000100:00100000:2.0:1788872874.304153:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72034:x1875765311214976:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788872874.304185:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872874.304207:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db424 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb151 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304275:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db42b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304290:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db42b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304316:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db42b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304333:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db432 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304342:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304349:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304445:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db439 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304454:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db439 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304461:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db439 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872874.304509:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788872874.304513:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788872874.304593:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db439 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304622:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db42b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304629:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db42b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304636:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db42b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304643:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db42b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304650:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872874.304655:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db42b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304663:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db42b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304676:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:2.0:1788872874.304680:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872874.304685:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db42b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304692:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db42b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304718:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304724:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db432 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304729:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db432 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304734:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872874.304737:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db432 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304743:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db432 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304751:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff98a9f9e3f200) 00010000:00010000:2.0:1788872874.304754:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872874.304757:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db432 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304763:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db432 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304795:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db424 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb151 expref: 9 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304810:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db439 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb151 expref: 8 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.304830:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f9e3f400) 00010000:00010000:2.0:1788872874.304833:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788872874.304836:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899c00, rc 0) 00000100:00100000:2.0:1788872874.304889:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+8:72034:x1875765311214976:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 739us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872874.304897:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1380 00000100:00100000:0.0:1788872874.309499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872874.309803:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311215104 00000100:00100000:3.0:1788872874.309814:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311215104 00000100:00100000:3.0:1788872874.309883:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1381 00000100:00100000:3.0:1788872874.309909:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f098ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+8:72034:x1875765311215104:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872874.309931:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872874.309953:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db440 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb158 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.310023:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db447 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.310037:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db447 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.310050:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db447 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.310063:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.310074:0:68674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db3c9 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db3c2 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.310083:0:68674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.310117:0:68674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db3c9 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db3c2 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872874.310131:0:68674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68674:1875765327811584:0@lo:104: 00000100:00100000:3.0:1788872874.310179:0:68674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872874.310228:0:68674:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5d10f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.310343:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327811584 00000100:00100000:0.0:1788872874.310348:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327811584 00000100:00100000:0.0:1788872874.310397:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788872874.310405:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:68674:x1875765327811584:12345-0@lo:104: 00010000:00010000:0.0:1788872874.310420:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db3c9 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.310482:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788872874.310488:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:68674:x1875765327811584:12345-0@lo:104: Request processed in 85us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.310495:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00010000:0.0:1788872874.310515:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872874.310520:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db3c9 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.310538:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899000 already unused, calling callback (ffffffffc19e46f0) 00010000:00010000:0.0:1788872874.310544:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db3c9 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872874.310581:0:14981:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db3c9 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.310618:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db3c9 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.310625:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872874.310651:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db3c9 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.310659:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa899000/0xe4e6e89fb01db3c2 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db3c9 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.310679:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872874.310681:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872874.310683:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872874.310695:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327811712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872874.310725:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872874.311040:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327811712 00000100:00100000:3.0:1788872874.311051:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327811712 00010000:00010000:3.0:1788872874.311071:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db3c9 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xe4e6e89fb01db3c2 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872874.311104:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:3.0:1788872874.311110:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0988700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3645:x1875765327811712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872874.311120:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788872874.311512:0:68674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68674:1875765327811584:0@lo:104: 00010000:00010000:3.0:1788872874.311545:0:68674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788872874.316844:0:92455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084296 is committed 00010000:00010000:0.0:1788872874.317074:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db3c9 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db3c2 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.317098:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff98a9c29bf700) 00010000:00010000:0.0:1788872874.317105:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.317115:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.317148:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.317195:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872874.317335:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0988700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3645:x1875765327811712:12345-0@lo:103:ldlm_bl.0 Request processed in 6222us (6606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.317346:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00010000:00010000:3.0:1788872874.317592:0:68674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.317601:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872874.317730:0:68674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68674:1875765327811840:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788872874.317780:0:68674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872874.317808:0:68674:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5d10900 going to sleep for 11 seconds 00000100:00100000:2.0:1788872874.317975:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327811712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872874.318474:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327811840 00000100:00100000:0.0:1788872874.318483:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327811840 00000100:00100000:0.0:1788872874.318527:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00100000:0.0:1788872874.318537:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68674:x1875765327811840:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788872874.318648:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68674:x1875765327811840:12345-0@lo:1000:mdt00_004.0 Request processed in 112us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.318656:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00000100:00100000:3.0:1788872874.318772:0:68674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68674:1875765327811840:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788872874.318824:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db455 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.318838:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db455 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.318848:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db455 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872874.318966:0:68674:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db455 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.318981:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db447 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.318987:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db447 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.318993:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db447 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319000:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db447 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319006:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872874.319010:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db447 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319017:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db447 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319029:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f9e3f400) 00010000:00010000:3.0:1788872874.319032:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872874.319036:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db447 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319042:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db447 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319054:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319066:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319071:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319076:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872874.319079:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319085:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319094:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff98a9c29bf700) 00010000:00010000:3.0:1788872874.319096:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872874.319099:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319104:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db44e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319140:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db440 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb158 expref: 10 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319153:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db455 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb158 expref: 9 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.319724:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9c329d200) 00010000:00010000:3.0:1788872874.319729:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788872874.319738:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4600, rc 0) 00000100:00100000:3.0:1788872874.319801:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f098ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72034:x1875765311215104:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 9894us (10309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.319810:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1381 00000100:00100000:0.0:1788872874.323702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872874.323838:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311215232 00000100:00100000:3.0:1788872874.323847:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311215232 00000100:00100000:3.0:1788872874.323917:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1382 00000100:00100000:3.0:1788872874.323928:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f098bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72034:x1875765311215232:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872874.323952:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872874.323975:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db45c lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb15f expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.324041:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db463 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.324054:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db463 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.324065:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db463 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872874.324113:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1788872874.324117:0:83669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788872874.324154:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db45c lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb15f expref: 11 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.324187:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db463 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb15f expref: 10 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.324196:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9f016a500) 00010000:00010000:3.0:1788872874.324212:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788872874.324216:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5a00, rc 0) 00000100:00100000:3.0:1788872874.324280:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f098bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72034:x1875765311215232:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 353us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.324286:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1382 00000100:00100000:1.0:1788872874.329845:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872874.330967:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311215488 00000100:00100000:2.0:1788872874.330979:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311215488 00000100:00100000:2.0:1788872874.331145:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1383 00000100:00100000:2.0:1788872874.331157:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72034:x1875765311215488:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788872874.331190:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872874.331217:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db46a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb166 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872874.331337:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788872874.331468:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db46a lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb166 expref: 12 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.331483:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f9e3f200) 00010000:00010000:2.0:1788872874.331486:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788872874.331491:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db46a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb166 expref: 12 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.331512:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899200, rc 0) 00000100:00100000:2.0:1788872874.331644:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+11:72034:x1875765311215488:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 488us (1808us total) trans 77309411461 rc 301/301 00000100:00100000:2.0:1788872874.331652:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1383 00000100:00100000:0.0:1788872874.334159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872874.334304:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311215744 00000100:00100000:2.0:1788872874.334404:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311215744 00000100:00100000:2.0:1788872874.334500:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1384 00000100:00100000:2.0:1788872874.334512:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f098b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:72034:x1875765311215744:12345-192.168.204.39@tcp:36:lfs.0 00010000:00010000:2.0:1788872874.334617:0:66192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872874.334648:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01db463 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb15f expref: 11 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.334670:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9f016a500) 00010000:00010000:2.0:1788872874.334675:0:66192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872874.334700:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db478 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.334714:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db478 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.334724:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db478 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872874.334879:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c587cbea reply state 00000000e9b5ccbc transno 77309411462 ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db478 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.334893:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db478 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.334899:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9f016a500) 00010000:00010000:2.0:1788872874.334902:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1788872874.334917:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788872874.334925:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000100:00100000:2.0:1788872874.335264:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f098b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+12:72034:x1875765311215744:12345-192.168.204.39@tcp:36:lfs.0 Request processed in 753us (1111us total) trans 77309411462 rc 0/0 00000100:00100000:2.0:1788872874.335273:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1384 00000100:00100000:1.0:1788872874.338432:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872874.338525:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311216000 00000100:00100000:3.0:1788872874.338536:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311216000 00000100:00100000:3.0:1788872874.338631:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 240 00000100:00100000:3.0:1788872874.338643:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+12:72034:x1875765311216000:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:3.0:1788872874.338879:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+13:72034:x1875765311216000:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 225us (442us total) trans 77309411463 rc 0/0 00000100:00100000:3.0:1788872874.338887:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 240 00000100:00100000:1.0:1788872874.361471:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872874.361708:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311216128 00000100:00100000:3.0:1788872874.361722:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311216128 00000100:00100000:2.0:1788872874.361939:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1385 00000100:00100000:2.0:1788872874.361952:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72035:x1875765311216128:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:2.0:1788872874.361972:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872874.362098:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db47f lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb16d expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.362459:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db486 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.362474:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db486 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.362485:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db486 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.362498:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.362508:0:83669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db416 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db40f expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.362516:0:83669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.362887:0:83669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db416 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db40f expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872874.362924:0:83669:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:83669:1875765327811968:0@lo:104: 00000100:00100000:2.0:1788872874.362989:0:83669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872874.363046:0:83669:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c743b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.363237:0:13343:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788872874.363253:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327811968 00000100:00100000:0.0:1788872874.363257:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327811968 00000100:00100000:0.0:1788872874.363299:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788872874.363307:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c8a57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:83669:x1875765327811968:12345-0@lo:104: 00010000:00010000:0.0:1788872874.363320:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db416 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872874.363397:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788872874.363404:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c8a57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:83669:x1875765327811968:12345-0@lo:104: Request processed in 98us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.363422:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788872874.366821:0:83669:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:83669:1875765327811968:0@lo:104: 00010000:00010000:2.0:1788872874.366852:0:83669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872874.367489:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872874.367501:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db416 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872874.367513:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898c00 already unused, calling callback (ffffffffc19e46f0) 00010000:00010000:1.0:1788872874.367520:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db416 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872874.367530:0:6509:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db416 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872874.367612:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db416 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872874.367620:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872874.367656:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db416 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872874.367665:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a9fa898c00/0xe4e6e89fb01db40f lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db416 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872874.367709:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872874.367711:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872874.367713:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872874.367876:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872874.367897:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327812096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872874.367965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872874.368191:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327812096 00000100:00100000:3.0:1788872874.368199:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327812096 00010000:00010000:3.0:1788872874.368244:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db416 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xe4e6e89fb01db40f expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872874.368283:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:3.0:1788872874.368293:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3647:x1875765327812096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872874.368306:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872874.369241:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db416 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db40f expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.369258:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff98a8ca103100) 00010000:00010000:3.0:1788872874.369264:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.369283:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.369292:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.369326:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872874.369388:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327812096:12345-0@lo:103:ldlm_bl.0 Request processed in 1083us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.369396:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00010000:00010000:1.0:1788872874.369514:0:83669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872874.369523:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872874.369659:0:83669:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:83669:1875765327812224:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1788872874.369694:0:83669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872874.369718:0:83669:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5f69d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872874.369800:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327812096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872874.370042:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327812224 00000100:00100000:3.0:1788872874.370049:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327812224 00000100:00100000:3.0:1788872874.370089:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00100000:3.0:1788872874.370097:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:83669:x1875765327812224:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1788872874.370184:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:83669:x1875765327812224:12345-0@lo:1000:mdt00_005.0 Request processed in 88us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.370191:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000100:00100000:2.0:1788872874.370355:0:83669:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:83669:1875765327812224:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1788872874.370416:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899000/0xe4e6e89fb01db494 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370428:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899000/0xe4e6e89fb01db494 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370436:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899000/0xe4e6e89fb01db494 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872874.370458:0:83669:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899000/0xe4e6e89fb01db494 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370469:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db486 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370475:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db486 lrc: 2/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370481:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db486 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370501:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872874.370505:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db486 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370512:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db486 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370523:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f9e3f400) 00010000:00010000:2.0:1788872874.370526:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872874.370530:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db486 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370537:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01db486 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370572:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370579:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370585:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370589:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872874.370592:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370597:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370615:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff98a8ca103100) 00010000:00010000:2.0:1788872874.370618:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872874.370621:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370628:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01db48d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370667:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db47f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb16d expref: 11 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370682:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899000/0xe4e6e89fb01db494 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb16d expref: 10 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.370690:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9f9e3f200) 00010000:00010000:2.0:1788872874.370693:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788872874.370695:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899000, rc 0) 00000100:00100000:2.0:1788872874.370740:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72035:x1875765311216128:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 8792us (9279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872874.370747:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1385 00000100:00100000:0.0:1788872874.376642:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872874.376814:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311216256 00000100:00100000:3.0:1788872874.376826:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311216256 00000100:00100000:3.0:1788872874.376900:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1386 00000100:00100000:3.0:1788872874.376911:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+13:72035:x1875765311216256:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872874.376938:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872874.376961:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db49b lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb174 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.377043:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db4a2 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.377081:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db4a2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.377093:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db4a2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872874.377144:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788872874.377148:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788872874.377186:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db49b lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb174 expref: 15 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.377219:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db4a2 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb174 expref: 14 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.377228:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9f9e3ff00) 00010000:00010000:3.0:1788872874.377231:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788872874.377235:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4200, rc 0) 00000100:00100000:3.0:1788872874.377302:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+14:72035:x1875765311216256:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 393us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.377310:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1386 00000100:00100000:0.0:1788872874.387083:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872874.387337:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311216512 00000100:00100000:3.0:1788872874.387347:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311216512 00000100:00100000:3.0:1788872874.387426:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1387 00000100:00100000:3.0:1788872874.387437:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+14:72035:x1875765311216512:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872874.387458:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872874.387484:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db4a9 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb17b expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872874.387652:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788872874.387763:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db4a9 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb17b expref: 16 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.387777:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9c329d600) 00010000:00010000:3.0:1788872874.387781:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788872874.387786:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db4a9 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb17b expref: 16 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.387802:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5e00, rc 0) 00000100:00100000:3.0:1788872874.387858:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+15:72035:x1875765311216512:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 422us (783us total) trans 77309411464 rc 301/301 00000100:00100000:3.0:1788872874.387866:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1387 00000100:00100000:1.0:1788872874.391093:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872874.391290:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311216768 00000100:00100000:3.0:1788872874.391304:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311216768 00000100:00100000:3.0:1788872874.391359:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1388 00000100:00100000:3.0:1788872874.391369:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+15:72035:x1875765311216768:12345-192.168.204.39@tcp:36:lfs.0 00010000:00010000:3.0:1788872874.391444:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872874.391769:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db4a2 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb174 expref: 15 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.391788:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9f9e3ff00) 00010000:00010000:3.0:1788872874.391793:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872874.391882:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4b7 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.391922:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4b7 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872874.391933:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4b7 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872874.392264:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007174e5ff reply state 000000002ac93c6e transno 77309411465 ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4b7 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.392277:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4b7 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872874.392284:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9f9e3ff00) 00010000:00010000:2.0:1788872874.392287:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1788872874.392295:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788872874.392303:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000100:00100000:2.0:1788872874.393176:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+16:72035:x1875765311216768:12345-192.168.204.39@tcp:36:lfs.0 Request processed in 1803us (2089us total) trans 77309411465 rc 0/0 00000100:00100000:2.0:1788872874.393186:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1388 00000100:00100000:0.0:1788872874.396215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872874.396323:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311217024 00000100:00100000:1.0:1788872874.396333:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311217024 00000100:00100000:1.0:1788872874.396444:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 241 00000100:00100000:1.0:1788872874.396455:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+16:72035:x1875765311217024:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:1.0:1788872874.396724:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+17:72035:x1875765311217024:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 269us (516us total) trans 77309411466 rc 0/0 00000100:00100000:1.0:1788872874.396732:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 241 00000100:00100000:0.0:1788872874.681074:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327812352:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681159:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.681196:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327812864:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681220:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.681235:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327813376:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.681274:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788872874.681279:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327812736:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681295:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.681308:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327813248:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.681348:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327812480:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681367:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.681397:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327812992:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681419:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.681435:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327813504:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681486:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.681503:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788872874.681508:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327812608:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681529:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.681547:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327813120:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.681618:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327813632:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872874.681668:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327813376 00000100:00100000:0.0:1788872874.681677:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327813376 00000100:00100000:0.0:1788872874.681722:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327812992 00000100:00100000:0.0:1788872874.681725:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327812992 00000100:00100000:0.0:1788872874.681740:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327813504 00000100:00100000:0.0:1788872874.681742:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327813504 00000100:00100000:0.0:1788872874.681757:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327813120 00000100:00100000:0.0:1788872874.681759:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327813120 00000100:00100000:0.0:1788872874.681777:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:0.0:1788872874.681785:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327813376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681836:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327813376:12345-0@lo:400:kworker.0 Request processed in 50us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.681843:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:0.0:1788872874.681858:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690 00000100:00100000:0.0:1788872874.681864:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327812992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681893:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327812992:12345-0@lo:400:kworker.0 Request processed in 30us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.681899:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690 00000100:00100000:0.0:1788872874.681909:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00100000:0.0:1788872874.681922:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327813504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681951:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327813504:12345-0@lo:400:kworker.0 Request processed in 31us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.681957:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000100:00100000:0.0:1788872874.681968:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:0.0:1788872874.681973:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327813120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.681997:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327813120:12345-0@lo:400:kworker.0 Request processed in 24us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.682002:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00100000:0.0:1788872874.682019:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327812864 00000100:00100000:0.0:1788872874.682022:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327812864 00000100:00100000:0.0:1788872874.682042:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327812736 00000100:00100000:0.0:1788872874.682044:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327812736 00000100:00100000:0.0:1788872874.682055:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327813248 00000100:00100000:0.0:1788872874.682057:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327813248 00000100:00100000:0.0:1788872874.682066:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327812480 00000100:00100000:0.0:1788872874.682068:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327812480 00000100:00100000:0.0:1788872874.682077:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327812608 00000100:00100000:0.0:1788872874.682079:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327812608 00000100:00100000:0.0:1788872874.682088:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327813632 00000100:00100000:0.0:1788872874.682090:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327813632 00000100:00100000:0.0:1788872874.682101:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:0.0:1788872874.682105:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327812864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682135:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327812864:12345-0@lo:400:kworker.0 Request processed in 28us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.682141:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:0.0:1788872874.682151:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1788872874.682156:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327812736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682194:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327812736:12345-0@lo:400:kworker.0 Request processed in 36us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.682200:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1788872874.682212:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1788872874.682218:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327813248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682244:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327813248:12345-0@lo:400:kworker.0 Request processed in 26us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.682249:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1788872874.682259:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1788872874.682264:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327812480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682289:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327812480:12345-0@lo:400:kworker.0 Request processed in 24us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.682295:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1788872874.682305:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:0.0:1788872874.682310:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327812608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682337:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327812608:12345-0@lo:400:kworker.0 Request processed in 27us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.682343:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:0.0:1788872874.682353:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1788872874.682358:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327813632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682395:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327813632:12345-0@lo:400:kworker.0 Request processed in 37us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872874.682401:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00080000:0.0:1788872874.682431:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872874.682436:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872874.682445:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872874.682447:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872874.682484:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327812736:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682494:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327813248:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682503:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327812864:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682512:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327813376:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682544:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327812608:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682575:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327813120:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682585:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327813632:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682593:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327812480:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682601:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327812992:0@lo:400:kworker.0 00000100:00100000:0.0:1788872874.682609:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327813504:0@lo:400:kworker.0 00000100:00100000:3.0:1788872874.683797:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327812352 00000100:00100000:3.0:1788872874.683807:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327812352 00000100:00100000:3.0:1788872874.683851:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788872874.683858:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327812352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872874.683933:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327812352:12345-0@lo:400:kworker.0 Request processed in 75us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.683940:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788872874.683993:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327812352:0@lo:400:kworker.0 00000100:00100000:1.0:1788872874.684772:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327813760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872874.684816:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872874.684845:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872874.684851:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327813888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872874.688454:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872874.688482:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327814016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872874.688596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872874.688652:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327814016 00000100:00100000:3.0:1788872874.688660:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327814016 00000100:00100000:3.0:1788872874.688712:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:3.0:1788872874.688722:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327814016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872874.688752:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872874.688798:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327814016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.688806:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:3.0:1788872874.688857:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327814016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872874.689086:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327813760 00000100:00100000:3.0:1788872874.689090:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327813760 00000100:00100000:3.0:1788872874.689245:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00100000:3.0:1788872874.689253:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327813760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872874.689288:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00000100:00100000:3.0:1788872874.689325:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327813760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (4508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.689332:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00100000:3.0:1788872874.689422:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788872874.689431:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327814144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872874.689600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872874.689631:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000004:00080000:1.0:1788872874.689644:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084295 committed transno 120259084296 00000004:00080000:1.0:1788872874.689663:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084296 committed transno 120259084296 00000100:00100000:1.0:1788872874.689680:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327813760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872874.689701:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327813888 00000100:00100000:1.0:1788872874.689704:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327813888 00000100:00100000:1.0:1788872874.689737:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:1.0:1788872874.689744:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327813888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872874.689762:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1788872874.689794:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327813888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872874.689801:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00000100:00100000:1.0:1788872874.689831:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327813888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872874.690979:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872874.692652:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327814144 00000100:00100000:3.0:1788872874.692667:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327814144 00000100:00100000:3.0:1788872874.692729:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168 00000100:00100000:3.0:1788872874.692741:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327814144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872874.692774:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872874.692850:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327814144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872874.692857:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168 00000100:00100000:1.0:1788872874.707756:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327814144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872875.192746:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872875.192781:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327814272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872875.192866:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872875.192916:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327814272 00000100:00100000:1.0:1788872875.192923:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327814272 00000100:00100000:1.0:1788872875.192985:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:1.0:1788872875.192994:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327814272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872875.193021:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872875.193064:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327814272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872875.193070:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00100000:1.0:1788872875.193117:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327814272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872875.198672:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872875.198695:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327814400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872875.202118:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872875.202318:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327814400 00000100:00100000:1.0:1788872875.202329:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327814400 00000100:00100000:1.0:1788872875.202414:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:1.0:1788872875.202426:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327814400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872875.202468:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872875.202571:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327814400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (3808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872875.202579:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00000100:00100000:0.0:1788872875.202932:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327814400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788872875.330597:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788872875.342606:0:75620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411466 is committed 00000020:00080000:2.0:1788872875.342631:0:75620:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98a8c743b480 refcount 2 committed 0 result 0 batchid 73014444093 00000020:00080000:2.0:1788872875.342637:0:75620:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98a8c3627d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98a8c743ba80 00000020:00080000:2.0:1788872875.342640:0:75620:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000090a1:0x2:0x0].5 00000020:00080000:2.0:1788872875.342643:0:75620:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98a8c3627c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98a9c9cce600 00000020:00080000:2.0:1788872875.342645:0:75620:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].5 00000020:00080000:1.0:1788872875.342686:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444091 00000020:00080000:2.0:1788872875.342746:0:75620:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff98a8c76703c0 refcount 2 committed 0 result 0 batchid 73014444092 00000020:00080000:2.0:1788872875.342749:0:75620:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98a9fa91f700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff98a8c76700c0 00000020:00080000:2.0:1788872875.342752:0:75620:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000090a1:0x2:0x0].4 00000020:00080000:2.0:1788872875.342754:0:75620:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98a9fa91f200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98a8c36cd200 00000020:00080000:2.0:1788872875.342756:0:75620:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].4 00000020:00080000:1.0:1788872875.342952:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444093 committed batchid 73014444091 00000020:00080000:1.0:1788872875.343025:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444091 00010000:00010000:3.0:1788872875.343343:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db3d0 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343356:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db3d0 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343375:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db3d0 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343398:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872875.343403:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db3d0 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343411:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db3d0 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343430:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9f016a500) 00010000:00010000:3.0:1788872875.343433:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872875.343438:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db3d0 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343458:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db3d0 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343483:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01db41d lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343489:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01db41d lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343496:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01db41d lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343501:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872875.343505:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01db41d lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343512:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01db41d lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343532:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9f9e3ff00) 00010000:00010000:3.0:1788872875.343535:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872875.343538:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01db41d lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343545:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01db41d lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343580:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db478 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343587:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db478 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343593:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db478 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343599:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872875.343602:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db478 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343609:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db478 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343616:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9f016a500) 00010000:00010000:3.0:1788872875.343619:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788872875.343622:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db478 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343628:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9fa899400/0xe4e6e89fb01db478 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343658:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4b7 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343664:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4b7 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343671:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4b7 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343677:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872875.343680:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4b7 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343687:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4b7 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343696:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9f9e3ff00) 00010000:00010000:3.0:1788872875.343698:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788872875.343701:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4b7 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.343708:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4b7 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788872875.362749:0:75620:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444093 batchid updated 00000020:00080000:1.0:1788872875.362804:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444093 00000004:00080000:1.0:1788872875.362881:0:75640:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98a9c5492d80 with version 15 00000020:00080000:1.0:1788872875.362904:0:75640:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444092 cancel update log [0x2000090a1:0x2:0x0].4: rc = 0 00000020:00080000:1.0:1788872875.362988:0:75640:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444092 cancel update log [0x2400088d0:0x2:0x0].4: rc = 0 00000004:00080000:1.0:1788872875.363016:0:75640:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff98a9c5492240 with version 16 00000020:00080000:1.0:1788872875.363019:0:75640:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444093 cancel update log [0x2000090a1:0x2:0x0].5: rc = 0 00000020:00080000:1.0:1788872875.363043:0:75640:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444093 cancel update log [0x2400088d0:0x2:0x0].5: rc = 0 00000020:00080000:1.0:1788872875.363049:0:75640:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444093 00000004:00080000:3.0:1788872875.363162:0:75625:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98a8c5c4f240 version 15 rpc_version 15 00000020:00100000:3.0:1788872875.363200:0:75625:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788872875.363213:0:75625:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98a8c7831f80 x1875765327814656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872875.363241:0:75625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7831f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327814656:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788872875.363318:0:75625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872875.363380:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c25216c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872875.363692:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327814656 00000100:00100000:1.0:1788872875.363701:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327814656 00000100:00100000:1.0:1788872875.363756:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:1.0:1788872875.363766:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75625:x1875765327814656:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788872875.364058:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75625:x1875765327814656:12345-0@lo:1000:osp_up0-1.0 Request processed in 292us (738us total) trans 120259084297 rc 0/0 00000100:00100000:1.0:1788872875.364076:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000100:00100000:3.0:1788872875.364170:0:75625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7831f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327814656:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788872875.364183:0:75625:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98a8c5c4f240 version 16 rpc_version 16 00000020:00100000:3.0:1788872875.364198:0:75625:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788872875.364203:0:75625:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98a8c7830a80 x1875765327814912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872875.364219:0:75625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327814912:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788872875.364263:0:75625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872875.364287:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c3892180 going to sleep for 11 seconds 00000100:00100000:1.0:1788872875.364467:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327814912 00000100:00100000:1.0:1788872875.364472:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327814912 00000100:00100000:1.0:1788872875.364505:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:1.0:1788872875.364513:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75625:x1875765327814912:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788872875.364633:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75625:x1875765327814912:12345-0@lo:1000:osp_up0-1.0 Request processed in 121us (369us total) trans 120259084298 rc 0/0 00000100:00100000:1.0:1788872875.364640:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000100:00100000:3.0:1788872875.364802:0:75625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75625:1875765327814912:0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1788872875.369416:0:92455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00000100:00100000:2.0:1788872875.468396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872875.468535:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311217152 00000100:00100000:3.0:1788872875.468747:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311217152 00000100:00100000:3.0:1788872875.469008:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1389 00000100:00100000:3.0:1788872875.469020:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72044:x1875765311217152:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872875.469065:0:66193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00000100:00100000:3.0:1788872875.469138:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72044:x1875765311217152:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 120us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872875.469146:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1389 00000100:00100000:0.0:1788872875.474175:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872875.474256:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311217280 00000100:00100000:2.0:1788872875.474266:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311217280 00000100:00100000:2.0:1788872875.474323:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1390 00000100:00100000:2.0:1788872875.474333:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+5:72044:x1875765311217280:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:2.0:1788872875.474398:0:83669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1788872875.474605:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+5:72044:x1875765311217280:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 272us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872875.474625:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1390 00000100:00100000:1.0:1788872875.486268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872875.487131:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311217408 00000100:00100000:3.0:1788872875.487148:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311217408 00000100:00100000:3.0:1788872875.487215:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2171 00000100:00100000:3.0:1788872875.487226:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+5:72044:x1875765311217408:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872875.487253:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872875.487331:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+5:72044:x1875765311217408:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 106us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872875.487354:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2171 00000100:00080000:2.0:1788872875.487774:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872875.496147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872875.497251:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311217536 00000100:00100000:2.0:1788872875.497266:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311217536 00000100:00100000:2.0:1788872875.497332:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5994 00000100:00100000:2.0:1788872875.497341:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875765311217536:12345-192.168.204.39@tcp:8:lfs.0 00010000:00080000:2.0:1788872875.497391:0:8437:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp t0 exp 0000000000000000 cur 3812 last 0 00000020:00000080:2.0:1788872875.497423:0:8437:0:(genops.c:1406:class_connect()) connect: client 0804304d-5904-48ad-87f2-bcbc7642a62a, cookie 0xe4e6e89fb01db4be 00002000:00100000:2.0:1788872875.497436:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0804304d-5904-48ad-87f2-bcbc7642a62a/ffff98a8c4ba4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788872875.497448:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788872875.497534:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788872875.498228:0:8437:0:(import.c:65:import_set_state_nolock()) ffff98a8c4ba6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872875.498581:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311217536:12345-192.168.204.39@tcp:8:lfs.0 Request processed in 1236us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872875.498600:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5994 00000100:00100000:0.0:1788872875.503991:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872875.504425:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311217664 00000100:00100000:1.0:1788872875.504436:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311217664 00000100:00080000:0.0:1788872875.504512:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872875.504634:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2172 00000100:00100000:1.0:1788872875.504648:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+6:72044:x1875765311217664:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:1.0:1788872875.504680:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872875.504762:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+6:72044:x1875765311217664:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 118us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872875.504770:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2172 00000100:00100000:1.0:1788872875.580616:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872875.580799:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311217920 00000100:00100000:3.0:1788872875.580810:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311217920 00000100:00100000:3.0:1788872875.580875:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1391 00000100:00100000:3.0:1788872875.580888:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72051:x1875765311217920:12345-192.168.204.39@tcp:36:mcreate.0 00010000:00010000:3.0:1788872875.580947:0:66979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872875.580975:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899600/0xe4e6e89fb01db3de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb143 expref: 10 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.581004:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:3.0:1788872875.581009:0:66979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872875.581069:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.581083:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.581093:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.581109:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db4cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.581297:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db4cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.581306:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db4cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.582153:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4c5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.582166:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4c5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.582173:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.582181:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.582187:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872875.582191:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.582199:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4c5 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.582210:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:3.0:1788872875.582213:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872875.582217:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4c5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.582223:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4c5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872875.582235:0:66979:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006fa1995e reply state 000000007a1187c7 transno 120259084299 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db4cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.582245:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db4cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.582262:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c329df00) 00010000:00010000:3.0:1788872875.582264:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872875.582267:0:66979:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788872875.582390:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+11:72051:x1875765311217920:12345-192.168.204.39@tcp:36:mcreate.0 Request processed in 1502us (1781us total) trans 120259084299 rc 0/0 00000100:00100000:3.0:1788872875.582399:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1391 00000100:00100000:3.0:1788872875.629957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872875.629989:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311218048 00000100:00100000:3.0:1788872875.629998:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311218048 00000100:00100000:3.0:1788872875.630050:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1392 00000100:00100000:3.0:1788872875.630060:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:72054:x1875765311218048:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:3.0:1788872875.630082:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872875.630104:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb182 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.630165:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db4da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.630179:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db4da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.630191:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db4da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872875.630236:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872875.630240:0:66192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872875.630259:0:66192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db4da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.630302:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb182 expref: 13 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.630317:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db4da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb182 expref: 12 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.630326:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:3.0:1788872875.630329:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872875.630333:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4200, rc 0) 00000100:00100000:3.0:1788872875.630396:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+12:72054:x1875765311218048:12345-192.168.204.39@tcp:101:rm.0 Request processed in 338us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872875.630403:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1392 00000100:00100000:3.0:1788872875.641978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872875.642079:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311218176 00000100:00100000:0.0:1788872875.642091:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311218176 00000100:00100000:0.0:1788872875.642168:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1393 00000100:00100000:0.0:1788872875.642180:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+12:72054:x1875765311218176:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:0.0:1788872875.642202:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872875.642237:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afe00/0xe4e6e89fb01db4e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb189 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.642309:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db4e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.642323:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db4e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.642334:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db4e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.642345:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db4ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.642351:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db4ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.642369:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db4ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.642449:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db4f6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.642458:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db4f6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.642475:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db4f6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872875.642528:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x3:0x0]: returning size 0 00000004:00200000:0.0:1788872875.642532:0:66190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788872875.642606:0:66190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db4f6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.642626:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db4f6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.642636:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db4e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643054:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db4e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643064:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db4e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643071:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db4e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643077:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872875.643082:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db4e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643090:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db4e8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643104:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:0.0:1788872875.643107:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872875.643112:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db4e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643117:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01db4e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643132:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db4ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643145:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db4ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643150:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db4ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643155:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872875.643158:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db4ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643163:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db4ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643172:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c329df00) 00010000:00010000:0.0:1788872875.643174:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872875.643177:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db4ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643183:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db4ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643217:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afe00/0xe4e6e89fb01db4e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb189 expref: 14 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643231:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db4f6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb189 expref: 13 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872875.643238:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff98a9e1e20f00) 00010000:00010000:0.0:1788872875.643240:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872875.643248:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af400, rc 0) 00000100:00100000:0.0:1788872875.643845:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+13:72054:x1875765311218176:12345-192.168.204.39@tcp:101:rm.0 Request processed in 1664us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872875.643854:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1393 00000100:00100000:0.0:1788872875.647020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872875.647235:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311218432 00000100:00100000:3.0:1788872875.647247:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311218432 00000100:00100000:3.0:1788872875.647343:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1394 00000100:00100000:3.0:1788872875.647363:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+13:72054:x1875765311218432:12345-192.168.204.39@tcp:36:rm.0 00010000:00010000:3.0:1788872875.647428:0:66979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788872875.647458:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db4f6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb189 expref: 13 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647487:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff98a9e1e20f00) 00010000:00010000:3.0:1788872875.647506:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db4da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb182 expref: 12 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647516:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:3.0:1788872875.647535:0:66979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872875.647577:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647592:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647603:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647614:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db504 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647621:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db504 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647628:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db504 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647729:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db50b lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647739:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db50b lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647746:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db50b lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647954:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db512 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647964:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db512 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647982:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db512 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.647990:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db512 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648009:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db512 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648017:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db512 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648037:0:66979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872875.648057:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db50b lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648064:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db50b lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648070:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db50b lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648076:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872875.648080:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db50b lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648089:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db50b lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648098:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:3.0:1788872875.648100:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788872875.648134:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db50b lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648141:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db50b lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648158:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648164:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648170:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648176:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648181:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872875.648183:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648189:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4fd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648197:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:3.0:1788872875.648199:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872875.648202:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4fd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648207:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db4fd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872875.648217:0:66979:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000077790d53 reply state 00000000ecdad4ae transno 120259084300 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db504 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648235:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db504 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.648241:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c329df00) 00010000:00010000:3.0:1788872875.648243:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872875.648246:0:66979:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788872875.648323:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+13:72054:x1875765311218432:12345-192.168.204.39@tcp:36:rm.0 Request processed in 971us (1312us total) trans 120259084300 rc 0/0 00000100:00100000:3.0:1788872875.648331:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1394 00010000:00010000:3.0:1788872875.649318:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872875.649327:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db512 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.649337:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872875.649340:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db512 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.649348:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db512 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.649372:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:3.0:1788872875.649376:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788872875.649380:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db512 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.649387:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db512 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872875.649401:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872875.649403:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872875.649419:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872876.350335:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872877.368693:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872877.844467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872877.844517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872877.844585:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872877.844607:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872877.844631:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872877.844666:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311218944 00000100:00100000:3.0:1788872877.844677:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311218944 00000100:00100000:3.0:1788872877.844739:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311219072 00000100:00100000:3.0:1788872877.844742:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311219072 00000100:00100000:3.0:1788872877.844767:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2693 00000100:00100000:3.0:1788872877.844779:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311218944:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872877.844866:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311218944:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 88us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872877.844875:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2693 00000100:00100000:3.0:1788872877.844896:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2694 00000100:00100000:3.0:1788872877.844902:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c56ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2406:x1875765311219072:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872877.844927:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c56ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2406:x1875765311219072:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872877.844933:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2694 00000100:00100000:3.0:1788872877.844950:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311218688 00000100:00100000:3.0:1788872877.844953:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311218688 00000100:00100000:3.0:1788872877.844982:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311218816 00000100:00100000:3.0:1788872877.844985:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311218816 00000100:00100000:3.0:1788872877.845005:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1393 00000100:00100000:3.0:1788872877.845011:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+13:2407:x1875765311218688:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000080:3.0:1788872877.845034:0:66193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c3a66300 x1875765311218688/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:48/0 lens 224/224 e 0 to 0 dl 1788872888 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872877.845067:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+13:2407:x1875765311218688:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 56us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872877.845073:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1393 00000100:00100000:3.0:1788872877.845085:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1394 00000100:00100000:3.0:1788872877.845091:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311218816:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872877.845112:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311218816:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 21us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872877.845118:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1394 00000100:00080000:3.0:1788872877.845136:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872877.845139:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872877.845142:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872877.845144:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872877.845352:0:92461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311218560 00000100:00100000:2.0:1788872877.845357:0:92461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311218560 00000100:00100000:2.0:1788872877.845396:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 172 00000100:00100000:2.0:1788872877.845405:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311218560:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872877.845438:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311218560:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 35us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872877.845444:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 172 00010000:00010000:3.0:1788872878.393115:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872879.419177:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872879.801642:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872879.801677:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c56fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327815040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872879.801789:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872879.801864:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327815040 00000100:00100000:3.0:1788872879.801878:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327815040 00000100:00100000:3.0:1788872879.801955:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:3.0:1788872879.801967:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327815040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872879.802009:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872879.802257:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327815040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 291us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872879.802265:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000100:00080000:3.0:1788872879.802304:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872879.802348:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c56fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327815040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872879.805025:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872879.805171:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327815168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872879.805290:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872879.805850:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327815552:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.805893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872879.806087:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327815296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872879.806123:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872879.806177:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327815808:0@lo:400:kworker.0 00000100:00100000:0.0:1788872879.806208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872879.806231:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327816320:0@lo:400:kworker.0 00000100:00100000:0.0:1788872879.806257:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872879.806292:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327816832:0@lo:400:kworker.0 00000100:00100000:0.0:1788872879.806316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872879.806352:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788872879.806358:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c56fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327815424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872879.806382:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872879.806403:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327815936:0@lo:400:kworker.0 00000100:00100000:0.0:1788872879.806425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872879.806444:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327816448:0@lo:400:kworker.0 00000100:00100000:0.0:1788872879.806464:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872879.806501:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327815808 00000100:00100000:0.0:1788872879.806510:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327815808 00000100:00100000:0.0:1788872879.806602:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327816832 00000100:00100000:0.0:1788872879.806605:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327816832 00000100:00100000:0.0:1788872879.806626:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327815936 00000100:00100000:0.0:1788872879.806647:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327815936 00000100:00100000:0.0:1788872879.806669:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327816448 00000100:00100000:0.0:1788872879.806672:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327816448 00000100:00100000:0.0:1788872879.806689:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:0.0:1788872879.806699:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327815808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.806949:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327816064:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.806987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872879.806999:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327816576:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.807022:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872879.807045:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788872879.807052:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327815680:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.807123:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872879.807136:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327816192:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.807158:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872879.807178:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327816704:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.807202:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872879.807242:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327815168 00000100:00100000:1.0:1788872879.807247:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327815168 00000100:00100000:1.0:1788872879.807294:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327815296 00000100:00100000:1.0:1788872879.807297:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327815296 00000100:00100000:1.0:1788872879.807315:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327816192 00000100:00100000:1.0:1788872879.807319:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327816192 00000100:00100000:1.0:1788872879.807330:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:1.0:1788872879.807337:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327815168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872879.807374:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1788872879.807421:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327815168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872879.807429:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00100000:1.0:1788872879.807448:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:1.0:1788872879.807454:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1875765327815296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788872879.807478:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00010000:00000080:1.0:1788872879.807493:0:30614:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f5eebb80 x1875765327815296/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:50/0 lens 224/368 e 0 to 0 dl 1788872890 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872879.807539:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1875765327815296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872879.807569:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00000100:00100000:1.0:1788872879.807583:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:1.0:1788872879.807589:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327816192:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788872879.807602:0:30614:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c1c9d880 x1875765327816192/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:50/0 lens 224/224 e 0 to 0 dl 1788872890 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872879.807627:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327816192:12345-0@lo:400:kworker.0 Request processed in 39us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872879.807633:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000100:00100000:1.0:1788872879.807656:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327815424 00000100:00100000:1.0:1788872879.807660:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327815424 00000100:00100000:1.0:1788872879.807692:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174 00000100:00100000:1.0:1788872879.807699:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327815424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872879.807724:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872879.807757:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327815424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872879.808419:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327815808:12345-0@lo:400:kworker.0 Request processed in 1717us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872879.808431:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:0.0:1788872879.808457:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327816064 00000100:00100000:0.0:1788872879.808462:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327816064 00000100:00100000:0.0:1788872879.808488:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327815680 00000100:00100000:0.0:1788872879.808490:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327815680 00000100:00100000:0.0:1788872879.808509:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:0.0:1788872879.808514:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327816832:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788872879.808530:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4df3800 x1875765327816832/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:50/0 lens 224/224 e 0 to 0 dl 1788872890 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872879.808585:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327816832:12345-0@lo:400:kworker.0 Request processed in 71us (2268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872879.808591:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:0.0:1788872879.808605:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1788872879.808611:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327815936:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788872879.808624:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4df2300 x1875765327815936/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:50/0 lens 224/224 e 0 to 0 dl 1788872890 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872879.808653:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327815936:12345-0@lo:400:kworker.0 Request processed in 42us (2227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872879.808659:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1788872879.808674:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1788872879.808695:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327816448:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788872879.808707:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4df2d80 x1875765327816448/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:50/0 lens 224/224 e 0 to 0 dl 1788872890 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872879.808738:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327816448:12345-0@lo:400:kworker.0 Request processed in 44us (2272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872879.808743:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1788872879.808755:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:1.0:1788872879.809029:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174 00000100:00100000:1.0:1788872879.809182:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327816320 00000100:00100000:1.0:1788872879.809188:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327816320 00000100:00100000:1.0:1788872879.809232:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327816576 00000100:00100000:1.0:1788872879.809235:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327816576 00000100:00100000:1.0:1788872879.809261:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327816704 00000100:00100000:1.0:1788872879.809265:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327816704 00000100:00100000:1.0:1788872879.809304:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:1.0:1788872879.809311:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327816320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.809379:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327816320:12345-0@lo:400:kworker.0 Request processed in 69us (3121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872879.809386:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:1.0:1788872879.809398:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696 00000100:00100000:1.0:1788872879.809405:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327816576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.809433:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327816576:12345-0@lo:400:kworker.0 Request processed in 30us (2411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872879.809438:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696 00000100:00100000:1.0:1788872879.809448:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697 00000100:00100000:1.0:1788872879.809454:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327816704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.809478:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327816704:12345-0@lo:400:kworker.0 Request processed in 25us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872879.809483:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697 00000100:00100000:1.0:1788872879.809569:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327816192:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.809584:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327816704:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.809598:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327816576:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.809617:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327815168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872879.809680:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c56fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327815424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872879.809692:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327815936:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.809704:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327816448:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.809728:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327815296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872879.809741:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327815808:0@lo:400:kworker.0 00000100:00100000:0.0:1788872879.812260:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327816064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872879.812444:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327816064:12345-0@lo:400:kworker.0 Request processed in 209us (5456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872879.812454:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:0.0:1788872879.812497:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1788872879.812506:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327815680:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788872879.812521:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6561500 x1875765327815680/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:50/0 lens 224/224 e 0 to 0 dl 1788872890 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872879.812569:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327815680:12345-0@lo:400:kworker.0 Request processed in 65us (5445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872879.812575:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1788872879.813376:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327816320:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.813429:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327816832:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.813517:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327815680:0@lo:400:kworker.0 00000100:00100000:1.0:1788872879.813533:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327816064:0@lo:400:kworker.0 00000100:00080000:1.0:1788872879.814686:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872879.814696:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872879.814700:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872879.814703:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872879.821916:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327815552 00000100:00100000:3.0:1788872879.821942:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327815552 00000100:00100000:3.0:1788872879.822030:0:92461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788872879.822043:0:92461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327815552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872879.822316:0:92461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327815552:12345-0@lo:400:kworker.0 Request processed in 274us (16421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872879.822395:0:92461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788872879.823426:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327815552:0@lo:400:kworker.0 00000100:00100000:0.0:1788872880.313311:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872880.313345:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327816960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872880.313526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872880.315165:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872880.315197:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327817088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872880.315278:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872880.317805:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327816960 00000100:00100000:1.0:1788872880.317827:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327816960 00000100:00100000:0.0:1788872880.318086:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327817088 00000100:00100000:0.0:1788872880.318113:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327817088 00000100:00100000:0.0:1788872880.318158:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175 00000100:00100000:0.0:1788872880.318172:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327816960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872880.318213:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872880.318333:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327816960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (4808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872880.318341:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175 00000100:00100000:0.0:1788872880.318372:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:0.0:1788872880.318379:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327817088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872880.318391:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872880.318430:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327817088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872880.318436:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00100000:0.0:1788872880.318496:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327817088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872880.318572:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327816960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788872880.441497:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788872880.830510:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00010000:00010000:2.0:1788872881.465850:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872882.489236:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788872882.715494:0:92455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00010000:00010000:0.0:1788872882.717372:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db4cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717388:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db4cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717395:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db4cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717401:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872882.717406:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db4cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717425:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db4cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717445:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c329df00) 00010000:00010000:0.0:1788872882.717448:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872882.717453:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db4cc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717459:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01db4cc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717479:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db504 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717485:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db504 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717491:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db504 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717497:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872882.717499:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db504 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717505:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db504 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717513:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c329df00) 00010000:00010000:0.0:1788872882.717516:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872882.717518:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db504 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872882.717529:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db504 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872882.953795:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872882.953850:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872882.954111:0:92459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311219200 00000100:00100000:0.0:1788872882.954126:0:92459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311219200 00000100:00100000:0.0:1788872882.954199:0:92459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 174 00000100:00100000:0.0:1788872882.954225:0:92459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311219200:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872882.954299:0:92459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311219200:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 88us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872882.954308:0:92459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 174 00000100:00100000:3.0:1788872882.954444:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872882.954642:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872882.954671:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872882.955337:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311219712 00000100:00100000:0.0:1788872882.955344:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311219712 00000100:00100000:0.0:1788872882.955409:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311219584 00000100:00100000:0.0:1788872882.955413:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311219584 00000100:00100000:0.0:1788872882.955439:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2698 00000100:00100000:0.0:1788872882.955447:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311219712:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872882.955498:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311219712:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 52us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872882.955505:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2698 00000100:00100000:0.0:1788872882.955520:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2699 00000100:00100000:0.0:1788872882.955527:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311219584:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872882.955581:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311219584:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 54us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872882.955587:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2699 00000100:00100000:0.0:1788872882.955606:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311219456 00000100:00100000:0.0:1788872882.955632:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311219456 00000100:00100000:0.0:1788872882.955661:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311219328 00000100:00100000:0.0:1788872882.955664:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311219328 00000100:00100000:0.0:1788872882.955686:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1401 00000100:00100000:0.0:1788872882.955692:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311219456:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872882.955726:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311219456:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 34us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872882.955733:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1401 00000100:00100000:0.0:1788872882.955744:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1402 00000100:00100000:0.0:1788872882.955750:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2406:x1875765311219328:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000080:0.0:1788872882.955762:0:66192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5aced80 x1875765311219328/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:53/0 lens 224/224 e 0 to 0 dl 1788872893 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872882.955782:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2406:x1875765311219328:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 32us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872882.955787:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1402 00000100:00080000:3.0:1788872882.956618:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872882.956624:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872882.956627:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872882.956630:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788872883.515874:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788872884.007978:0:93651:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1788872884.124701:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872884.124981:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311219840 00000100:00100000:2.0:1788872884.124992:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311219840 00000100:00100000:2.0:1788872884.125062:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1395 00000100:00100000:2.0:1788872884.125074:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72122:x1875765311219840:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:2.0:1788872884.125096:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872884.125121:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898c00/0xe4e6e89fb01db519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb190 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872884.125205:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db520 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872884.125221:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872884.125234:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872884.125294:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788872884.125299:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788872884.125335:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872884.125362:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898c00/0xe4e6e89fb01db519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb190 expref: 11 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872884.125382:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb190 expref: 10 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872884.125391:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9f016af00) 00010000:00010000:2.0:1788872884.125395:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788872884.125414:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899200, rc 0) 00010000:00000080:2.0:1788872884.125422:0:66193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5acfb80 x1875765311219840/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:55/0 lens 576/688 e 0 to 0 dl 1788872895 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872884.125486:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72122:x1875765311219840:12345-192.168.204.39@tcp:101:touch.0 Request processed in 414us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872884.125493:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1395 00000100:00080000:0.0:1788872884.125633:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788872884.128319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872884.128409:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311219968 00000100:00100000:0.0:1788872884.128418:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311219968 00000100:00100000:0.0:1788872884.128485:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1396 00000100:00100000:0.0:1788872884.128496:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72122:x1875765311219968:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872884.128517:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872884.128538:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db527 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb197 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128630:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db52e lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128652:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db52e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128663:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db52e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128678:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db535 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128686:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db535 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128692:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db535 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128744:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db53c lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128752:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db53c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128759:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db53c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872884.128783:0:66192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db53c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128796:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db52e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128802:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db52e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128819:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db52e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128825:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db52e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128831:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872884.128835:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db52e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128842:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db52e lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128855:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f9e3f400) 00010000:00010000:0.0:1788872884.128859:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872884.128863:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db52e lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128870:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db52e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128882:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db535 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128888:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db535 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128894:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db535 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128899:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52aee00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872884.128908:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db535 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128914:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db535 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128921:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff98a9e1e20000) 00010000:00010000:0.0:1788872884.128924:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872884.128926:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db535 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128931:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db535 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128962:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db527 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb197 expref: 12 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128975:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db53c lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb197 expref: 11 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.128983:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9c329d200) 00010000:00010000:0.0:1788872884.128985:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788872884.128987:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af400, rc 0) 00010000:00000080:0.0:1788872884.128994:0:66192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6525880 x1875765311219968/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:55/0 lens 576/584 e 0 to 0 dl 1788872895 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872884.129064:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:72122:x1875765311219968:12345-192.168.204.39@tcp:101:touch.0 Request processed in 570us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872884.129070:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1396 00000100:00100000:2.0:1788872884.137201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872884.139497:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311220096 00000100:00100000:1.0:1788872884.139514:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311220096 00000100:00100000:1.0:1788872884.139755:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1397 00000100:00100000:1.0:1788872884.139765:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+5:72122:x1875765311220096:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:1.0:1788872884.139786:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872884.139811:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db543 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb19e expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.139877:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d200/0xe4e6e89fb01db54a lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.139891:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d200/0xe4e6e89fb01db54a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.139903:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d200/0xe4e6e89fb01db54a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872884.139965:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1788872884.139969:0:83669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1788872884.140034:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db543 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb19e expref: 7 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.140051:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d200/0xe4e6e89fb01db54a lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb19e expref: 6 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.140058:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9c1358900) 00010000:00010000:1.0:1788872884.140061:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1788872884.140064:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d200, rc 0) 00000100:00100000:1.0:1788872884.141453:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+6:72122:x1875765311220096:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1679us (4263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872884.141464:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1397 00000100:00100000:2.0:1788872884.145452:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872884.145489:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311220224 00000100:00100000:2.0:1788872884.145498:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311220224 00000100:00100000:2.0:1788872884.145570:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 735 00000100:00100000:2.0:1788872884.145580:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2404:x1875765311220224:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788872884.145596:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872884.145623:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db53c lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb197 expref: 11 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872884.145639:0:26198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9c329d200) 00010000:00010000:2.0:1788872884.145644:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872884.145696:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2404:x1875765311220224:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 116us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872884.145704:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 735 00000100:00080000:0.0:1788872884.151770:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872884.157651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872884.157808:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311220480 00000100:00100000:0.0:1788872884.157818:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311220480 00000100:00100000:0.0:1788872884.157878:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1398 00000100:00100000:0.0:1788872884.157889:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+6:72122:x1875765311220480:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872884.157911:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872884.157936:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db551 lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1a5 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.158073:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db558 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.158088:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db558 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.158101:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db558 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.158116:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db55f lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.158123:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db55f lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.158129:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db55f lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872884.158305:0:66193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66193:1875765327817216:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788872884.158361:0:66193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872884.158415:0:66193:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f544a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788872884.158437:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327817216 00000100:00100000:0.0:1788872884.158441:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327817216 00000100:00100000:0.0:1788872884.158484:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:0.0:1788872884.158491:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66193:x1875765327817216:12345-0@lo:1000:mdt00_002.0 00010000:00000080:0.0:1788872884.158537:0:30614:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9df455500 x1875765327817216/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:55/0 lens 328/4320 e 0 to 0 dl 1788872895 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_002.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872884.158606:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66193:x1875765327817216:12345-0@lo:1000:mdt00_002.0 Request processed in 115us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872884.158614:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00000100:00100000:0.0:1788872884.158657:0:66193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66193:1875765327817216:0@lo:1000:mdt00_002.0 00000004:00080000:0.0:1788872884.158906:0:66193:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x471:0x0], count =401 00000004:00080000:0.0:1788872884.158914:0:66193:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x471:0x0]+401 in llog 00000004:00080000:0.0:1788872884.158925:0:66193:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x602:0x0], index 1: 0 00010000:00010000:0.0:1788872884.159071:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52afe00/0xe4e6e89fb01db566 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159082:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52afe00/0xe4e6e89fb01db566 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159091:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52afe00/0xe4e6e89fb01db566 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159124:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db558 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159131:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db558 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159138:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db558 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159145:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db558 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159159:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52aee00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872884.159164:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db558 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159172:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db558 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159184:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9c1358900) 00010000:00010000:0.0:1788872884.159197:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872884.159202:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db558 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159209:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52aee00/0xe4e6e89fb01db558 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872884.159223:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000098ecd066 reply state 00000000aa2ca008 transno 77309411467 ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db55f lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159234:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db55f lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159240:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff98a9e1e20000) 00010000:00010000:0.0:1788872884.159242:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872884.159245:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788872884.159283:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01db551 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1a5 expref: 9 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159296:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52afe00/0xe4e6e89fb01db566 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1a5 expref: 8 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.159315:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff98a9e1e20500) 00010000:00010000:0.0:1788872884.159317:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872884.159319:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52afe00, rc 0) 00000100:00100000:0.0:1788872884.159367:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72122:x1875765311220480:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1479us (1726us total) trans 77309411467 rc 0/0 00000100:00100000:0.0:1788872884.159373:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1398 00000100:00100000:0.0:1788872884.179752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872884.179847:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311220736 00000100:00100000:1.0:1788872884.179858:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311220736 00000100:00100000:1.0:1788872884.179926:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1399 00000100:00100000:1.0:1788872884.179936:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72122:x1875765311220736:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:1.0:1788872884.179997:0:66192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872884.180028:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52afe00/0xe4e6e89fb01db566 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1a5 expref: 9 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.180045:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff98a9e1e20500) 00010000:00010000:1.0:1788872884.180056:0:66192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872884.180123:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db574 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.180155:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db574 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.180165:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db574 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872884.180304:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b70c61dc reply state 000000005da913e4 transno 77309411468 ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db574 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.180317:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db574 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.180323:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff98a9c1358600) 00010000:00010000:1.0:1788872884.180326:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872884.180329:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872884.180428:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72122:x1875765311220736:12345-192.168.204.39@tcp:36:touch.0 Request processed in 492us (686us total) trans 77309411468 rc 0/0 00000100:00100000:1.0:1788872884.180436:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1399 00000100:00100000:0.0:1788872884.183514:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872884.183656:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311220864 00000100:00100000:1.0:1788872884.183666:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311220864 00000100:00100000:1.0:1788872884.183719:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1400 00000100:00100000:1.0:1788872884.183730:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72122:x1875765311220864:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:1.0:1788872884.183755:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872884.183781:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db57b lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1ac expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.183842:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db57b lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1ac expref: 11 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.183872:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9cc00/0xe4e6e89fb01db57b lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1ac expref: 11 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.183892:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff98a9c1358600) 00010000:00010000:1.0:1788872884.183895:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788872884.183898:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9cc00, rc 0) 00000100:00100000:1.0:1788872884.183968:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+11:72122:x1875765311220864:12345-192.168.204.39@tcp:101:touch.0 Request processed in 240us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872884.183975:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1400 00000100:00100000:3.0:1788872884.193911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872884.193991:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311220992 00000100:00100000:1.0:1788872884.194002:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311220992 00000100:00100000:1.0:1788872884.194083:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5995 00000100:00100000:1.0:1788872884.194093:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311220992:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:1.0:1788872884.194348:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2407:x1875765311220992:12345-192.168.204.39@tcp:2:touch.0 Request processed in 255us (446us total) trans 4294969456 rc 0/0 00000100:00100000:1.0:1788872884.194356:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5995 00000100:00080000:0.0:1788872884.194624:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872884.197270:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872884.197674:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311221248 00000100:00100000:0.0:1788872884.197685:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311221248 00000100:00100000:0.0:1788872884.197734:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 242 00000100:00100000:0.0:1788872884.197744:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:72122:x1875765311221248:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:0.0:1788872884.198019:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+12:72122:x1875765311221248:12345-192.168.204.39@tcp:35:touch.0 Request processed in 276us (758us total) trans 77309411469 rc 0/0 00000100:00100000:0.0:1788872884.198027:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 242 00000100:00100000:2.0:1788872884.221438:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872884.222842:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311221376 00000100:00100000:3.0:1788872884.222856:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311221376 00000100:00100000:3.0:1788872884.222929:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1401 00000100:00100000:3.0:1788872884.222943:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+10:72123:x1875765311221376:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:3.0:1788872884.222975:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872884.222998:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db582 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1b3 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223074:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db589 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223092:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db589 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223105:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db589 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223125:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db590 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223132:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db590 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223140:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db590 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223216:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db597 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223224:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db597 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223231:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db597 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872884.223254:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db597 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223278:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db589 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223284:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db589 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223290:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db589 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223296:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db589 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223302:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872884.223307:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db589 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223315:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db589 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223329:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9f9e3f400) 00010000:00010000:3.0:1788872884.223332:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872884.223337:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db589 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223343:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db589 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223354:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db590 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223360:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db590 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223374:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db590 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223380:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872884.223383:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db590 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223389:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db590 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223398:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff98a9c329d800) 00010000:00010000:3.0:1788872884.223401:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872884.223404:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db590 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223410:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db590 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223442:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db582 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1b3 expref: 12 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223455:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db597 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1b3 expref: 11 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.223463:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9f9e3f200) 00010000:00010000:3.0:1788872884.223465:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788872884.223467:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5800, rc 0) 00010000:00000080:3.0:1788872884.223474:0:66193:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6524380 x1875765311221376/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:55/0 lens 576/584 e 0 to 0 dl 1788872895 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872884.223579:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+11:72123:x1875765311221376:12345-192.168.204.39@tcp:101:touch.0 Request processed in 640us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872884.223587:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1401 00000100:00100000:2.0:1788872884.230797:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872884.230847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872884.230920:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311221632 00000100:00100000:0.0:1788872884.230931:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311221632 00000100:00100000:0.0:1788872884.230997:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 736 00000100:00100000:0.0:1788872884.231008:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2407:x1875765311221632:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788872884.231026:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872884.231055:0:26197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01db597 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1b3 expref: 11 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872884.231074:0:26197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9f9e3f200) 00010000:00010000:0.0:1788872884.231087:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872884.231143:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2407:x1875765311221632:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 137us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872884.231152:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 736 00000100:00100000:1.0:1788872884.231374:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311221504 00000100:00100000:1.0:1788872884.231379:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311221504 00000100:00100000:1.0:1788872884.231426:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1402 00000100:00100000:1.0:1788872884.231434:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+12:72123:x1875765311221504:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:1.0:1788872884.231454:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872884.231474:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01db59e lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1ba expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.231532:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01db5a5 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.231583:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01db5a5 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.231595:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01db5a5 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872884.231640:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788872884.231644:0:66192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1788872884.231680:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c600/0xe4e6e89fb01db59e lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1ba expref: 14 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.231695:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9de00/0xe4e6e89fb01db5a5 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1ba expref: 13 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.231704:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9c1358100) 00010000:00010000:1.0:1788872884.231706:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1788872884.231709:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9de00, rc 0) 00000100:00100000:1.0:1788872884.231745:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+13:72123:x1875765311221504:12345-192.168.204.39@tcp:101:touch.0 Request processed in 312us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872884.231752:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1402 00000100:00100000:1.0:1788872884.242601:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872884.242680:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311221888 00000100:00100000:3.0:1788872884.242690:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311221888 00000100:00100000:3.0:1788872884.242750:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1403 00000100:00100000:3.0:1788872884.242760:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+13:72123:x1875765311221888:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:3.0:1788872884.242782:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872884.242803:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db5ac lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1c1 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.242914:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db5b3 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.242930:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db5b3 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.242942:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db5b3 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.242957:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db5ba lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.242965:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db5ba lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.242972:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db5ba lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788872884.243477:0:68674:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x603:0x0], index 1: 0 00010000:00010000:3.0:1788872884.243668:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db5c1 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243679:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db5c1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243687:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db5c1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243720:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db5b3 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243728:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db5b3 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243735:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db5b3 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243741:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db5b3 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243746:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872884.243750:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db5b3 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243757:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db5b3 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243768:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9c1358100) 00010000:00010000:3.0:1788872884.243771:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872884.243784:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db5b3 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243791:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5c00/0xe4e6e89fb01db5b3 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872884.243806:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be46064d reply state 00000000f97e3aeb transno 77309411470 ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db5ba lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243816:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db5ba lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243822:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff98a9c329d800) 00010000:00010000:3.0:1788872884.243824:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872884.243827:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788872884.243859:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4800/0xe4e6e89fb01db5ac lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1c1 expref: 16 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243874:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db5c1 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1c1 expref: 15 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872884.243882:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff98a9c329d600) 00010000:00010000:3.0:1788872884.243885:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788872884.243887:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4200, rc 0) 00000100:00100000:3.0:1788872884.243957:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+16:72123:x1875765311221888:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1197us (1362us total) trans 77309411470 rc 0/0 00000100:00100000:3.0:1788872884.243966:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1403 00000100:00100000:1.0:1788872884.253602:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872884.253640:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311222144 00000100:00100000:1.0:1788872884.253649:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311222144 00000100:00100000:1.0:1788872884.253702:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1404 00000100:00100000:1.0:1788872884.253713:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+16:72123:x1875765311222144:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:1.0:1788872884.253770:0:66193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872884.253808:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac4200/0xe4e6e89fb01db5c1 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1c1 expref: 16 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.253826:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff98a9c329d600) 00010000:00010000:1.0:1788872884.253837:0:66193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872884.253892:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01db5cf lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.253906:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01db5cf lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.253917:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01db5cf lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872884.254030:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000828ea772 reply state 000000000a74dfc1 transno 77309411471 ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01db5cf lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.254042:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01db5cf lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.254048:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff98a9c1358b00) 00010000:00010000:1.0:1788872884.254051:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872884.254054:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872884.254136:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+17:72123:x1875765311222144:12345-192.168.204.39@tcp:36:touch.0 Request processed in 425us (543us total) trans 77309411471 rc 0/0 00000100:00100000:1.0:1788872884.254145:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1404 00000100:00100000:1.0:1788872884.257693:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872884.257730:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311222272 00000100:00100000:1.0:1788872884.257740:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311222272 00000100:00100000:1.0:1788872884.257795:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1405 00000100:00100000:1.0:1788872884.257806:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+17:72123:x1875765311222272:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:1.0:1788872884.257837:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872884.257858:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db5d6 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1c8 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.257923:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db5d6 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1c8 expref: 18 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.257937:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c800/0xe4e6e89fb01db5d6 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1c8 expref: 18 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872884.257956:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff98a9c1358b00) 00010000:00010000:1.0:1788872884.257959:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788872884.257964:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c800, rc 0) 00000100:00100000:1.0:1788872884.258022:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+18:72123:x1875765311222272:12345-192.168.204.39@tcp:101:touch.0 Request processed in 218us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872884.258030:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1405 00000100:00100000:1.0:1788872884.267728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872884.274499:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311222400 00000100:00100000:0.0:1788872884.274518:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311222400 00000100:00100000:0.0:1788872884.274635:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5996 00000100:00100000:0.0:1788872884.274647:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2404:x1875765311222400:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:0.0:1788872884.274937:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311222400:12345-192.168.204.39@tcp:2:touch.0 Request processed in 291us (7217us total) trans 4294969457 rc 0/0 00000100:00100000:0.0:1788872884.274947:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5996 00000100:00100000:0.0:1788872884.277668:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872884.277810:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311222656 00000100:00100000:3.0:1788872884.277821:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311222656 00000100:00100000:3.0:1788872884.277866:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 243 00000100:00100000:3.0:1788872884.277875:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+18:72123:x1875765311222656:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872884.278266:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+19:72123:x1875765311222656:12345-192.168.204.39@tcp:35:touch.0 Request processed in 391us (604us total) trans 77309411472 rc 0/0 00000100:00100000:3.0:1788872884.278769:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 243 00010000:00010000:0.0:1788872884.537970:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872884.920728:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872884.920768:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327817344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872884.920844:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872884.920895:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327817344 00000100:00100000:1.0:1788872884.920908:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327817344 00000100:00100000:1.0:1788872884.920975:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:1.0:1788872884.920985:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c56fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327817344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788872884.921026:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00010000:00000080:1.0:1788872884.921041:0:23717:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c56fc700 x1875765327817344/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:55/0 lens 224/368 e 0 to 0 dl 1788872895 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872884.921101:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c56fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327817344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872884.921108:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00100000:1.0:1788872884.921154:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327817344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872884.921638:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327817472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872884.921675:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872884.921699:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872884.921704:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327817600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872884.921722:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872884.921753:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327817472 00000100:00100000:3.0:1788872884.921758:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327817472 00000100:00100000:3.0:1788872884.921795:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00100000:3.0:1788872884.921802:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327817472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872884.921820:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872884.921852:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327817472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872884.921858:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000100:00100000:3.0:1788872884.921870:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327817600 00000100:00100000:3.0:1788872884.921872:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327817600 00000100:00100000:3.0:1788872884.921890:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178 00000100:00100000:3.0:1788872884.921895:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327817600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872884.921909:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872884.921936:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327817600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872884.921941:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178 00000100:00080000:3.0:1788872884.921972:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872884.921977:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872884.922013:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327817600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872884.922024:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327817472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872884.922625:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327818112:0@lo:400:kworker.0 00000100:00100000:0.0:1788872884.922665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872884.922700:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327818624:0@lo:400:kworker.0 00000100:00100000:0.0:1788872884.922721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872884.922744:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788872884.922748:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327817984:0@lo:400:kworker.0 00000100:00100000:0.0:1788872884.922769:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872884.922786:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327818496:0@lo:400:kworker.0 00000100:00100000:0.0:1788872884.922804:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872884.922822:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327819008:0@lo:400:kworker.0 00000100:00100000:0.0:1788872884.922840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872884.922869:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327818624 00000100:00100000:0.0:1788872884.922885:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327818624 00000100:00100000:0.0:1788872884.922928:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00100000:0.0:1788872884.922934:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327818624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872884.922986:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327818624:12345-0@lo:400:kworker.0 Request processed in 52us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872884.922992:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00000100:00100000:0.0:1788872884.923012:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327818112 00000100:00100000:0.0:1788872884.923016:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327818112 00000100:00100000:0.0:1788872884.923052:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327817984 00000100:00100000:0.0:1788872884.923055:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327817984 00000100:00100000:0.0:1788872884.923075:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327818496 00000100:00100000:0.0:1788872884.923078:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327818496 00000100:00100000:0.0:1788872884.923089:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327819008 00000100:00100000:0.0:1788872884.923091:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327819008 00000100:00100000:0.0:1788872884.923102:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1788872884.923107:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327818112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872884.923140:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327818112:12345-0@lo:400:kworker.0 Request processed in 33us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872884.923146:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1788872884.923159:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1788872884.923185:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327817984:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788872884.923199:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9ef1b8a80 x1875765327817984/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:55/0 lens 224/224 e 0 to 0 dl 1788872895 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872884.923229:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327817984:12345-0@lo:400:kworker.0 Request processed in 65us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872884.923235:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1788872884.923247:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1788872884.923253:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327818496:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788872884.923274:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9ef1ba680 x1875765327818496/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:55/0 lens 224/224 e 0 to 0 dl 1788872895 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872884.923304:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327818496:12345-0@lo:400:kworker.0 Request processed in 51us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872884.923309:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1788872884.923321:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1788872884.923326:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327819008:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788872884.923335:0:83669:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9ef1bad80 x1875765327819008/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:55/0 lens 224/224 e 0 to 0 dl 1788872895 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872884.923363:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327819008:12345-0@lo:400:kworker.0 Request processed in 37us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872884.923367:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1788872884.925023:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327817728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872884.925085:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872884.925115:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327818240:0@lo:400:kworker.0 00000100:00100000:1.0:1788872884.925138:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872884.925148:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327818752:0@lo:400:kworker.0 00000100:00100000:1.0:1788872884.925169:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872884.925205:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788872884.925212:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327817856:0@lo:400:kworker.0 00000100:00100000:1.0:1788872884.925242:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872884.925268:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327818368:0@lo:400:kworker.0 00000100:00100000:1.0:1788872884.925289:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872884.925300:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327818880:0@lo:400:kworker.0 00000100:00100000:1.0:1788872884.925320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872884.925799:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327818752 00000100:00100000:2.0:1788872884.925818:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327818752 00000100:00100000:2.0:1788872884.925866:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327818880 00000100:00100000:2.0:1788872884.925869:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327818880 00000100:00100000:2.0:1788872884.925888:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:2.0:1788872884.925895:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327818752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872884.925950:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327818752:12345-0@lo:400:kworker.0 Request processed in 56us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872884.925957:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:2.0:1788872884.925972:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:2.0:1788872884.925977:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327818880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872884.926001:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327818880:12345-0@lo:400:kworker.0 Request processed in 24us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872884.926007:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00100000:2.0:1788872884.926024:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327817728 00000100:00100000:2.0:1788872884.926027:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327817728 00000100:00100000:2.0:1788872884.926050:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00100000:2.0:1788872884.926054:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327817728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872884.926081:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1788872884.926108:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327817728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872884.926113:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00100000:2.0:1788872884.926150:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327818880:0@lo:400:kworker.0 00000100:00100000:2.0:1788872884.926180:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327817728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872884.926192:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327818752:0@lo:400:kworker.0 00000100:00100000:3.0:1788872884.926303:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327818240 00000100:00100000:3.0:1788872884.926307:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327818240 00000100:00100000:3.0:1788872884.926329:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327818368 00000100:00100000:3.0:1788872884.926331:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327818368 00000100:00100000:3.0:1788872884.926345:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1788872884.926350:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327818240:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872884.926363:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5ae0700 x1875765327818240/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:55/0 lens 224/224 e 0 to 0 dl 1788872895 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872884.926617:0:92460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327817856 00000100:00100000:2.0:1788872884.926622:0:92460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327817856 00000100:00100000:2.0:1788872884.926671:0:92460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788872884.926679:0:92460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327817856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872884.926715:0:92460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327817856:12345-0@lo:400:kworker.0 Request processed in 38us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872884.926722:0:92460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788872884.926768:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327817856:0@lo:400:kworker.0 00000100:00100000:3.0:1788872884.926911:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327818240:12345-0@lo:400:kworker.0 Request processed in 560us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872884.926918:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1788872884.926932:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1788872884.926939:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327818368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872884.927081:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327818368:12345-0@lo:400:kworker.0 Request processed in 142us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872884.927088:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00080000:0.0:1788872884.927277:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872884.927283:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872884.927286:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872884.927288:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872884.927321:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327817984:0@lo:400:kworker.0 00000100:00100000:0.0:1788872884.927333:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327818496:0@lo:400:kworker.0 00000100:00100000:0.0:1788872884.927345:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327819008:0@lo:400:kworker.0 00000100:00100000:0.0:1788872884.927358:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327818112:0@lo:400:kworker.0 00000100:00100000:0.0:1788872884.927370:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327818624:0@lo:400:kworker.0 00000100:00100000:2.0:1788872884.927501:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327818368:0@lo:400:kworker.0 00000100:00100000:2.0:1788872884.927512:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327818240:0@lo:400:kworker.0 00000100:00100000:2.0:1788872885.435470:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327819136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872885.435543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872885.435617:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327819136 00000100:00100000:2.0:1788872885.435626:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327819136 00000100:00100000:2.0:1788872885.435672:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179 00000100:00100000:2.0:1788872885.435681:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327819136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872885.435705:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872885.435762:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327819136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872885.435770:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179 00000100:00100000:2.0:1788872885.435818:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327819136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872885.440685:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872885.440717:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327819264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872885.440804:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872885.440876:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327819264 00000100:00100000:0.0:1788872885.440886:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327819264 00000100:00100000:0.0:1788872885.440940:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00100000:0.0:1788872885.440951:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327819264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872885.440977:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872885.441023:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327819264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872885.441030:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00100000:0.0:1788872885.441076:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327819264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788872885.561751:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788872886.170765:0:93748:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788872886.170820:0:93748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.170836:0:93748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.170845:0:93748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.170852:0:93748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.170904:0:93748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788872886.170910:0:93748:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788872886.170936:0:93748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788872886.170940:0:93748:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788872886.170946:0:93748:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788872886.170984:0:93748:0:(import.c:65:import_set_state_nolock()) ffff98a8c6774000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788872886.171057:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef1bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327819392:0@lo:39:umount.0 00000100:00100000:1.0:1788872886.171142:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872886.171505:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327819392 00000100:00100000:2.0:1788872886.171514:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327819392 00000100:00100000:2.0:1788872886.171594:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:2.0:1788872886.171604:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875765327819392:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788872886.171636:0:68674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01daf4d 00000100:00080000:2.0:1788872886.171651:0:68674:0:(import.c:65:import_set_state_nolock()) ffff98a9faa5e800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788872886.172350:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872886.172362:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.172372:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872886.172377:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.172388:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872886.172405:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872886.172410:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788872886.172413:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788872886.172415:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788872886.172451:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.172459:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872886.172489:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.172496:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52af200/0xe4e6e89fb01db2e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db2f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.172509:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872886.172511:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872886.172513:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872886.172582:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327819520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872886.172630:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872886.172904:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327819520 00000100:00100000:3.0:1788872886.172911:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327819520 00000100:00100000:3.0:1788872886.172958:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:3.0:1788872886.172966:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327819520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872886.172979:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872886.172995:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac5600/0xe4e6e89fb01db2f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db2e9 expref: 24 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.173007:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872886.173049:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3645:x1875765327819520:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872886.173065:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:1.0:1788872886.173137:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327819520:0@lo:103:ldlm_bl.0 00010000:00000080:2.0:1788872886.173618:0:68674:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9efa59180 x1875765327819392/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:57/0 lens 224/224 e 0 to 0 dl 1788872897 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872886.173672:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1875765327819392:12345-0@lo:39:umount.0 Request processed in 2069us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872886.173680:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000020:00000080:2.0:1788872886.173689:0:68674:0:(genops.c:906:class_export_put()) final put ffff98a9faa5d000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1788872886.173731:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c6774000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1788872886.173740:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9faa5d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1788872886.173743:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef1bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327819392:0@lo:39:umount.0 00000100:00080000:0.0:1788872886.173822:0:93748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788872886.173827:0:93748:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788872886.173831:0:93748:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788872886.173921:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9faa5e800 for lustre-MDT0000 00010000:00010000:3.0:1788872886.173990:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872886.175096:0:93748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175109:0:93748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175115:0:93748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175121:0:93748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175141:0:93748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872886.175156:0:93748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175163:0:93748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175169:0:93748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175174:0:93748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175192:0:93748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788872886.175198:0:93748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175204:0:93748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175209:0:93748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175214:0:93748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175272:0:93748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788872886.175278:0:93748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175284:0:93748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175289:0:93748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.175294:0:93748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872886.175384:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788872886.175391:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872886.175398:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872886.175402:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872886.175410:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872886.175418:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872886.175423:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788872886.175426:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788872886.175457:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.175463:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872886.175463:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872886.175468:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.175475:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872886.175477:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872886.175480:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.175485:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872886.175487:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9efac4000/0xe4e6e89fb01db2f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db2fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872886.175492:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872886.175497:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788872886.175498:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:3.0:1788872886.175499:0:14981:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788872886.175501:0:14981:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788872886.175501:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872886.175506:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872886.175514:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.175516:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.175521:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872886.175522:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.175527:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872886.175528:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.175534:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3800/0xe4e6e89fb01dae4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dae51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872886.175534:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788872886.175536:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788872886.175538:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788872886.175543:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872886.175576:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872886.175582:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872886.175594:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872886.175600:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c9000/0xe4e6e89fb01dae19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dae20 expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872886.175609:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872886.175610:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872886.175612:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872886.175625:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327819904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872886.175665:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.175671:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9dc00 already unused, calling callback (ffffffffc13c0c20) 00000100:00100000:1.0:1788872886.175672:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1788872886.175674:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.175680:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872886.175686:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872886.175690:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788872886.175693:0:14981:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1788872886.175704:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.175709:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872886.175719:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872886.175720:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327819904 00010000:00010000:3.0:1788872886.175725:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872886.175725:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327819904 00010000:00010000:3.0:1788872886.175727:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872886.175729:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872886.175771:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1788872886.175779:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3851880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3644:x1875765327819904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872886.175800:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872886.175813:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c9800/0xe4e6e89fb01dae20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01dae19 expref: 23 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872886.175823:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872886.175850:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3851880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3644:x1875765327819904:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872886.175857:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1788872886.175890:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327819904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872886.175903:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872886.175909:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327820032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872886.175931:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788872886.176063:0:93748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788872886.176069:0:93748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9dc00/0xe4e6e89fb01dad47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dad4e expref: -99 pid: 92454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872886.176091:0:93748:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1788872886.176094:0:93748:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788872886.176095:0:93748:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788872886.176125:0:93748:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788872886.176129:0:93748:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1788872886.176133:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788872886.176139:0:93748:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1788872886.176387:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872886.176864:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327820032 00000100:00100000:3.0:1788872886.176870:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327820032 00000100:00100000:3.0:1788872886.176913:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1788872886.176923:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3644:x1875765327820032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872886.176934:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872886.176947:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3a00/0xe4e6e89fb01dad4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01dad47 expref: 22 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.176967:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872886.177015:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3644:x1875765327820032:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872886.177022:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:1.0:1788872886.177042:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327820032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872886.177129:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872886.177143:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327819648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872886.177186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872886.177222:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872886.177228:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327819776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872886.177249:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872886.177288:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327819648 00000100:00100000:1.0:1788872886.177290:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327819776 00000100:00100000:2.0:1788872886.177292:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327819648 00000100:00100000:1.0:1788872886.177293:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327819776 00000100:00100000:2.0:1788872886.177322:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1788872886.177328:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3646:x1875765327819648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872886.177336:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872886.177345:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa898800/0xe4e6e89fb01db2fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db2f7 expref: 22 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872886.177354:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872886.177381:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3646:x1875765327819648:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872886.177396:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1788872886.177400:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1788872886.177406:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3646:x1875765327819776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872886.177414:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872886.177423:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c8000/0xe4e6e89fb01dae51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01dae4a expref: 20 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872886.177424:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327819648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872886.177432:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872886.177468:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:3646:x1875765327819776:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872886.177474:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:2.0:1788872886.178111:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327819776:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1788872886.179119:0:93748:0:(mdt_handler.c:8248:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:1.0:1788872886.179507:0:93748:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1788872886.179516:0:93748:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9e021b000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872886.179523:0:93748:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9c4c39000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872886.179528:0:93748:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a9ef0ae800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872886.179536:0:93748:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a8c67ef000 0804304d-5904-48ad-87f2-bcbc7642a62a 192.168.204.39@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 120259084300 stale:0 00000020:00080000:1.0:1788872886.179540:0:93748:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98a8c67ef800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 120259084298 stale:0 00000020:00080000:1.0:1788872886.179546:0:93748:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff98a8c72e99c0) has exports, disconnecting them 00000020:00080000:1.0:1788872886.180021:0:93748:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9e021b000), last request at 1788872854 00000020:00000080:1.0:1788872886.180028:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01daf3f 00000100:00080000:1.0:1788872886.180037:0:93748:0:(import.c:65:import_set_state_nolock()) ffff98a9e0219000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788872886.180092:0:93748:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9e021b000): rc 0 00000020:00000080:1.0:1788872886.180096:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9e021b000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788872886.180113:0:93748:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9c4c39000), last request at 1788872884 00000020:00000080:1.0:1788872886.180116:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01daf38 00000100:00080000:1.0:1788872886.180120:0:93748:0:(import.c:65:import_set_state_nolock()) ffff98a9c4c3f000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788872886.180156:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e021b000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788872886.180208:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e0219000 for lustre-MDT0000 00010000:00010000:3.0:1788872886.180263:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788872886.180329:0:93748:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9c4c39000): rc 0 00000020:00000080:1.0:1788872886.180332:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9c4c39000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788872886.180374:0:93748:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a9ef0ae800), last request at 1788872884 00000020:00000080:1.0:1788872886.180378:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01daf31 00000100:00080000:1.0:1788872886.180383:0:93748:0:(import.c:65:import_set_state_nolock()) ffff98a9faa59800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788872886.180465:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c4c39000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788872886.180504:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c4c3f000 for lustre-MDT0000 00010000:00010000:3.0:1788872886.180792:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788872886.180943:0:93748:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9ef0ae800): rc 0 00000020:00000080:1.0:1788872886.180946:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9ef0ae800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788872886.180961:0:93748:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.39@tcp (ffff98a8c67ef000), last request at 1788872884 00000020:00000080:1.0:1788872886.180972:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dad9b 00000020:00010000:1.0:1788872886.180984:0:93748:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a8c67ef000: total 1 00000100:00080000:1.0:1788872886.180988:0:93748:0:(import.c:65:import_set_state_nolock()) ffff98a9c4c3b000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788872886.181033:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef0ae800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788872886.181078:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9faa59800 for lustre-MDT0000 00000020:00010000:3.0:1788872886.181137:0:6508:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a8c67ef000: total 0 00010000:00010000:3.0:1788872886.181140:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872886.181205:0:6508:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a8c67ef000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1788872886.181244:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01db439 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb151 expref: 8 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.181274:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899200/0xe4e6e89fb01db520 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb190 expref: 7 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.181289:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899000/0xe4e6e89fb01db494 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb16d expref: 6 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.181428:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01db455 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb158 expref: 5 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872886.181448:0:6508:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a8c67ef000, canceled 4 locks, left on hash table 0. 00000020:00080000:1.0:1788872886.182465:0:93748:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a8c67ef000): rc 0 00000020:00080000:1.0:1788872886.182472:0:93748:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98a8c67ef800), last request at 1788872848 00000020:00000080:1.0:1788872886.182477:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dad94 00000020:00010000:1.0:1788872886.182485:0:93748:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a8c67ef800: total 0 00000100:00080000:1.0:1788872886.182490:0:93748:0:(import.c:65:import_set_state_nolock()) ffff98a9cb5ea800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788872886.185839:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a8c67ef800: total 0 00010000:00010000:2.0:1788872886.185941:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a8c67ef800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788872886.185984:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c5c5b800/0xe4e6e89fb01daf62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01daf5b expref: 5 pid: 23717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872886.186013:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a8c67ef800, canceled 1 locks, left on hash table 0. 00000020:00080000:1.0:1788872886.192496:0:93748:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a8c67ef800): rc 0 00000004:00000080:1.0:1788872886.192509:0:93748:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb002c7adbae0 00000100:00080000:1.0:1788872886.192533:0:93748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788872886.192538:0:93748:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788872886.193374:0:93748:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788872886.193408:0:93748:0:(import.c:65:import_set_state_nolock()) ffff98a9ee83e800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788872886.193455:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327820160:0@lo:39:umount.0 00000100:00100000:1.0:1788872886.193542:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788872886.193747:0:93748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788872886.193750:0:93748:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 3 00000004:00080000:1.0:1788872886.193762:0:93748:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00080000:1.0:1788872886.193826:0:93748:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788872886.193839:0:93748:0:(import.c:65:import_set_state_nolock()) ffff98a9c5f10800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788872886.193849:0:93748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788872886.193851:0:93748:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969455 gen 3 00000004:00080000:1.0:1788872886.193866:0:93748:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:1.0:1788872886.193935:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327820288:0@lo:9:umount.0 00000100:00100000:1.0:1788872886.193966:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788872886.194001:0:93748:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788872886.194012:0:93748:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0a8800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788872886.194028:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327820416:0@lo:9:umount.0 00000100:00100000:1.0:1788872886.194052:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788872886.194158:0:93748:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98a8c72e99c0) has no exports 00010000:00010000:0.0:1788872886.197415:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872886.197455:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327820160 00000100:00100000:0.0:1788872886.197468:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327820160 00000100:00100000:0.0:1788872886.197641:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00100000:0.0:1788872886.197656:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327820160:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788872886.197692:0:30614:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dadda 00000100:00080000:0.0:1788872886.197701:0:30614:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe91800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788872886.197724:0:30614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411472 00000100:00100000:0.0:1788872886.197931:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3643:x1875765327820160:12345-0@lo:39:umount.0 Request processed in 279us (4401us total) trans 77309411473 rc 0/0 00000100:00100000:0.0:1788872886.197940:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00010000:00010000:0.0:1788872886.198050:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788872886.198093:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ee83e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788872886.198102:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327820160:0@lo:39:umount.0 00000100:00100000:0.0:1788872886.198693:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327820288 00000100:00100000:0.0:1788872886.198699:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327820288 00000100:00100000:0.0:1788872886.198740:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327820416 00000100:00100000:0.0:1788872886.198753:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327820416 00000100:00100000:0.0:1788872886.198778:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5997 00000100:00100000:0.0:1788872886.198785:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327820288:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788872886.198802:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dadf6 00000100:00080000:0.0:1788872886.198808:0:8436:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0ad000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788872886.198841:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969455 00000020:00080000:1.0:1788872886.198877:0:93748:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98a8c72e99c0) has no exports 00000100:00100000:0.0:1788872886.198970:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3643:x1875765327820288:12345-0@lo:9:umount.0 Request processed in 184us (5002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872886.198978:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5997 00000100:00100000:0.0:1788872886.198990:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5998 00000100:00100000:0.0:1788872886.198995:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327820416:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788872886.199006:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dae12 00000100:00080000:0.0:1788872886.199011:0:8436:0:(import.c:65:import_set_state_nolock()) ffff98aa002c7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788872886.199030:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969457 00000100:00100000:0.0:1788872886.199106:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3643:x1875765327820416:12345-0@lo:9:umount.0 Request processed in 110us (5052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872886.199113:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5998 00000100:00080000:0.0:1788872886.199133:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872886.199137:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788872886.199162:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788872886.199182:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ef0a8800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788872886.199188:0:3643:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:0.0:1788872886.199190:0:3643:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:0.0:1788872886.199194:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3853100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327820416:0@lo:9:umount.0 00000100:00080000:0.0:1788872886.199204:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9c5f10800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788872886.199218:0:3643:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:0.0:1788872886.199220:0:3643:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:0.0:1788872886.199222:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327820288:0@lo:9:umount.0 00010000:00010000:0.0:1788872886.199253:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788872886.233490:0:6508:0:(genops.c:906:class_export_put()) final put ffff98a8c67ef000/0804304d-5904-48ad-87f2-bcbc7642a62a 00010000:00010000:3.0:1788872886.233621:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872886.233625:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872886.233627:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788872886.233661:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c67ef000/0804304d-5904-48ad-87f2-bcbc7642a62a for lustre-MDT0000 00000020:00000080:0.0:1788872886.233954:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c4c3b000 for lustre-MDT0000 00000020:00000080:2.0:1788872886.245753:0:6509:0:(genops.c:906:class_export_put()) final put ffff98a8c67ef800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1788872886.245838:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872886.245860:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872886.245863:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788872886.245899:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c67ef800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788872886.245962:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9cb5ea800 for lustre-MDT0000 00000020:00000080:1.0:1788872886.269074:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dadb0 00000020:00000080:1.0:1788872886.269091:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9fbfae800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788872886.269181:0:93748:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788872886.269239:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9fbfae800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788872886.269451:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788872886.269466:0:93748:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788872886.269470:0:93748:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98a9e99999c0) has no exports 00000020:00000080:0.0:1788872886.270200:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dada9 00000020:00000080:0.0:1788872886.270209:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9ee83d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788872886.270269:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872886.270280:0:93748:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788872886.270282:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9ee83d000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788872886.270285:0:93748:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ee83d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788872886.270292:0:93748:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788872886.270596:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ee83d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788872886.270831:0:93748:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a8c5089600 - data ffff98a9c6d1b948/ffff98a9c49a6400 00000020:01000000:0.0:1788872886.270966:0:93748:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9efa75060 - data ffff98a9c6e07a20/ffff98a9eecdd800 00000100:00080000:3.0:1788872886.316617:0:93748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788872886.316626:0:93748:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788872886.316644:0:93748:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98a8c3852a00 x1875765327820160/t77309411473(77309411473) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872896 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872886.316677:0:93748:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788872886.318686:0:93748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788872886.318692:0:93748:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 4 00000004:00080000:3.0:1788872886.318708:0:93748:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872886.318711:0:93748:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788872886.319064:0:92472:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788872886.319069:0:92472:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x70:0x0] index 1 count 1 00000040:00080000:1.0:1788872886.319079:0:92472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 28 count 2 00000100:00080000:3.0:1788872886.319831:0:93748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788872886.319836:0:93748:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969455 gen 4 00000004:00080000:3.0:1788872886.319853:0:93748:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872886.319855:0:93748:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788872886.320083:0:92474:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788872886.320087:0:92474:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x72:0x0] index 1 count 1 00000040:00080000:1.0:1788872886.320095:0:92474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 28 count 2 00000020:00000080:3.0:1788872886.321076:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dad6a 00000020:00000080:3.0:1788872886.321087:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9e99ac000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788872886.321772:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dad7f 00000020:00000080:3.0:1788872886.321779:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9c73c3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788872886.322313:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ac000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788872886.322447:0:93748:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788872886.322455:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872886.322466:0:93748:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788872886.322471:0:93748:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff98a8c72eb380) has no exports 00000004:01000000:3.0:1788872886.322751:0:93748:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788872886.322761:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dadfd 00000020:00000080:3.0:1788872886.322768:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a8c6798800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788872886.322773:0:93748:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788872886.322777:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872886.322785:0:93748:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788872886.322800:0:93748:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff98a8c72ecd40) has no exports 00000020:00000080:3.0:1788872886.322806:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dadef 00000020:00000080:3.0:1788872886.322810:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9c8f4a000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788872886.323123:0:93748:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788872886.323129:0:93748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788872886.323133:0:93748:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969455 gen 5 00000004:00080000:3.0:1788872886.323140:0:93748:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872886.323152:0:93748:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788872886.323190:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872886.323199:0:93748:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788872886.323203:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dade1 00000020:00000080:3.0:1788872886.323208:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a8c679b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788872886.323211:0:93748:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788872886.323214:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872886.323218:0:93748:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788872886.323221:0:93748:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff98a9e999cd40) has no exports 00000020:00000080:3.0:1788872886.323225:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dadd3 00000020:00000080:3.0:1788872886.323227:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9c5f14800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788872886.323368:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c73c3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788872886.323743:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c6798800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788872886.323751:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c8f4a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788872886.323761:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ef0a8800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788872886.323767:0:52416:0:(genops.c:906:class_export_put()) final put ffff98a8c679e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788872886.323769:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c679e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788872886.323773:0:52416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872886.323868:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c679b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788872886.323873:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c5f14800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788872886.324249:0:93748:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788872886.324254:0:93748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788872886.324338:0:93748:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 5 00000004:00080000:3.0:1788872886.324343:0:93748:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788872886.324345:0:93748:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788872886.324420:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872886.324429:0:93748:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788872886.324442:0:93748:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788872886.324448:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dadc5 00000020:00000080:3.0:1788872886.324454:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9ff63c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788872886.324809:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c5f10800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788872886.324826:0:52416:0:(genops.c:906:class_export_put()) final put ffff98a8c679c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788872886.324828:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c679c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788872886.324834:0:52416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788872886.324939:0:93748:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788872886.324944:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872886.324952:0:93748:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788872886.324955:0:93748:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff98a9fa794d40) has no exports 00000020:00000080:3.0:1788872886.324969:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dadbe 00000020:00000080:3.0:1788872886.324974:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9ee838000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788872886.325347:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff63c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788872886.325354:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ee838000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788872886.327635:0:93748:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788872886.327643:0:93748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788872886.327647:0:93748:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788872886.327655:0:93748:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788872886.327713:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872886.327729:0:93748:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872886.327755:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872886.327759:0:93748:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872886.327765:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9e99ab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788872886.327768:0:93748:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99ab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788872886.327776:0:93748:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872886.327887:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dad86 00000020:00000080:2.0:1788872886.327896:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9c73c7800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788872886.327901:0:93748:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788872886.327905:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872886.327911:0:93748:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788872886.327914:0:93748:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff98a8c72e8000) has no exports 00000020:00000080:2.0:1788872886.327933:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872886.327937:0:93748:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788872886.327941:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dad8d 00000020:00000080:2.0:1788872886.327946:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9c73c1800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788872886.327953:0:93748:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9ff63e800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788872886.327957:0:93748:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9ff63e800 3 00000020:01000004:2.0:1788872886.327960:0:93748:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a9ff63e800 from lustre-MDT0000 00000020:00000080:2.0:1788872886.327978:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872886.327994:0:93748:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788872886.327997:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9e99a8800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788872886.327999:0:93748:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a8800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788872886.328008:0:93748:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788872886.328043:0:93748:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788872886.328047:0:93748:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788872886.328051:0:93748:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788872886.328053:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872886.328056:0:93748:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788872886.328065:0:93748:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98a9cb5ed000 c67645b7-2296-4087-92b1-886500c47477 192.168.204.39@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788872886.328071:0:93748:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98a9df96f000 f2e885a0-f180-4b85-9f87-6a01e20afd1a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788872886.328076:0:93748:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff98a9fa793380) has exports, disconnecting them 00000020:00080000:2.0:1788872886.328080:0:93748:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.39@tcp (ffff98a9cb5ed000), last request at 1788872851 00000020:00000080:2.0:1788872886.328105:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01daf0e 00000020:00010000:2.0:1788872886.328110:0:93748:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9cb5ed000: total 2 00000100:00080000:2.0:1788872886.328115:0:93748:0:(import.c:65:import_set_state_nolock()) ffff98a9cb5ed800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788872886.328134:0:93748:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a9cb5ed000): rc 0 00000020:00080000:2.0:1788872886.328137:0:93748:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98a9df96f000), last request at 1788872848 00000020:00000080:2.0:1788872886.328192:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dad2b 00000020:00010000:2.0:1788872886.328196:0:93748:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a9df96f000: total 2 00000100:00080000:2.0:1788872886.328199:0:93748:0:(import.c:65:import_set_state_nolock()) ffff98a9df96c000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788872886.328207:0:93748:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9df96f000): rc 0 00000020:00080000:2.0:1788872886.328211:0:93748:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff98a9fa793380) has no exports 00000100:00100000:2.0:1788872886.328277:0:92460:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98a8c1f49200:92460] 1 exiting: rc = 0 00000100:00100000:2.0:1788872886.328387:0:92459:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98a8c4e13e00:92459] 0 exiting: rc = 1 00000020:00000080:1.0:1788872886.328531:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ee83e800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788872886.328539:0:52416:0:(genops.c:906:class_export_put()) final put ffff98a9c5f12000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872886.328541:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c5f12000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788872886.328546:0:52416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788872886.328635:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c73c7800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788872886.328639:0:52416:0:(genops.c:906:class_export_put()) final put ffff98a9e99a9800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788872886.328641:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e99a9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788872886.328645:0:52416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788872886.328673:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c73c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788872886.328934:0:14981:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9cb5ed000: total 0 00010000:00010000:0.0:1788872886.328975:0:14981:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9cb5ed000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788872886.329006:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa899e00/0xe4e6e89fb01db2db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb120 expref: 5 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329024:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d2e00/0xe4e6e89fb01daf15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0b0 expref: 4 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329035:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c8200/0xe4e6e89fb01daf23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb0be expref: 3 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329045:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db2e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb127 expref: 2 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329064:0:14981:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9cb5ed000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788872886.329086:0:14981:0:(genops.c:906:class_export_put()) final put ffff98a9cb5ed000/c67645b7-2296-4087-92b1-886500c47477 00000020:00010000:0.0:1788872886.329105:0:14981:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a9df96f000: total 1 00010000:00010000:0.0:1788872886.329123:0:14981:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a9df96f000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788872886.329139:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db32f expref: 14 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329162:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c9c00/0xe4e6e89fb01dae6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01dae66 expref: 13 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329176:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9ca00/0xe4e6e89fb01daeeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01daee4 expref: 12 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329186:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db321 expref: 11 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329197:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c8800/0xe4e6e89fb01dae97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01dae90 expref: 10 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329206:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db33d expref: 9 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329215:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d3600/0xe4e6e89fb01daef9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01daef2 expref: 8 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329226:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa898600/0xe4e6e89fb01db352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db34b expref: 7 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329235:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9c56c8a00/0xe4e6e89fb01dae89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01dae82 expref: 6 pid: 92459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788872886.329338:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb5ed000/c67645b7-2296-4087-92b1-886500c47477 for MGS 00000020:00000080:1.0:1788872886.329373:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9cb5ed800 for MGS 00010000:00010000:0.0:1788872886.329425:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52ae000/0xe4e6e89fb01db360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db359 expref: 5 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329444:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa899800/0xe4e6e89fb01db30c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db305 expref: 4 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329455:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9df4d2000/0xe4e6e89fb01daec1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01daeba expref: 3 pid: 92460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329465:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01db31a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db313 expref: 2 pid: 92461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872886.329475:0:14981:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a9df96f000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788872886.329489:0:14981:0:(genops.c:906:class_export_put()) final put ffff98a9df96f000/f2e885a0-f180-4b85-9f87-6a01e20afd1a 00010000:00010000:0.0:1788872886.329504:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872886.329506:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872886.329508:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872886.329515:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872886.329585:0:92461:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98a8c73d7a00:92461] 2 exiting: rc = 0 00000020:00000080:2.0:1788872886.329967:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9df96f000/f2e885a0-f180-4b85-9f87-6a01e20afd1a for MGS 00000020:00000080:2.0:1788872886.329988:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9df96c000 for MGS 00000100:00100000:2.0:1788872886.330023:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330031:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330037:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330052:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330058:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330064:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330070:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330075:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330081:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330087:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330092:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330097:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330103:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330108:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330114:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330119:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330125:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330130:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330136:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330152:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330159:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330165:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330171:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330176:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330183:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330188:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330193:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330199:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330204:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330209:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330215:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330220:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330227:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330233:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330239:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330252:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330270:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330276:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330290:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330295:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330300:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330305:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330311:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330317:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330322:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330327:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330331:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330337:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330342:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330346:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330352:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330357:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330363:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330369:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330375:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330380:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330385:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330391:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330396:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330401:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330406:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330412:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330417:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788872886.330423:0:93748:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788872886.331502:0:93748:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a8c47ceae0 - data ffff98a9e90ad1b0/ffff98a9c6a13400 00000020:01000000:2.0:1788872886.331658:0:93748:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a9faa35ea0 - data ffff98a9e91296c0/ffff98a9e7790400 00000020:00000080:2.0:1788872886.332063:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dad24 00000020:00000080:2.0:1788872886.332072:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9df96b800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788872886.332085:0:93748:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9ff63e800 from MGS, refs=2 00000020:01000004:2.0:1788872886.332088:0:93748:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9ff63e800 2 00000020:01000004:2.0:1788872886.332091:0:93748:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a9ff63e800 from MGS 00000020:00000080:2.0:1788872886.332108:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872886.332126:0:93748:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788872886.332129:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9ff638800/MGS 00000020:00000080:2.0:1788872886.332132:0:93748:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff638800/MGS for MGS 00000020:01000000:2.0:1788872886.332138:0:93748:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788872886.332218:0:93748:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788872886.332223:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872886.332233:0:93748:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788872886.332240:0:93748:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98a8c3bcb000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788872886.332245:0:93748:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff98a9e9b0cd40) has exports, disconnecting them 00000020:00080000:2.0:1788872886.332250:0:93748:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98a8c3bcb000), last request at 1788872848 00000020:00000080:1.0:1788872886.332359:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9df96b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788872886.332389:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dae3c 00000020:00080000:2.0:1788872886.332402:0:93748:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a8c3bcb000): rc 0 00000020:00000080:2.0:1788872886.332406:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a8c3bcb000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788872886.333047:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c3bcb000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788872886.344643:0:93748:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788872886.344651:0:93748:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788872886.344656:0:93748:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788872886.344663:0:93748:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788872886.344840:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872886.344854:0:93748:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788872886.344860:0:93748:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9ff63e800 1 00000020:00000080:3.0:1788872886.344868:0:93748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dad16 00000020:00000080:3.0:1788872886.344877:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9ff63f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788872886.345003:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c6774000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788872886.345010:0:52416:0:(genops.c:906:class_export_put()) final put ffff98a9ef97b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788872886.345012:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef97b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788872886.345023:0:52416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1788872886.345230:0:93748:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788872886.345243:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872886.345248:0:93748:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788872886.345252:0:93748:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff98a9fa7919c0) has no exports 00000020:00000080:1.0:1788872886.347865:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff63f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788872886.391761:0:93748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788872886.391779:0:93748:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788872886.391785:0:93748:0:(genops.c:906:class_export_put()) final put ffff98a9ff639800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788872886.391789:0:93748:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ff639800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788872886.391800:0:93748:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788872886.391925:0:93748:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98a9ff638000 00000020:02000400:0.0:1788872886.391989:0:93748:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788872886.590841:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872887.611076:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788872888.073791:0:3637:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311222784 offset 0 length 224: 4 00000100:00100000:0.0:1788872888.073836:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872888.073864:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872888.073908:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872888.073943:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872888.073973:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311223040 00000100:00100000:0.0:1788872888.073982:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311223040 00000100:00100000:0.0:1788872888.074036:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311222912 00000100:00100000:0.0:1788872888.074039:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311222912 00000100:00100000:0.0:1788872888.074055:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1409 00000100:00100000:0.0:1788872888.074065:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+19:2404:x1875765311223040:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872888.074160:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+19:2404:x1875765311223040:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 96us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872888.074168:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1409 00000100:00100000:0.0:1788872888.074186:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1407 00000100:00100000:0.0:1788872888.074190:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2404:x1875765311222912:12345-192.168.204.39@tcp:400:kworker.0 00000020:00080000:0.0:1788872888.074196:0:66192:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.39@tcp 00000100:00100000:0.0:1788872888.074219:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2404:x1875765311222912:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (323us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788872888.074225:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1407 00000100:00100000:0.0:1788872888.074242:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311223296 00000100:00100000:0.0:1788872888.074246:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311223296 00000100:00100000:0.0:1788872888.074272:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311223168 00000100:00100000:0.0:1788872888.074275:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311223168 00000100:00100000:0.0:1788872888.074295:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2702 00000100:00100000:0.0:1788872888.074302:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311223296:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872888.074342:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311223296:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 41us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872888.074349:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2702 00000100:00100000:0.0:1788872888.074360:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2703 00000100:00100000:0.0:1788872888.074374:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2404:x1875765311223168:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872888.074400:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2404:x1875765311223168:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872888.074405:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2703 00000100:00080000:0.0:1788872888.074422:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872888.074426:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872888.074428:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872888.087436:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872888.090447:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311223424 00000100:00100000:1.0:1788872888.090461:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311223424 00000100:00100000:1.0:1788872888.090585:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1408 00000100:00100000:1.0:1788872888.090594:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311223424:12345-192.168.204.39@tcp:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788872888.090626:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872888.090701:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311223424:12345-192.168.204.39@tcp:38:ptlrpcd_00_00.0 Request processed in 106us (3274us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872888.090709:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1408 00010000:00010000:0.0:1788872888.636262:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872889.656793:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872890.041310:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327820928:0@lo:400:kworker.0 00000100:00100000:2.0:1788872890.041386:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872890.041420:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327821440:0@lo:400:kworker.0 00000100:00100000:2.0:1788872890.041444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872890.041469:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788872890.041475:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327820800:0@lo:400:kworker.0 00000100:00100000:2.0:1788872890.041506:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872890.041540:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327821312:0@lo:400:kworker.0 00000100:00100000:1.0:1788872890.041590:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327820672:0@lo:400:kworker.0 00000100:00100000:2.0:1788872890.041591:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872890.041625:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327820928 00000100:00100000:1.0:1788872890.041632:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872890.041635:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327820928 00000100:00100000:1.0:1788872890.041655:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327821184:0@lo:400:kworker.0 00000100:00100000:2.0:1788872890.041676:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327820800 00000100:00100000:2.0:1788872890.041681:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327820800 00000100:00100000:1.0:1788872890.041684:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872890.041709:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788872890.041718:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327820672 00000100:00100000:1.0:1788872890.041718:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327820544:0@lo:400:kworker.0 00000100:00100000:2.0:1788872890.041724:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327820672 00000400:00000100:1.0:1788872890.041743:0:3647:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327820544 offset 0 length 224: 4 00000100:00100000:2.0:1788872890.041760:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1788872890.041770:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327821056:0@lo:400:kworker.0 00000100:00100000:2.0:1788872890.041773:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327820800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872890.041797:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872890.041812:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327821568:0@lo:400:kworker.0 00000100:00100000:2.0:1788872890.041837:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327820800:12345-0@lo:400:kworker.0 Request processed in 68us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872890.041845:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872890.041849:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:2.0:1788872890.041867:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327821056 00000100:00100000:2.0:1788872890.041871:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327821056 00000100:00100000:2.0:1788872890.041887:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327821568 00000100:00100000:2.0:1788872890.041891:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327821568 00000100:00100000:2.0:1788872890.041903:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1788872890.041910:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327821056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872890.041914:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1788872890.041921:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875765327820928:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788872890.041929:0:66193:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788872890.041942:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327821056:12345-0@lo:400:kworker.0 Request processed in 32us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872890.041950:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1788872890.041969:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1788872890.041970:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875765327820928:12345-0@lo:400:kworker.0 Request processed in 45us (581us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788872890.041977:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765327820672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872890.041983:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000020:00080000:2.0:1788872890.041987:0:66192:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788872890.042010:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1788872890.042017:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765327820672:12345-0@lo:400:kworker.0 Request processed in 39us (384us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788872890.042018:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765327821568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872890.042031:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000020:00080000:1.0:1788872890.042032:0:66193:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788872890.042054:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327821440 00000100:00100000:2.0:1788872890.042059:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327821440 00000100:00100000:1.0:1788872890.042065:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765327821568:12345-0@lo:400:kworker.0 Request processed in 47us (221us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788872890.042081:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1788872890.042100:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327821312 00000100:00100000:2.0:1788872890.042104:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327821312 00000100:00100000:1.0:1788872890.042106:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327821184 00000100:00100000:1.0:1788872890.042111:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327821184 00000100:00100000:2.0:1788872890.042126:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:2.0:1788872890.042134:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327821440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872890.042143:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00100000:1.0:1788872890.042150:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1875765327821184:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788872890.042156:0:8447:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788872890.042167:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327821440:12345-0@lo:400:kworker.0 Request processed in 33us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872890.042186:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:1.0:1788872890.042190:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1875765327821184:12345-0@lo:400:kworker.0 Request processed in 37us (505us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788872890.042199:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00100000:2.0:1788872890.042204:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:2.0:1788872890.042214:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327821312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872890.042230:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327821696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872890.042251:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327821312:12345-0@lo:400:kworker.0 Request processed in 39us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872890.042259:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:1.0:1788872890.042265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872890.042308:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327821056:0@lo:400:kworker.0 00000100:00080000:1.0:1788872890.042321:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788872890.042326:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788872890.042330:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788872890.042336:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872890.042340:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3791 00000100:00080000:1.0:1788872890.042347:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872890.042369:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef3d1500 x1875765327821824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872890.042402:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327821568:0@lo:400:kworker.0 00000100:00080000:1.0:1788872890.042426:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788872890.042430:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788872890.042434:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788872890.042437:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872890.042440:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3791 00000100:00080000:1.0:1788872890.042447:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872890.042448:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327820800:0@lo:400:kworker.0 00000100:00100000:2.0:1788872890.042464:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327821312:0@lo:400:kworker.0 00000100:00100000:1.0:1788872890.042464:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef3d2680 x1875765327821952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872890.042476:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788872890.042480:0:3645:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:1.0:1788872890.042481:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327820672:0@lo:400:kworker.0 00000100:02000400:2.0:1788872890.042487:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788872890.042492:0:3645:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872890.042496:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3791 00000100:00080000:1.0:1788872890.042500:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788872890.042502:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00080000:1.0:1788872890.042506:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788872890.042510:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788872890.042515:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872890.042520:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3791 00000100:00100000:2.0:1788872890.042521:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5af7480 x1875765327822080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872890.042526:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872890.042541:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327820928:0@lo:400:kworker.0 00000100:00100000:1.0:1788872890.042569:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef3d3480 x1875765327822208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872890.042580:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327821440:0@lo:400:kworker.0 00000100:00100000:1.0:1788872890.042583:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327821184:0@lo:400:kworker.0 00000100:00100000:1.0:1788872890.042635:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327821696 00000100:00100000:1.0:1788872890.042639:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327821696 00000100:00100000:2.0:1788872890.042648:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327821824:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788872890.042674:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015 00000100:00100000:2.0:1788872890.042679:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872890.042684:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1875765327821696:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788872890.042691:0:23717:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788872890.042703:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327821952:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788872890.042728:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1875765327821696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (465us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788872890.042736:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00100000:2.0:1788872890.042743:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872890.042761:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327821824 00000100:00100000:1.0:1788872890.042766:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327821824 00000100:00100000:2.0:1788872890.042767:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327822080:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788872890.042785:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327821952 00000100:00100000:2.0:1788872890.042792:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872890.042792:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327821952 00000100:00100000:1.0:1788872890.042806:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327822080 00000100:00100000:1.0:1788872890.042809:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327822080 00000100:00100000:2.0:1788872890.042811:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327822208:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788872890.042823:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1788872890.042829:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327821824:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788872890.042835:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:1.0:1788872890.042851:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872890.042863:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:2.0:1788872890.042870:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327821952:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788872890.042882:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872890.042891:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327821824:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 60us (213us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872890.042900:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:2.0:1788872890.042913:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327821952:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 41us (170us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872890.042919:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1788872890.042925:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327822080:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788872890.043064:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872890.043069:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872890.043081:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872890.043101:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327822208 00000100:00100000:0.0:1788872890.043105:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327822208 00000100:00100000:0.0:1788872890.043129:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016 00000100:00100000:0.0:1788872890.043135:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327822208:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788872890.043146:0:8446:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872890.043168:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327822336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872890.043183:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327822208:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 46us (350us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872890.043190:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00100000:3.0:1788872890.043207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872890.043237:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788872890.043243:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327822464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872890.043269:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872890.043309:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327822336 00000100:00100000:3.0:1788872890.043316:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327822336 00000100:02020000:0.0:1788872890.043337:0:3647:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1788872890.043346:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327822464 00000100:00100000:3.0:1788872890.043350:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327822464 00000100:00100000:3.0:1788872890.043367:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:3.0:1788872890.043374:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327822336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872890.043394:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872890.043430:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327822336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872890.043445:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00100000:3.0:1788872890.043458:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00100000:3.0:1788872890.043464:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327822464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872890.043478:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872890.043505:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327822464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872890.043511:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000100:00100000:3.0:1788872890.044672:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327822464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872890.044691:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327822336:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788872890.044774:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872890.044779:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872890.044782:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327821824:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788872890.044792:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872890.044795:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872890.044798:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327821952:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788872890.044808:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872890.044811:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872890.044814:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327822208:0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788872890.045093:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872890.045152:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327822080:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 2224us (2361us total) trans 0 rc -19/-19 00000100:00080000:3.0:1788872890.045209:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872890.045213:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872890.045217:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327822080:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788872890.048895:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1788872890.050848:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00080000:0.0:1788872890.058511:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788872890.058520:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff98a9df8c9800 already not connected (conn 74, was 73): DISCONN 00000001:00100000:3.0:1788872890.059676:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788872890.059697:0:9516:0:(genops.c:906:class_export_put()) final put ffff98aa002c0800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788872890.059731:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969457 is committed 00000020:00000080:1.0:1788872890.059794:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98aa002c0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788872890.059872:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98aa002c7800 for lustre-OST0001 00000001:00100000:0.0:1788872890.062005:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788872890.062022:0:75620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411473 is committed 00000020:00000080:0.0:1788872890.062029:0:75620:0:(genops.c:906:class_export_put()) final put ffff98a9dfe95800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788872890.062099:0:75620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411472 is committed 00010000:00010000:1.0:1788872890.062201:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db55f lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062219:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db55f lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062226:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db55f lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062233:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872890.062237:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db55f lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062245:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db55f lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062264:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff98a9e1e20000) 00010000:00010000:1.0:1788872890.062267:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872890.062271:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db55f lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062288:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db55f lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062318:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db574 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062325:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db574 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062330:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db574 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062334:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872890.062343:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db574 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062349:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db574 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062357:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff98a9c1358600) 00010000:00010000:1.0:1788872890.062360:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872890.062362:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db574 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062368:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01db574 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062380:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db5ba lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062387:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db5ba lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062392:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db5ba lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062397:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872890.062400:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db5ba lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062406:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db5ba lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062412:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff98a9c329d800) 00010000:00010000:1.0:1788872890.062414:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872890.062423:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db5ba lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062430:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9efac5400/0xe4e6e89fb01db5ba lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062446:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01db5cf lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062453:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01db5cf lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062459:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01db5cf lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062464:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872890.062467:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01db5cf lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062473:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01db5cf lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062482:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff98a9c1358b00) 00010000:00010000:1.0:1788872890.062484:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872890.062486:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01db5cf lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872890.062492:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c4f9d000/0xe4e6e89fb01db5cf lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788872890.062742:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9dfe95800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788872890.062796:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9dfe91800 for lustre-MDT0001 00010000:00010000:3.0:1788872890.680995:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872891.706976:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788872892.095232:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788872892.095242:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a9ef0aa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788872892.095334:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef0aa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788872892.095400:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ef0ad000 for lustre-OST0000 00010000:00010000:0.0:1788872892.729119:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872893.213956:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872893.214032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000400:00000100:0.0:1788872893.214061:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311223552 offset 0 length 224: 4 00000100:00100000:0.0:1788872893.214078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872893.214113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872893.214146:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311223808 00000100:00100000:0.0:1788872893.214156:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311223808 00000100:00100000:0.0:1788872893.214219:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311223680 00000100:00100000:0.0:1788872893.214222:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311223680 00000100:00100000:0.0:1788872893.214252:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1412 00000100:00100000:0.0:1788872893.214263:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2406:x1875765311223808:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872893.214339:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2406:x1875765311223808:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 78us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872893.214347:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1412 00000100:00100000:0.0:1788872893.214366:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1415 00000100:00100000:0.0:1788872893.214371:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311223680:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:0.0:1788872893.214392:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872893.214419:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311223680:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 47us (306us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872893.214425:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1415 00000100:00080000:0.0:1788872893.214441:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872893.214668:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311224064 00000100:00100000:1.0:1788872893.214685:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311224064 00000100:00100000:1.0:1788872893.214738:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311223936 00000100:00100000:1.0:1788872893.214742:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311223936 00000100:00100000:1.0:1788872893.214763:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2706 00000100:00100000:1.0:1788872893.214770:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311224064:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872893.214807:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311224064:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 38us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872893.214814:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2706 00000100:00100000:1.0:1788872893.214825:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2707 00000100:00100000:1.0:1788872893.214831:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311223936:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872893.214852:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311223936:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 21us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872893.214857:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2707 00000100:00080000:0.0:1788872893.216900:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872893.216910:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788872893.752798:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872894.785015:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872895.161118:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872895.161137:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327822592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872895.161218:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872895.161263:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327822720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872895.161290:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872895.161377:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327822592 00000100:00100000:0.0:1788872895.161401:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327822592 00000100:00100000:0.0:1788872895.161470:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327822720 00000100:00100000:0.0:1788872895.161474:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327822720 00000100:00100000:0.0:1788872895.161495:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00100000:0.0:1788872895.161504:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327822592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872895.161533:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872895.161615:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327822592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872895.161623:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00100000:0.0:1788872895.161642:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:0.0:1788872895.161649:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327822720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872895.161666:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872895.161693:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327822720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872895.161698:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00100000:2.0:1788872895.161761:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327822720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872895.161775:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327822592:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788872895.162592:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872895.162597:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872895.162601:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872895.162607:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3827 00000100:00080000:3.0:1788872895.162611:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788872895.162616:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872895.162636:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5acdf80 x1875765327822976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872895.162659:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788872895.162661:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327822848:0@lo:400:kworker.0 00000100:00080000:3.0:1788872895.162662:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872895.162664:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872895.162667:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3827 00000100:00080000:3.0:1788872895.162669:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788872895.162672:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872895.162682:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5acf480 x1875765327823232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1788872895.162693:0:3644:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327822848 offset 0 length 224: 4 00000100:00080000:3.0:1788872895.162703:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872895.162706:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872895.162707:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872895.162711:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3827 00000100:00080000:3.0:1788872895.162713:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1788872895.162724:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1788872895.162726:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872895.162729:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327823104:0@lo:400:kworker.0 00000100:00100000:3.0:1788872895.162738:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f0989880 x1875765327823488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872895.162747:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872895.162750:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872895.162751:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872895.162754:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3827 00000100:00100000:2.0:1788872895.162754:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788872895.162756:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788872895.162760:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872895.162773:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f080bb80 x1875765327823616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872895.162779:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327823360:0@lo:400:kworker.0 00000100:00100000:3.0:1788872895.162795:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327822976:0@lo:38:kworker.0 00000100:00100000:2.0:1788872895.162809:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788872895.162937:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872895.162942:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872895.162956:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327823104 00000100:00100000:1.0:1788872895.162961:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327823104 00000100:00100000:1.0:1788872895.163014:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327823360 00000100:00100000:1.0:1788872895.163017:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327823360 00000100:00100000:1.0:1788872895.163037:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1788872895.163045:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327823104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872895.170806:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1788872895.170837:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327823360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872895.176817:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327823104:12345-0@lo:400:kworker.0 Request processed in 13762us (14051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872895.176849:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00080000:1.0:1788872895.176897:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872895.176948:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327823104:0@lo:400:kworker.0 00000100:00100000:0.0:1788872895.177207:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327823360:12345-0@lo:400:kworker.0 Request processed in 6386us (14395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872895.177215:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:2.0:1788872895.191167:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327823360:0@lo:400:kworker.0 00000100:00100000:3.0:1788872895.191349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872895.191472:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327823232:0@lo:38:kworker.0 00000100:00100000:3.0:1788872895.191528:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872895.191770:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327823488:0@lo:38:kworker.0 00000100:00100000:3.0:1788872895.191800:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872895.191831:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327823616:0@lo:38:kworker.0 00000100:00100000:3.0:1788872895.191855:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872895.191922:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327822976 00000100:00100000:0.0:1788872895.191929:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327822976 00000100:00100000:2.0:1788872895.191956:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327823488 00000100:00100000:2.0:1788872895.191960:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327823488 00000100:00100000:0.0:1788872895.191967:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327823232 00000100:00100000:0.0:1788872895.191980:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327823232 00000100:00100000:0.0:1788872895.192000:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:2.0:1788872895.192001:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00100000:2.0:1788872895.192006:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327823488:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788872895.192007:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327822976:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872895.192027:0:30614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1788872895.192027:0:66190:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872895.192122:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327823616 00000100:00100000:1.0:1788872895.192126:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327823616 00000100:00100000:1.0:1788872895.192149:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1788872895.192154:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327823232:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872895.192164:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872895.197718:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327823488:12345-0@lo:38:kworker.0 Request processed in 5698us (5905us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872895.197735:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00000100:00100000:2.0:1788872895.197827:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:2.0:1788872895.197834:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327823616:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788872895.197857:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872895.198099:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327823616:12345-0@lo:38:kworker.0 Request processed in 99us (6078us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872895.198107:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1788872895.207608:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327822976:12345-0@lo:38:kworker.0 Request processed in 15591us (16250us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872895.207626:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00080000:3.0:1788872895.207842:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872895.207848:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872895.207853:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327823616:0@lo:38:kworker.0 00000100:00080000:3.0:1788872895.207883:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872895.207887:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872895.207907:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327822976:0@lo:38:kworker.0 00000100:00080000:3.0:1788872895.207922:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872895.207925:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872895.207928:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327823488:0@lo:38:kworker.0 00000100:00100000:1.0:1788872895.209788:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327823232:12345-0@lo:38:kworker.0 Request processed in 17625us (18251us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872895.209802:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00080000:3.0:1788872895.209876:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872895.209882:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872895.209885:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327823232:0@lo:38:kworker.0 00010000:00010000:2.0:1788872895.802577:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872896.824885:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872897.852079:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788872898.319994:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311224192 offset 0 length 224: 4 00000100:00100000:0.0:1788872898.320053:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872898.320087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872898.320194:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311224704 00000100:00100000:2.0:1788872898.320204:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311224704 00000100:00100000:2.0:1788872898.320272:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2708 00000100:00100000:2.0:1788872898.320282:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311224704:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872898.320351:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311224704:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 71us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872898.320358:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2708 00000100:00080000:3.0:1788872898.320380:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872898.320669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872898.324542:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872898.324709:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311224576 00000100:00100000:3.0:1788872898.324719:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311224576 00000100:00100000:3.0:1788872898.324801:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5999 00000100:00100000:3.0:1788872898.324812:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2403:x1875765311224576:12345-192.168.204.39@tcp:9:kworker.0 00000020:00000080:3.0:1788872898.324842:0:14545:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01daf85 00000100:00080000:3.0:1788872898.324863:0:14545:0:(import.c:65:import_set_state_nolock()) ffff98a9f0834000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788872898.325342:0:14545:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969455 00000100:00100000:3.0:1788872898.325527:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+2:2403:x1875765311224576:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 716us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872898.325536:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5999 00010000:00010000:3.0:1788872898.325586:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872898.328081:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311224448 00000100:00100000:1.0:1788872898.328097:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311224448 00000100:00100000:1.0:1788872898.328330:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311224320 00000100:00100000:1.0:1788872898.328335:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311224320 00000100:00100000:1.0:1788872898.328374:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1415 00000100:00100000:1.0:1788872898.328387:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2407:x1875765311224448:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872898.328413:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1419 00000100:00100000:3.0:1788872898.328422:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311224320:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:3.0:1788872898.328442:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872898.328485:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311224320:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 63us (7816us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872898.328493:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1419 00000100:00100000:1.0:1788872898.328603:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2407:x1875765311224448:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 218us (8512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872898.328612:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1415 00000100:00080000:0.0:1788872898.329787:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872898.329796:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788872898.877946:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872899.897701:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872900.284642:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872900.284681:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327823744:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788872900.284717:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872900.284723:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872900.284728:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872900.284735:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3832 00000100:00080000:1.0:1788872900.284751:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788872900.284760:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872900.284787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872900.284789:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef3d1500 x1875765327824000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872900.284816:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872900.284819:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872900.284822:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872900.284826:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3832 00000100:00080000:1.0:1788872900.284828:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788872900.284833:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872900.284846:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5acdf80 x1875765327824256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872900.284854:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327823872:0@lo:400:kworker.0 00000100:00080000:1.0:1788872900.284882:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872900.284886:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872900.284888:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872900.284893:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3832 00000400:00000100:2.0:1788872900.284896:0:3644:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327823872 offset 0 length 224: 4 00000100:00080000:1.0:1788872900.284896:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788872900.284901:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872900.284918:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c3a63480 x1875765327824512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872900.284935:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1788872900.284936:0:52416:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872900.284939:0:52416:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1788872900.284942:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327824128:0@lo:400:kworker.0 00000100:00080000:1.0:1788872900.284942:0:52416:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872900.284946:0:52416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3832 00000100:00080000:1.0:1788872900.284956:0:52416:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788872900.284961:0:52416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872900.284974:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872900.284978:0:52416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff54e300 x1875765327824768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872900.285021:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327823744 00000100:00100000:2.0:1788872900.285033:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327823744 00000100:00100000:2.0:1788872900.285112:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:2.0:1788872900.285137:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327823744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872900.285179:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872900.285218:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327824640:0@lo:400:kworker.0 00000100:00100000:2.0:1788872900.285229:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327823744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872900.285236:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:00100000:1.0:1788872900.285258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872900.285270:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327824128 00000100:00100000:1.0:1788872900.285286:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872900.285292:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327824384:0@lo:400:kworker.0 00000100:00100000:1.0:1788872900.285321:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872900.285361:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327824640 00000100:00100000:1.0:1788872900.285365:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327824640 00000100:00100000:1.0:1788872900.285408:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:1.0:1788872900.285419:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327824640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872900.285462:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327824640:12345-0@lo:400:kworker.0 Request processed in 46us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872900.285469:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000100:00100000:1.0:1788872900.285492:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327824384 00000100:00100000:1.0:1788872900.285495:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327824384 00000100:00100000:1.0:1788872900.285629:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1788872900.285639:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327824384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872900.285681:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327824384:12345-0@lo:400:kworker.0 Request processed in 46us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872900.285687:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1788872900.285812:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327824384:0@lo:400:kworker.0 00000100:00100000:1.0:1788872900.285826:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327824640:0@lo:400:kworker.0 00000100:00100000:3.0:1788872900.286536:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327824000:0@lo:38:kworker.0 00000100:00100000:3.0:1788872900.286612:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872900.286640:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327824256:0@lo:38:kworker.0 00000100:00100000:3.0:1788872900.286664:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872900.286682:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327824512:0@lo:38:kworker.0 00000100:00100000:3.0:1788872900.286724:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872900.286746:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327824768:0@lo:38:kworker.0 00000100:00100000:3.0:1788872900.286771:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872900.288898:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327823744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872900.288998:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327824128 00000100:00100000:3.0:1788872900.289991:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327824512 00000100:00100000:3.0:1788872900.290001:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327824512 00000100:00100000:3.0:1788872900.290045:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00100000:3.0:1788872900.290053:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327824512:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872900.290080:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872900.290732:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327824512:12345-0@lo:38:kworker.0 Request processed in 674us (4002us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872900.290742:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00000100:00100000:3.0:1788872900.290790:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327824896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872900.290850:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872900.290901:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327824896 00000100:00100000:3.0:1788872900.290907:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327824896 00000100:00100000:3.0:1788872900.290939:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186 00000100:00100000:3.0:1788872900.290946:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327824896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872900.290980:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872900.291027:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327824896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872900.291047:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186 00000100:00100000:3.0:1788872900.291098:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327824896:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788872900.291244:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872900.291252:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872900.291258:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327824512:0@lo:38:kworker.0 00000100:00080000:3.0:1788872900.291736:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872900.291745:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872900.291748:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872900.292742:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327824000 00000100:00100000:1.0:1788872900.292757:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327824000 00000100:00100000:1.0:1788872900.292815:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327824256 00000100:00100000:1.0:1788872900.292820:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327824256 00000100:00100000:1.0:1788872900.292844:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327824768 00000100:00100000:1.0:1788872900.292847:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327824768 00000100:00100000:1.0:1788872900.292866:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1788872900.292891:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327824128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872900.293012:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327824128:12345-0@lo:400:kworker.0 Request processed in 127us (8036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872900.293021:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1788872900.293358:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1788872900.293365:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327824000:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872900.293390:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872900.293448:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327824000:12345-0@lo:38:kworker.0 Request processed in 82us (6837us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872900.293626:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1788872900.293635:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327824256:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872900.293647:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872900.293684:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327824256:12345-0@lo:38:kworker.0 Request processed in 49us (7018us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872900.293691:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1788872900.293710:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1788872900.293716:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327824768:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872900.293726:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872900.293755:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327824768:12345-0@lo:38:kworker.0 Request processed in 38us (6983us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872900.293761:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1788872900.293847:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327824128:0@lo:400:kworker.0 00000100:00080000:1.0:1788872900.293969:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872900.293977:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872900.293983:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327824000:0@lo:38:kworker.0 00000100:00080000:1.0:1788872900.294000:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872900.294005:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872900.294008:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327824256:0@lo:38:kworker.0 00000100:00080000:1.0:1788872900.294019:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872900.294022:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872900.294025:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327824768:0@lo:38:kworker.0 00000100:00100000:3.0:1788872900.294257:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00010000:00010000:0.0:1788872900.921767:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872901.952672:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872902.969679:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872903.444637:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000400:00000100:0.0:1788872903.444678:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311224832 offset 0 length 224: 4 00000100:00100000:1.0:1788872903.444798:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311225088 00000100:00100000:1.0:1788872903.444821:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311225088 00000100:00100000:1.0:1788872903.444905:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1418 00000100:00100000:1.0:1788872903.444916:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2407:x1875765311225088:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872903.445007:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2407:x1875765311225088:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 93us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872903.445014:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1418 00000100:00080000:2.0:1788872903.445130:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872903.445337:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872903.445377:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872903.445442:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311224960 00000100:00100000:2.0:1788872903.445446:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311224960 00000100:00100000:2.0:1788872903.445483:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1423 00000100:00100000:2.0:1788872903.445488:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311224960:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:2.0:1788872903.445510:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872903.445575:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875765311224960:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 56us (168us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872903.445584:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1423 00000100:00100000:1.0:1788872903.445896:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311225216 00000100:00100000:1.0:1788872903.445900:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311225216 00000100:00100000:1.0:1788872903.446033:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2710 00000100:00100000:1.0:1788872903.446040:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311225216:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872903.446077:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311225216:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 37us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872903.446084:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2710 00000100:00080000:2.0:1788872903.449938:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1788872903.873717:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000020:00000080:2.0:1788872903.873727:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a9f0830000/0804304d-5904-48ad-87f2-bcbc7642a62a 00000020:00000080:1.0:1788872903.873828:0:52416:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f0830000/0804304d-5904-48ad-87f2-bcbc7642a62a for lustre-OST0000 00000020:00000080:1.0:1788872903.873884:0:52416:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9f0834000 for lustre-OST0000 00010000:00010000:1.0:1788872903.995181:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1788872904.481748:0:3639:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-192.168.204.39@tcp portal 26 match 1875765311225344 offset 0 length 520: 4 00000100:00100000:2.0:1788872904.481838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872904.481891:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872904.481942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872904.482004:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311225600 00000100:00100000:2.0:1788872904.482018:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311225600 00000100:00100000:2.0:1788872904.482101:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311225472 00000100:00100000:2.0:1788872904.482104:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311225472 00000100:00100000:2.0:1788872904.482128:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1419 00000100:00100000:2.0:1788872904.482141:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2406:x1875765311225600:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872904.482247:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2406:x1875765311225600:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 107us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872904.482256:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1419 00000100:00100000:2.0:1788872904.482278:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1424 00000100:00100000:2.0:1788872904.482283:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875765311225472:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:2.0:1788872904.482308:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788872904.482337:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875765311225472:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 52us (446us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788872904.482343:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1424 00000100:00100000:2.0:1788872904.482365:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311225728 00000100:00100000:2.0:1788872904.482369:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311225728 00000100:00100000:2.0:1788872904.482399:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6000 00000100:00100000:2.0:1788872904.482406:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2403:x1875765311225728:12345-192.168.204.39@tcp:9:kworker.0 00000020:00000080:2.0:1788872904.482453:0:26185:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01db4be 00000100:00080000:2.0:1788872904.482467:0:26185:0:(import.c:65:import_set_state_nolock()) ffff98a8c4ba6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788872904.482525:0:26185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969457 00000100:00100000:2.0:1788872904.482732:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+2:2403:x1875765311225728:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 325us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872904.482739:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6000 00010000:00010000:2.0:1788872904.482931:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872905.020340:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788872905.400974:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872905.400983:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872905.400988:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872905.401000:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3837 00000100:00080000:1.0:1788872905.401008:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872905.401018:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872905.401048:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff54d880 x1875765327825152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872905.401090:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872905.401093:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872905.401095:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872905.401099:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3837 00000100:00080000:1.0:1788872905.401102:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872905.401107:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872905.401121:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff54df80 x1875765327825408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872905.401141:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872905.401144:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872905.401146:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872905.401150:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3837 00000100:00080000:1.0:1788872905.401153:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872905.401157:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872905.401180:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff54e680 x1875765327825664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872905.401205:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872905.401209:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872905.401211:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872905.401214:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3837 00000100:00080000:1.0:1788872905.401217:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788872905.401221:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872905.401230:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ff54f800 x1875765327826048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872905.401276:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327825024:0@lo:400:kworker.0 00000400:00000100:1.0:1788872905.401364:0:3645:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327825024 offset 0 length 224: 4 00000100:00100000:1.0:1788872905.401419:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327825920:0@lo:400:kworker.0 00000100:00100000:1.0:1788872905.401464:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872905.401517:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872905.401523:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327825792:0@lo:400:kworker.0 00000100:00100000:1.0:1788872905.401571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872905.401616:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327825152:0@lo:38:kworker.0 00000100:00100000:1.0:1788872905.401650:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872905.401672:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327825408:0@lo:38:kworker.0 00000100:00100000:1.0:1788872905.401702:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872905.401721:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327825664:0@lo:38:kworker.0 00000100:00100000:1.0:1788872905.401748:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872905.401768:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327826048:0@lo:38:kworker.0 00000100:00100000:1.0:1788872905.401811:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872905.401845:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327825280:0@lo:400:kworker.0 00000100:00100000:1.0:1788872905.401874:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872905.401895:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327826176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872905.401921:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872905.401942:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872905.401949:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327825536:0@lo:400:kworker.0 00000100:00100000:1.0:1788872905.401973:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872905.402031:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327825152 00000100:00100000:1.0:1788872905.402042:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327825152 00000100:00100000:1.0:1788872905.402088:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327825408 00000100:00100000:1.0:1788872905.402091:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327825408 00000100:00100000:1.0:1788872905.402100:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327826048 00000100:00100000:1.0:1788872905.402102:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327826048 00000100:00100000:1.0:1788872905.402113:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327825280 00000100:00100000:1.0:1788872905.402116:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327825280 00000100:00100000:1.0:1788872905.402154:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327825536 00000100:00100000:1.0:1788872905.402157:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327825536 00000100:00100000:1.0:1788872905.402177:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1788872905.402186:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327825280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872905.402249:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327825280:12345-0@lo:400:kworker.0 Request processed in 63us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872905.402258:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1788872905.402278:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1788872905.402286:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327825536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872905.402316:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327825536:12345-0@lo:400:kworker.0 Request processed in 31us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872905.402333:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1788872905.402347:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:1.0:1788872905.402352:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327825152:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872905.402374:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872905.402412:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327825152:12345-0@lo:38:kworker.0 Request processed in 58us (761us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872905.402418:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:1.0:1788872905.402433:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1788872905.402438:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327825408:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788872905.402442:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327826176 00010000:00020000:1.0:1788872905.402448:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872905.402449:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327826176 00000100:00100000:1.0:1788872905.402484:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327825408:12345-0@lo:38:kworker.0 Request processed in 44us (780us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872905.402491:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:0.0:1788872905.402496:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:0.0:1788872905.402508:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327826176:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872905.402509:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1788872905.402518:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327826048:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872905.402527:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00002000:00000024:0.0:1788872905.402543:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872905.402591:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327826048:12345-0@lo:38:kworker.0 Request processed in 72us (777us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872905.402599:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00080000:1.0:1788872905.402629:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872905.402635:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327826176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (711us total) trans 0 rc 0/0 00000100:00080000:1.0:1788872905.402637:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872905.402646:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00100000:1.0:1788872905.402675:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327825536:0@lo:400:kworker.0 00000100:00100000:0.0:1788872905.402685:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327825664 00000100:00100000:0.0:1788872905.402691:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327825664 00000100:00100000:1.0:1788872905.402692:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327825280:0@lo:400:kworker.0 00000100:00100000:1.0:1788872905.402713:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327826176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872905.402719:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00100000:0.0:1788872905.402735:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327825664:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872905.402748:0:8446:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788872905.402786:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872905.402793:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788872905.402798:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327825664:12345-0@lo:38:kworker.0 Request processed in 61us (1047us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872905.402799:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327825152:0@lo:38:kworker.0 00000100:00100000:0.0:1788872905.402813:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000100:00080000:1.0:1788872905.402816:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872905.402822:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872905.402826:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327825408:0@lo:38:kworker.0 00000100:00080000:1.0:1788872905.402837:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872905.402840:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872905.402843:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327825664:0@lo:38:kworker.0 00000100:00080000:1.0:1788872905.402854:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872905.402857:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872905.402860:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327826048:0@lo:38:kworker.0 00000100:00100000:3.0:1788872905.404019:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327825920 00000100:00100000:3.0:1788872905.404032:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327825920 00000100:00100000:3.0:1788872905.404088:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327825792 00000100:00100000:3.0:1788872905.404092:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327825792 00000100:00100000:0.0:1788872905.404116:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:0.0:1788872905.404142:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327825920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872905.404241:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327825920:12345-0@lo:400:kworker.0 Request processed in 103us (2777us total) trans 0 rc 0/0 00000100:00080000:1.0:1788872905.404297:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872905.404355:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327825920:0@lo:400:kworker.0 00000100:00100000:1.0:1788872905.405780:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327826304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872905.405857:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872905.406445:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327826304 00000100:00100000:2.0:1788872905.406454:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327826304 00000100:00100000:2.0:1788872905.406520:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:2.0:1788872905.406530:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327826304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872905.406592:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872905.406683:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765327826304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872905.406691:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00100000:1.0:1788872905.406808:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327826304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872905.407672:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00100000:3.0:1788872905.411059:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1788872905.411103:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327825792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872905.411259:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327825792:12345-0@lo:400:kworker.0 Request processed in 181us (9685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872905.411269:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:0.0:1788872905.411362:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327825792:0@lo:400:kworker.0 00010000:00010000:0.0:1788872906.042438:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788872906.432106:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788872890/real 1788872890] req@ffff98a8c6526d80 x1875765327820544/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872906 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872906.432158:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff98a8c6526d80 x1875765327820544/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872906 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872906.432168:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788872906.432172:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788872906.432175:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.139@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788872906.432177:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788872906.432181:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a8c6526d80 x1875765327820544/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788872906 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872906.432190:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a8c5acdc00 x1875765327822848/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872911 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872906.432215:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9ef3d2680 x1875765327823872/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872916 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872906.432224:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98a9ff54e300 x1875765327825024/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788872921 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788872906.432254:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788872906.432258:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788872906.432259:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788872906.432262:0:3647:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1788872906.432294:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327820544:0@lo:400:kworker.0 00000100:00100000:3.0:1788872906.432334:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327825024:0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.433070:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327823872:0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.433080:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327822848:0@lo:400:kworker.0 00000100:00080000:1.0:1788872906.433116:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872906.433120:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788872906.433123:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872906.433138:0:86506:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3785 00000100:00080000:1.0:1788872906.433146:0:86506:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872906.433177:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c4f36d80 x1875765327826432/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872906.433200:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872906.433204:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872906.433206:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872906.433209:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3842 00000100:00080000:1.0:1788872906.433212:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872906.433216:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872906.433230:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c4f35500 x1875765327826560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872906.433268:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872906.433271:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872906.433273:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872906.433276:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3842 00000100:00080000:1.0:1788872906.433279:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872906.433282:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872906.433293:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c4f37480 x1875765327826816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872906.433307:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872906.433309:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872906.433311:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872906.433315:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3842 00000100:00080000:1.0:1788872906.433317:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872906.433328:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872906.433341:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c4f37100 x1875765327827072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872906.433369:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872906.433375:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872906.433377:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872906.433380:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3842 00000100:00080000:1.0:1788872906.433382:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788872906.433386:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872906.433396:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5acdc00 x1875765327827456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872906.433427:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327827200:0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.433493:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872906.433528:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872906.433546:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327827328:0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.433588:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872906.433618:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327827200 00000100:00100000:1.0:1788872906.433625:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327827200 00000100:00100000:1.0:1788872906.433662:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327827328 00000100:00100000:1.0:1788872906.433665:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327827328 00000100:00100000:1.0:1788872906.433683:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713 00000100:00100000:1.0:1788872906.433692:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327827200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.433740:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327827200:12345-0@lo:400:kworker.0 Request processed in 48us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872906.433747:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713 00000100:00100000:1.0:1788872906.433781:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714 00000100:00100000:1.0:1788872906.433795:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327827328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.433826:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327827328:12345-0@lo:400:kworker.0 Request processed in 32us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872906.433831:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714 00000100:00100000:1.0:1788872906.433858:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327826944:0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.433886:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872906.433906:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872906.433911:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327826688:0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.433931:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872906.433954:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327826944 00000100:00100000:1.0:1788872906.433958:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327826944 00000100:00100000:1.0:1788872906.433982:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327826688 00000100:00100000:1.0:1788872906.433985:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327826688 00000100:00100000:1.0:1788872906.434002:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1788872906.434008:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327826944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.434047:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327826944:12345-0@lo:400:kworker.0 Request processed in 40us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872906.434053:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1788872906.434064:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1788872906.434069:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327826688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.434095:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327826688:12345-0@lo:400:kworker.0 Request processed in 26us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872906.434100:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1788872906.434145:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327826688:0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.434154:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327826944:0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.434191:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327827328:0@lo:400:kworker.0 00000100:00100000:1.0:1788872906.434199:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327827200:0@lo:400:kworker.0 00000100:00100000:3.0:1788872906.434782:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327826432:0@lo:250:kworker.0 00000400:00000100:3.0:1788872906.434809:0:3643:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765327826432 offset 0 length 520: 4 00000100:00100000:3.0:1788872906.434834:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327826560:0@lo:38:kworker.0 00000100:00100000:3.0:1788872906.434856:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872906.434890:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327826816:0@lo:38:kworker.0 00000100:00100000:3.0:1788872906.434911:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872906.434928:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327827072:0@lo:38:kworker.0 00000100:00100000:3.0:1788872906.434949:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872906.434966:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327827456:0@lo:38:kworker.0 00000100:00100000:3.0:1788872906.434986:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872906.435017:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327826560 00000100:00100000:3.0:1788872906.435022:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327826560 00000100:00100000:3.0:1788872906.435042:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327826816 00000100:00100000:3.0:1788872906.435045:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327826816 00000100:00100000:3.0:1788872906.435055:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327827456 00000100:00100000:3.0:1788872906.435057:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327827456 00000100:00100000:3.0:1788872906.435070:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1788872906.435074:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327826560:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872906.435091:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872906.435125:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327826560:12345-0@lo:38:kworker.0 Request processed in 49us (267us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872906.435131:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1788872906.435146:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1788872906.435149:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327826816:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872906.435159:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872906.435181:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327826816:12345-0@lo:38:kworker.0 Request processed in 30us (269us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872906.435187:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1788872906.435196:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1788872906.435200:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327827456:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872906.435217:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872906.435251:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327827456:12345-0@lo:38:kworker.0 Request processed in 37us (251us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872906.435257:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1788872906.435274:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327827072 00000100:00100000:3.0:1788872906.435278:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327827072 00000100:00100000:3.0:1788872906.435294:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00100000:3.0:1788872906.435298:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0809880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327827072:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872906.435307:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872906.435329:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0809880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327827072:12345-0@lo:38:kworker.0 Request processed in 30us (379us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872906.435335:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000100:00080000:3.0:1788872906.435357:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872906.435362:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872906.435365:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327826560:0@lo:38:kworker.0 00000100:00080000:3.0:1788872906.435372:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872906.435375:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872906.435378:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327826816:0@lo:38:kworker.0 00000100:00080000:3.0:1788872906.435384:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872906.435387:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872906.435389:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327827072:0@lo:38:kworker.0 00000100:00080000:3.0:1788872906.435395:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872906.435398:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872906.435401:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327827456:0@lo:38:kworker.0 00010000:00010000:1.0:1788872907.076156:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872908.089751:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872908.508722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872908.508781:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872908.515794:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311225984 00000100:00100000:2.0:1788872908.515811:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311225984 00000100:00100000:2.0:1788872908.516080:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311225856 00000100:00100000:2.0:1788872908.516084:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311225856 00000100:00100000:2.0:1788872908.516124:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1424 00000100:00100000:2.0:1788872908.516137:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2407:x1875765311225984:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872908.516358:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1431 00000100:00100000:0.0:1788872908.516365:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311225856:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:0.0:1788872908.516388:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872908.516482:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311225856:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 114us (7699us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872908.516490:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1431 00000100:00100000:2.0:1788872908.517483:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2407:x1875765311225984:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 1342us (8776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872908.517495:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1424 00000100:00080000:1.0:1788872908.517925:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788872909.113822:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872909.514205:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872909.514308:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311226240 00000100:00100000:1.0:1788872909.514318:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311226240 00000100:00100000:1.0:1788872909.514384:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1425 00000100:00100000:1.0:1788872909.514394:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2407:x1875765311226240:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872909.514474:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2407:x1875765311226240:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 80us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872909.514481:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1425 00000100:00100000:0.0:1788872909.516105:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872909.516190:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311226112 00000100:00100000:1.0:1788872909.516198:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311226112 00000100:00100000:1.0:1788872909.516240:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1432 00000100:00100000:1.0:1788872909.516248:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311226112:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:1.0:1788872909.516273:0:66979:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872909.516330:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311226112:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 81us (232us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872909.516337:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1432 00000001:00100000:3.0:1788872910.011603:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000020:00000080:3.0:1788872910.011615:0:9516:0:(genops.c:906:class_export_put()) final put ffff98a8c4ba4000/0804304d-5904-48ad-87f2-bcbc7642a62a 00000020:00000080:0.0:1788872910.011694:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c4ba4000/0804304d-5904-48ad-87f2-bcbc7642a62a for lustre-OST0001 00000020:00000080:0.0:1788872910.011748:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c4ba6800 for lustre-OST0001 00000020:01000004:1.0:1788872910.122263:0:94369:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788872910.122271:0:94369:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788872910.122273:0:94369:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788872910.122387:0:94369:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98a9fa734000 00000020:01000004:1.0:1788872910.122405:0:94369:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788872910.122418:0:94369:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788872910.122432:0:94369:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98a9f67119c0) 00000020:00000080:1.0:1788872910.122469:0:94369:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1788872910.136750:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788872910.220444:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788872910.222716:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788872910.224301:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788872910.225924:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788872910.226812:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788872910.227074:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788872910.228043:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788872910.228441:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788872910.228706:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788872910.228933:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788872910.229273:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788872910.229596:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788872910.229844:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788872910.230120:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788872910.230511:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788872910.237340:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788872910.237774:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788872910.238038:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788872910.238461:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788872910.238837:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788872910.239149:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788872910.239731:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788872910.240046:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788872910.247804:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788872910.248426:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788872910.248701:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788872910.248925:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788872910.249330:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788872910.249593:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788872910.249794:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788872910.250048:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788872910.250430:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788872910.251258:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788872910.251517:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788872910.251732:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788872910.252045:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788872910.252448:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788872910.252725:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788872910.253342:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788872910.253613:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788872910.253800:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788872910.254044:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788872910.254507:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788872910.254735:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788872910.255043:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788872910.255511:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788872910.255970:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788872910.256584:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788872910.257043:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788872910.257447:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788872910.257852:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788872910.258316:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788872910.258527:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788872910.258618:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:3.0:1788872910.258661:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:3.0:1788872910.258705:0:94369:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00080000:01000000:3.0:1788872910.259981:0:94369:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788872910.260257:0:94369:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788872910.260267:0:94369:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788872910.260279:0:94369:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01db5e4 00000020:01000004:3.0:1788872910.260288:0:94369:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788872910.260300:0:94369:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788872910.260305:0:94369:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a9fa734000 from MGS 00000020:01000004:3.0:1788872910.260308:0:94369:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788872910.260318:0:94369:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98a9e9998000) 00000020:00000080:3.0:1788872910.260329:0:94369:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:3.0:1788872910.260392:0:94369:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9fa734000 from MGS, refs=2 00080000:01000000:3.0:1788872910.260396:0:94369:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788872910.260401:0:94369:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01db5f2 00010000:00010000:3.0:1788872910.260530:0:94369:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1788872910.268706:0:94369:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788872910.270401:0:94373:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788872910.270533:0:94369:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788872910.270995:0:94369:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788872910.273702:0:94369:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788872910.273962:0:94369:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788872910.274133:0:94369:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788872910.274140:0:94369:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788872910.281282:0:94369:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788872910.281299:0:94369:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788872910.281794:0:94369:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788872910.281802:0:94369:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788872910.282736:0:94369:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788872910.282761:0:94369:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1788872910.282763:0:94369:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.139@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1788872910.282767:0:94369:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.139@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1788872910.282773:0:94369:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98a9e98d3800 already not connected (conn 70, was 0): CONNECTING 00000100:00100000:3.0:1788872910.282779:0:94369:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1788872910.520892:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327827584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872910.520987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872910.521152:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327827584 00000100:00100000:2.0:1788872910.521160:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327827584 00000100:00100000:2.0:1788872910.521218:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:2.0:1788872910.521227:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327827584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872910.521259:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788872910.521305:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872910.521404:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327827584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 177us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872910.521413:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00100000:3.0:1788872910.521415:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327827712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872910.521473:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872910.521938:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327827584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872910.522954:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327827712 00000100:00100000:2.0:1788872910.522966:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327827712 00000100:00100000:2.0:1788872910.523087:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190 00000100:00100000:2.0:1788872910.523099:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327827712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872910.523130:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872910.523187:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327827712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872910.523194:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190 00000100:00100000:2.0:1788872910.523241:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327827712:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788872910.523423:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788872911.160720:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788872911.544779:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872911.544790:0:82775:0:(pinger.c:247:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788872911.544793:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872911.544797:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872911.544801:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872911.544811:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3843 00000100:00080000:0.0:1788872911.544816:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872911.544823:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872911.545369:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9cb5d8a80 x1875765327827840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872911.545441:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872911.545446:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872911.545448:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872911.545452:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3843 00000100:00080000:0.0:1788872911.545454:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872911.545466:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872911.545479:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9cb5d9180 x1875765327828096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872911.545499:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872911.545502:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872911.545518:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872911.545521:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3843 00000100:00080000:0.0:1788872911.545524:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872911.545527:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872911.545540:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a40000 x1875765327828352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788872911.545602:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788872911.545605:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788872911.545606:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788872911.545609:0:82775:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3843 00000100:00080000:0.0:1788872911.545612:0:82775:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788872911.545615:0:82775:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:0.0:1788872911.545624:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a42300 x1875765327828736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872911.545660:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327828480:0@lo:400:kworker.0 00000100:00100000:0.0:1788872911.545732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872911.545772:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872911.545778:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327828608:0@lo:400:kworker.0 00000100:00100000:0.0:1788872911.545806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872911.545899:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327827968:0@lo:400:kworker.0 00000100:00100000:1.0:1788872911.545933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872911.545960:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872911.545966:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327828224:0@lo:400:kworker.0 00000100:00100000:1.0:1788872911.545986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872911.549718:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327828480 00000100:00100000:2.0:1788872911.549738:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327828480 00000100:00100000:2.0:1788872911.549811:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327828608 00000100:00100000:2.0:1788872911.549814:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327828608 00000100:00100000:2.0:1788872911.549839:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00100000:2.0:1788872911.549975:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327828480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872911.550155:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327828480:12345-0@lo:400:kworker.0 Request processed in 184us (4422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872911.550163:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00100000:2.0:1788872911.550182:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716 00000100:00100000:2.0:1788872911.550188:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327828608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872911.550219:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327828608:12345-0@lo:400:kworker.0 Request processed in 32us (4411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872911.550225:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716 00000100:00100000:2.0:1788872911.550296:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327828608:0@lo:400:kworker.0 00000100:00100000:2.0:1788872911.550311:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327828480:0@lo:400:kworker.0 00000100:00100000:3.0:1788872911.550499:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327827968 00000100:00100000:3.0:1788872911.550505:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327827968 00000100:00100000:3.0:1788872911.550539:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327828224 00000100:00100000:3.0:1788872911.550542:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327828224 00000100:00100000:3.0:1788872911.550597:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1788872911.550603:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327827968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872911.550644:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327827968:12345-0@lo:400:kworker.0 Request processed in 40us (4709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872911.550660:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1788872911.550673:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:3.0:1788872911.550679:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327828224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872911.550707:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327828224:12345-0@lo:400:kworker.0 Request processed in 28us (4719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872911.550713:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:3.0:1788872911.550741:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327827840:0@lo:38:kworker.0 00000100:00100000:3.0:1788872911.550792:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872911.550817:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327828096:0@lo:38:kworker.0 00000100:00100000:3.0:1788872911.550839:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872911.550981:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327828352:0@lo:38:kworker.0 00000100:00100000:3.0:1788872911.551011:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872911.551027:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327828736:0@lo:38:kworker.0 00000100:00100000:3.0:1788872911.551203:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872911.551245:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327827840 00000100:00100000:3.0:1788872911.551249:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327827840 00000100:00100000:3.0:1788872911.551267:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327828096 00000100:00100000:3.0:1788872911.551281:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327828096 00000100:00100000:3.0:1788872911.551292:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327828736 00000100:00100000:3.0:1788872911.551294:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327828736 00000100:00100000:3.0:1788872911.551303:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1788872911.551308:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327827840:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872911.551326:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872911.551361:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327827840:12345-0@lo:38:kworker.0 Request processed in 51us (568us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872911.551367:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1788872911.551379:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:3.0:1788872911.551383:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327828096:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872911.551393:0:66193:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872911.551511:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:1.0:1788872911.551517:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327828736:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872911.551527:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872911.551575:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875765327828736:12345-0@lo:38:kworker.0 Request processed in 57us (524us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872911.551581:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:1.0:1788872911.551606:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327828352 00000100:00100000:1.0:1788872911.551610:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327828352 00000100:00100000:1.0:1788872911.551630:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:1.0:1788872911.551635:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327828352:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788872911.551644:0:23717:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872911.551681:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327828352:12345-0@lo:38:kworker.0 Request processed in 44us (668us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872911.551687:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000100:00080000:1.0:1788872911.551706:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872911.551743:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327828224:0@lo:400:kworker.0 00000100:00080000:2.0:1788872911.552001:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872911.552008:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872911.552011:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327827840:0@lo:38:kworker.0 00000100:00080000:2.0:1788872911.552021:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872911.552024:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872911.552027:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327828352:0@lo:38:kworker.0 00000100:00080000:2.0:1788872911.552034:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872911.552037:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872911.552039:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327828736:0@lo:38:kworker.0 00000100:00100000:1.0:1788872911.552129:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327827968:0@lo:400:kworker.0 00000100:00100000:3.0:1788872911.554412:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875765327828096:12345-0@lo:38:kworker.0 Request processed in 3004us (3549us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872911.554427:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00080000:2.0:1788872911.555085:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872911.555093:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872911.555099:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327828096:0@lo:38:kworker.0 00010000:00010000:3.0:1788872912.187397:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872913.209594:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872913.615282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872913.619602:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872913.619942:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872913.620076:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311226368 00000100:00100000:3.0:1788872913.620087:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311226368 00000100:00100000:3.0:1788872913.620139:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 0 00000100:00100000:3.0:1788872913.620148:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1875765311226368:12345-192.168.204.39@tcp:250:kworker.0 00010000:00080000:3.0:1788872913.620180:0:94375:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp t0 exp 0000000000000000 cur 3850 last 0 00000020:00000080:3.0:1788872913.620209:0:94375:0:(genops.c:1406:class_connect()) connect: client c67645b7-2296-4087-92b1-886500c47477, cookie 0xe4e6e89fb01db5f9 00000100:00080000:3.0:1788872913.620359:0:94375:0:(import.c:65:import_set_state_nolock()) ffff98a8ca9b9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872913.620443:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+5:2403:x1875765311226368:12345-192.168.204.39@tcp:250:kworker.0 Request processed in 294us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872913.620463:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 0 00000100:00100000:1.0:1788872913.624637:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311226624 00000100:00100000:1.0:1788872913.624652:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311226624 00000100:00100000:1.0:1788872913.624732:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1428 00000100:00100000:1.0:1788872913.624743:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2405:x1875765311226624:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872913.624823:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2405:x1875765311226624:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 83us (9552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872913.624830:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1428 00000100:00100000:1.0:1788872913.624847:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311226496 00000100:00100000:1.0:1788872913.624850:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311226496 00000100:00100000:1.0:1788872913.624869:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1436 00000100:00100000:1.0:1788872913.624873:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311226496:12345-192.168.204.39@tcp:38:kworker.0 00010000:00020000:1.0:1788872913.624893:0:83669:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872913.624921:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875765311226496:12345-192.168.204.39@tcp:38:kworker.0 Request processed in 46us (4988us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872913.624928:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1436 00000100:00080000:3.0:1788872913.625073:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788872914.233038:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872914.825940:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872914.826749:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311226752 00000100:00100000:1.0:1788872914.826761:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311226752 00000100:00100000:1.0:1788872914.826821:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1 00000100:00100000:1.0:1788872914.826831:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+5:71021:x1875765311226752:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872914.826849:0:94377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872914.826870:0:94377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1cf expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872914.826902:0:94377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1cf expref: 6 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872914.826930:0:94377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1cf expref: 6 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872914.826941:0:94377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c200, rc 0) 00000100:00100000:1.0:1788872914.827016:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+6:71021:x1875765311226752:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 178us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872914.827022:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1 00000100:00100000:1.0:1788872914.829347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872914.829619:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311226880 00000100:00100000:2.0:1788872914.829632:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311226880 00000100:00100000:2.0:1788872914.829686:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2 00000100:00100000:2.0:1788872914.829697:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+6:71021:x1875765311226880:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788872914.829790:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+6:71021:x1875765311226880:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 Request processed in 95us (451us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788872914.829807:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2 00000100:00100000:0.0:1788872914.844633:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872914.844745:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311227008 00000100:00100000:1.0:1788872914.844757:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311227008 00000100:00100000:1.0:1788872914.844828:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 3 00000100:00100000:1.0:1788872914.844850:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+6:71021:x1875765311227008:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872914.844870:0:94377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872914.844891:0:94377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9da00/0xe4e6e89fb01db607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1d6 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872914.844921:0:94377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9da00/0xe4e6e89fb01db607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1d6 expref: 7 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872914.844934:0:94377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9da00/0xe4e6e89fb01db607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1d6 expref: 7 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872914.844945:0:94377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9da00, rc 0) 00000100:00100000:1.0:1788872914.845014:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+7:71021:x1875765311227008:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 176us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872914.845022:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 3 00000100:00100000:0.0:1788872914.855605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872914.855876:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311227136 00000100:00100000:3.0:1788872914.855887:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311227136 00000100:00100000:3.0:1788872914.855958:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 4 00000100:00100000:3.0:1788872914.855968:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+7:71021:x1875765311227136:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788872914.857374:0:94378:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788872914.857663:0:94375:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 123 20000000:01000000:3.0:1788872914.859611:0:94379:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788872914.859620:0:94379:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788872914.859624:0:94379:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788872914.859626:0:94379:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788872914.859644:0:94379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:0.0:1788872914.859930:0:94375:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788872914.860349:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+8:71021:x1875765311227136:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 4375us (4755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872914.860384:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 4 00000100:00100000:0.0:1788872914.864898:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872914.865526:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311227264 00000100:00100000:2.0:1788872914.865538:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311227264 00000100:00100000:2.0:1788872914.868132:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 5 00000100:00100000:2.0:1788872914.868152:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+8:71021:x1875765311227264:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872914.868349:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+8:71021:x1875765311227264:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 203us (3460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872914.868365:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 5 00000100:00100000:2.0:1788872914.877297:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872914.877405:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311227392 00000100:00100000:0.0:1788872914.877418:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311227392 00000100:00100000:0.0:1788872914.877477:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6 00000100:00100000:0.0:1788872914.877487:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+8:71021:x1875765311227392:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872914.877505:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872914.877528:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52aee00/0xe4e6e89fb01db60e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1dd expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872914.877604:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52aee00/0xe4e6e89fb01db60e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1dd expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872914.877616:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52aee00/0xe4e6e89fb01db60e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1dd expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872914.877625:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52aee00, rc 0) 00000100:00100000:0.0:1788872914.877693:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311227392:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 208us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872914.877700:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6 00000100:00100000:0.0:1788872914.885126:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872914.885202:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311227520 00000100:00100000:1.0:1788872914.885212:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311227520 00000100:00100000:1.0:1788872914.885279:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 7 00000100:00100000:1.0:1788872914.885291:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311227520:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872914.885718:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311227520:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 426us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872914.885728:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 7 00000100:00100000:1.0:1788872914.888631:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872914.888850:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311227648 00000100:00100000:2.0:1788872914.888866:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311227648 00000100:00100000:0.0:1788872914.889116:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 8 00000100:00100000:0.0:1788872914.889130:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311227648:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872914.891353:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311227648:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 2216us (2723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872914.891375:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 8 00000100:00100000:2.0:1788872914.897658:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872914.898204:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311227776 00000100:00100000:1.0:1788872914.898216:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311227776 00000100:00100000:1.0:1788872914.898275:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 9 00000100:00100000:1.0:1788872914.898285:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311227776:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872914.898311:0:94377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872914.898331:0:94377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01db615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1e4 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872914.898369:0:94377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01db615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1e4 expref: 10 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872914.898380:0:94377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01db615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1e4 expref: 10 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872914.898389:0:94377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9dc00, rc 0) 00000100:00100000:1.0:1788872914.898450:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311227776:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 166us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872914.898457:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 9 00000100:00100000:0.0:1788872914.904857:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872914.905023:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311227904 00000100:00100000:3.0:1788872914.905034:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311227904 00000100:00100000:3.0:1788872914.905094:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 10 00000100:00100000:3.0:1788872914.905105:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311227904:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872914.905471:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311227904:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 367us (623us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788872914.905481:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 10 00010000:00010000:1.0:1788872915.258108:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872915.640942:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872915.640959:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327828864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872915.641036:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872915.641138:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327828864 00000100:00100000:3.0:1788872915.641145:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327828864 00000100:00100000:3.0:1788872915.641214:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191 00000100:00100000:3.0:1788872915.641224:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327828864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872915.641259:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872915.641308:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327828864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872915.641316:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191 00000100:00100000:3.0:1788872915.641364:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327828864:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788872915.641445:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872915.642588:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327828992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872915.642638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872915.643260:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327828992 00000100:00100000:2.0:1788872915.643270:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327828992 00000100:00080000:3.0:1788872915.643457:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872915.643516:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:2.0:1788872915.643526:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327828992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872915.643596:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872915.643656:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327828992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872915.643664:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00100000:2.0:1788872915.643706:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327828992:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788872916.282806:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872916.664850:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788872906/real 1788872906] req@ffff98a8c4f36d80 x1875765327826432/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788872916 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872916.664881:0:3643:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98a8c4f36d80 x1875765327826432/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788872916 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872916.664900:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872916.664907:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788872916.664926:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327826432:0@lo:250:kworker.0 00000100:00080000:2.0:1788872916.665066:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872916.665072:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788872916.665075:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872916.665080:0:86506:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3843 00000100:00080000:2.0:1788872916.665085:0:86506:0:(import.c:589:import_select_connection()) MGC192.168.204.139@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788872916.665091:0:86506:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872916.665129:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5af7480 x1875765327829120/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:1.0:1788872916.665195:0:3643:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff98a8c5af7480 x1875765327829120/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788872916.666421:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872916.666428:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872916.666431:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872916.666437:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3848 00000100:00080000:2.0:1788872916.666441:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872916.666447:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872916.666474:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5af5880 x1875765327829248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872916.666506:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872916.666510:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872916.666511:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872916.666529:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3848 00000100:00080000:2.0:1788872916.666531:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872916.666534:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872916.666544:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f0988700 x1875765327829504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872916.666586:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872916.666589:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872916.666590:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872916.666594:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3848 00000100:00080000:2.0:1788872916.666596:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872916.666600:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872916.666610:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef2dd180 x1875765327829760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872916.666636:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872916.666639:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788872916.666641:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872916.666644:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3848 00000100:00080000:2.0:1788872916.666646:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788872916.666649:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872916.666658:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef2ddf80 x1875765327830144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872916.666696:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327829632:0@lo:400:kworker.0 00000100:00100000:2.0:1788872916.666763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872916.666793:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872916.666804:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327829376:0@lo:400:kworker.0 00000100:00100000:2.0:1788872916.666826:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872916.666862:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327829888:0@lo:400:kworker.0 00000100:00100000:2.0:1788872916.666885:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872916.666898:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872916.666903:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327830016:0@lo:400:kworker.0 00000100:00100000:2.0:1788872916.666919:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872916.666945:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327829888 00000100:00100000:2.0:1788872916.666950:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327829888 00000100:00100000:2.0:1788872916.666985:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327830016 00000100:00100000:2.0:1788872916.666987:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327830016 00000100:00100000:2.0:1788872916.667002:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00100000:2.0:1788872916.667010:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327829888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872916.667054:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327829888:12345-0@lo:400:kworker.0 Request processed in 45us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872916.667060:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00100000:2.0:1788872916.667076:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:2.0:1788872916.667080:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327830016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872916.667101:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327830016:12345-0@lo:400:kworker.0 Request processed in 20us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872916.667106:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:2.0:1788872916.667144:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327830016:0@lo:400:kworker.0 00000100:00100000:2.0:1788872916.667152:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327829888:0@lo:400:kworker.0 00000100:00100000:0.0:1788872916.667614:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327829632 00000100:00100000:0.0:1788872916.667619:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327829632 00000100:00100000:0.0:1788872916.667666:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327829376 00000100:00100000:0.0:1788872916.667669:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327829376 00000100:00100000:0.0:1788872916.667696:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1788872916.667703:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327829632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872916.667753:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327829632:12345-0@lo:400:kworker.0 Request processed in 50us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872916.667759:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1788872916.667774:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:0.0:1788872916.667780:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327829376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872916.667807:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327829376:12345-0@lo:400:kworker.0 Request processed in 28us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872916.667812:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:0.0:1788872916.667852:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327829376:0@lo:400:kworker.0 00000100:00100000:0.0:1788872916.667877:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327829632:0@lo:400:kworker.0 10000000:01000000:3.0:1788872916.669356:0:94369:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1788872916.669387:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2200/0xe4e6e89fb01daef2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01daef9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669401:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2200/0xe4e6e89fb01daef2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01daef9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669408:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788872916.669439:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669453:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2200/0xe4e6e89fb01daef2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01daef9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.669473:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d400/0xe4e6e89fb01db305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01db30c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669480:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d400/0xe4e6e89fb01db305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01db30c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669484:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872916.669488:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669492:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d400/0xe4e6e89fb01db305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01db30c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.669503:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01db31a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669532:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01db31a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669537:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872916.669541:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669545:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01db31a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.669652:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01db328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669659:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01db328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669664:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872916.669668:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669672:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01db328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.669681:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01db32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01db336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669687:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01db32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01db336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669692:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872916.669695:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669698:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01db32f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01db336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.669718:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01db33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01db344 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669725:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01db33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01db344 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669730:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872916.669734:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669738:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01db33d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01db344 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.669746:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01db352 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669752:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01db352 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669758:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872916.669761:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669765:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db34b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01db352 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.669773:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52aec00/0xe4e6e89fb01db359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01db360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669779:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52aec00/0xe4e6e89fb01db359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01db360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669784:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872916.669794:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669798:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52aec00/0xe4e6e89fb01db359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01db360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.669810:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01dae66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01dae6d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669816:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01dae66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01dae6d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669820:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872916.669823:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669826:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d2800/0xe4e6e89fb01dae66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01dae6d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.669837:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3000/0xe4e6e89fb01dae82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01dae89 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669844:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3000/0xe4e6e89fb01dae82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01dae89 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669849:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872916.669852:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669855:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9df4d3000/0xe4e6e89fb01dae82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01dae89 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.669868:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a400/0xe4e6e89fb01dae90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01dae97 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669874:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a400/0xe4e6e89fb01dae90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01dae97 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669889:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788872916.669892:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669896:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a400/0xe4e6e89fb01dae90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01dae97 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.669905:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a000/0xe4e6e89fb01daeba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01daec1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669911:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a000/0xe4e6e89fb01daeba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01daec1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669916:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788872916.669918:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669921:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c5c5a000/0xe4e6e89fb01daeba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01daec1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.669928:0:94369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01daee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe4e6e89fb01daeeb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872916.669934:0:94369:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01daee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe4e6e89fb01daeeb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.669938:0:94369:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788872916.669941:0:94369:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788872916.669944:0:94369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9c56c8600/0xe4e6e89fb01daee4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe4e6e89fb01daeeb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788872916.670929:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872916.696710:0:94369:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98a9e98d3800 already not connected (conn 71, was 0): CONNECTING 00000100:00080000:3.0:1788872916.696719:0:94369:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:1.0:1788872916.709823:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872916.709862:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:1.0:1788872916.709883:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:0:1875765327829120:0@lo:250:kworker.0 00000100:00100000:1.0:1788872916.709962:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327829248:0@lo:38:kworker.0 00000100:00100000:1.0:1788872916.710039:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872916.710081:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327829504:0@lo:38:kworker.0 00000100:00100000:1.0:1788872916.710107:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.710118:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327829248 00000100:00100000:1.0:1788872916.710127:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327829760:0@lo:38:kworker.0 00000100:00100000:3.0:1788872916.710128:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327829248 00000100:00100000:3.0:1788872916.710162:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327829504 00000100:00100000:3.0:1788872916.710167:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327829504 00000100:00100000:3.0:1788872916.710183:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1788872916.710191:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327829248:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872916.710213:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872916.710257:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327829248:12345-0@lo:38:kworker.0 Request processed in 66us (217us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872916.710265:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1788872916.710281:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:3.0:1788872916.710285:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327829504:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788872916.710294:0:68674:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872916.710442:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327829504:12345-0@lo:38:kworker.0 Request processed in 154us (335us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872916.710448:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00080000:2.0:1788872916.710608:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788872916.710613:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788872916.710637:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788872916.710642:0:86506:0:(import.c:510:import_select_connection()) MGC192.168.204.139@tcp: connect to NID 0@lo last attempt 3853 00000100:00080000:2.0:1788872916.710647:0:86506:0:(import.c:589:import_select_connection()) MGC192.168.204.139@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788872916.710652:0:86506:0:(import.c:624:import_select_connection()) MGC192.168.204.139@tcp: import ffff98a9e98d3800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872916.710677:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9e9b01500 x1875765327830272/t0(0) o250->MGC192.168.204.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788872916.711180:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872916.711204:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327830144:0@lo:38:kworker.0 00000100:00100000:2.0:1788872916.711226:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872916.711299:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327830272:0@lo:250:kworker.0 00000100:00100000:2.0:1788872916.711325:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788872916.711373:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872916.711378:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872916.711381:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327829248:0@lo:38:kworker.0 00000100:00080000:2.0:1788872916.711391:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872916.711395:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872916.711397:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327829504:0@lo:38:kworker.0 00000100:00100000:1.0:1788872916.711453:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327830272 00000100:00100000:1.0:1788872916.711459:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327830272 00000100:00100000:3.0:1788872916.711475:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327829760 00000100:00100000:3.0:1788872916.711482:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327829760 00000100:00100000:1.0:1788872916.711498:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788872916.711504:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3643:x1875765327830272:12345-0@lo:250:kworker.0 00000100:00100000:3.0:1788872916.711513:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00000100:00100000:3.0:1788872916.711519:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327829760:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788872916.711526:0:94376:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo t0 exp 0000000000000000 cur 3853 last 0 00010000:00020000:3.0:1788872916.711534:0:8447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:1.0:1788872916.711589:0:94376:0:(genops.c:1406:class_connect()) connect: client f2e885a0-f180-4b85-9f87-6a01e20afd1a, cookie 0xe4e6e89fb01db61c 00000100:00100000:3.0:1788872916.711608:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327829760:12345-0@lo:38:kworker.0 Request processed in 87us (427us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872916.711618:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000100:00080000:1.0:1788872916.711733:0:94376:0:(import.c:65:import_set_state_nolock()) ffff98a8c2644000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872916.711773:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:3643:x1875765327830272:12345-0@lo:250:kworker.0 Request processed in 268us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872916.711780:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788872916.712946:0:3643:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.139@tcp: committing for last_committed 0 gen 29 00000100:00080000:2.0:1788872916.712959:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.139@tcp: connect to target with instance 0 00000100:00080000:2.0:1788872916.712968:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788872916.712974:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788872916.712978:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d3800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788872916.712981:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788872916.713015:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788872916.713025:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3643:1875765327830272:0@lo:250:kworker.0 00000100:00080000:2.0:1788872916.713040:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788872916.713056:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788872916.713059:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327829760:0@lo:38:kworker.0 00000020:01000000:3.0:1788872916.713811:0:86506:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.139@tcp 10000000:01000000:3.0:1788872916.713833:0:86506:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1788872916.713837:0:86506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788872916.713844:0:86506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788872916.713845:0:86506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872916.713846:0:86506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872916.713848:0:86506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872916.713850:0:86506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872916.713851:0:86506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788872916.713853:0:86506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872916.713855:0:86506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788872916.713907:0:86506:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788872916.713915:0:86506:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788872916.713917:0:86506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788872916.713918:0:86506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788872916.713919:0:86506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872916.713921:0:86506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872916.713922:0:86506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872916.713923:0:86506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872916.713924:0:86506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788872916.713926:0:86506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872916.713927:0:86506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788872916.713937:0:86506:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788872916.713941:0:86506:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1788872916.713943:0:86506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788872916.713944:0:86506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788872916.713945:0:86506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872916.713946:0:86506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872916.713947:0:86506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872916.713949:0:86506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872916.713950:0:86506:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788872916.713951:0:86506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872916.713952:0:86506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788872916.713973:0:86506:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00080000:3.0:1788872916.714004:0:94369:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1788872916.714015:0:94369:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788872916.714048:0:94369:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788872916.714053:0:94369:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788872916.714165:0:94369:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.139@tcp ctxt 0 is initialized 00000100:00100000:2.0:1788872916.714181:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327830400:0@lo:253:kworker.0 00000020:01000004:3.0:1788872916.714187:0:94369:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.139@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788872916.714190:0:94369:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788872916.714195:0:94369:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788872916.714195:0:94369:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872916.714196:0:94369:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872916.714197:0:94369:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872916.714198:0:94369:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872916.714199:0:94369:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788872916.714200:0:94369:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788872916.714201:0:94369:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872916.714202:0:94369:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788872916.714204:0:94369:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788872916.714206:0:94369:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788872916.714207:0:94369:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788872916.714208:0:94369:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872916.714209:0:94369:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872916.714209:0:94369:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872916.714210:0:94369:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872916.714211:0:94369:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788872916.714212:0:94369:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788872916.714213:0:94369:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872916.714214:0:94369:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788872916.714224:0:94369:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788872916.714233:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327830784:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788872916.714245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.714258:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.714482:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3771300 going to sleep for 11 seconds 00000100:00100000:3.0:1788872916.714517:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327830656:0@lo:253:kworker.0 00000100:00100000:3.0:1788872916.714585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.714631:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327830400 00000100:00100000:3.0:1788872916.714637:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327830400 00000100:00100000:3.0:1788872916.714666:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327830784 00000100:00100000:3.0:1788872916.714669:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327830784 00000100:00100000:3.0:1788872916.714679:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327830656 00000100:00100000:3.0:1788872916.714680:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327830656 00000100:00100000:3.0:1788872916.714691:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788872916.714698:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:3644:x1875765327830400:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788872916.714724:0:94375:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788872916.714742:0:94375:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788872916.714846:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788872916.714855:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:94369:x1875765327830784:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788872916.714883:0:94377:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788872916.714886:0:94377:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788872916.714888:0:94377:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1788872916.714894:0:94377:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788872916.714973:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327830528:0@lo:253:kworker.0 00000100:00100000:1.0:1788872916.715010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872916.715749:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327830144 00000100:00100000:0.0:1788872916.715756:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327830144 00000100:00100000:0.0:1788872916.715796:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1788872916.715802:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327830144:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788872916.715821:0:66192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788872916.715876:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327830144:12345-0@lo:38:kworker.0 Request processed in 73us (4648us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872916.715883:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00080000:1.0:1788872916.716009:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872916.716015:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872916.716019:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327830144:0@lo:38:kworker.0 00000100:00100000:3.0:1788872916.716390:0:94376:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1788872916.716686:0:94376:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1788872916.716943:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327830528 00000100:00100000:1.0:1788872916.716949:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327830528 00000100:00100000:0.0:1788872916.717116:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788872916.717126:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3646:x1875765327830656:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788872916.717165:0:94381:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1788872916.727023:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:94369:x1875765327830784:12345-0@lo:253:mount.lustre.0 Request processed in 12160us (12753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872916.727038:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788872916.727084:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788872916.727095:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:3645:x1875765327830528:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788872916.727124:0:94377:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1788872916.727210:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327830784:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788872916.727224:0:94369:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788872916.727227:0:94369:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788872916.727229:0:94369:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788872916.727230:0:94369:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872916.727232:0:94369:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872916.727233:0:94369:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872916.727235:0:94369:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872916.727236:0:94369:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788872916.727238:0:94369:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788872916.727240:0:94369:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872916.727241:0:94369:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788872916.727263:0:94369:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a9fa734000 from lustre-MDT0000 10000000:01000000:3.0:1788872916.727291:0:94369:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788872916.727294:0:94369:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788872916.727314:0:94369:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98a9fa734000 10000000:01000000:3.0:1788872916.727319:0:94369:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788872916.727325:0:94369:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98a9fa734000 10000000:01000000:3.0:1788872916.727328:0:94369:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788872916.727331:0:94369:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a9fa734000 from 1 10000000:01000000:3.0:1788872916.727334:0:94369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788872916.727368:0:94369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.727397:0:94369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.727416:0:94369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872916.727437:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327830912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788872916.727475:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.727515:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3771780 going to sleep for 11 seconds 00000100:00100000:1.0:1788872916.727649:0:94376:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:1.0:1788872916.727658:0:94376:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:1.0:1788872916.727793:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327830912 00000100:00100000:1.0:1788872916.727800:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327830912 00000100:00100000:1.0:1788872916.727889:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788872916.727897:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:94369:x1875765327830912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872916.727908:0:94382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872916.727921:0:94382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01db62a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db623 expref: -99 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872916.727941:0:94382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01db62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db623 expref: 9 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872916.727951:0:94382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9d000/0xe4e6e89fb01db62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db623 expref: 9 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872916.727960:0:94382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d000, rc 0) 00000100:00100000:1.0:1788872916.727996:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:94369:x1875765327830912:12345-0@lo:101:mount.lustre.0 Request processed in 100us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872916.728002:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 20000000:01000000:0.0:1788872916.728160:0:94375:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788872916.728171:0:94375:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788872916.728230:0:94381:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788872916.728362:0:94378:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788872916.728366:0:94378:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788872916.728381:0:94378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.728394:0:94378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1cf expref: 9 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.728401:0:94378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.728428:0:94378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1cf expref: 9 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.728440:0:94378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db600 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1cf expref: 9 pid: 94377 timeout: 3953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872916.728452:0:94378:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94378:1875765327831040:192.168.204.39@tcp:104: 00000100:00100000:3.0:1788872916.728514:0:94378:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3771cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872916.728579:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327830912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872916.728596:0:94369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db62a expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.728606:0:94369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db62a expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.728724:0:94369:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788872916.728736:0:94369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db62a expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.728743:0:94369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac4e00/0xe4e6e89fb01db623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db62a expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872916.728750:0:94369:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788872916.728764:0:94369:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788872916.728769:0:94369:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98a9fa734000 10000000:01000000:3.0:1788872916.728771:0:94369:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788872916.728775:0:94369:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788872916.728777:0:94369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788872916.728795:0:94369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.728802:0:94369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.728809:0:94369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872916.728822:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327831168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788872916.728858:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.728881:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327831168 00000100:00100000:3.0:1788872916.728885:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327831168 00000100:00100000:3.0:1788872916.728921:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788872916.728928:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:94369:x1875765327831168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872916.728937:0:94376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872916.728946:0:94376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac4800/0xe4e6e89fb01db63f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db638 expref: -99 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.728961:0:94376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac4800/0xe4e6e89fb01db63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db638 expref: 10 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.728970:0:94376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac4800/0xe4e6e89fb01db63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db638 expref: 10 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872916.728977:0:94376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4800, rc 0) 00000100:00100000:2.0:1788872916.728998:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3771780 going to sleep for 11 seconds 00000100:00100000:3.0:1788872916.729002:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:94369:x1875765327831168:12345-0@lo:101:mount.lustre.0 Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872916.729007:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788872916.729011:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327831168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872916.729020:0:94369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db63f expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.729029:0:94369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db63f expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872916.729081:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327831296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872916.729106:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872916.729124:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:3644:x1875765327830400:12345-0@lo:253:kworker.0 Request processed in 14425us (14877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872916.729131:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000004:0.0:1788872916.729167:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788872916.729171:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788872916.729172:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872916.729173:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872916.729174:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872916.729176:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872916.729177:0:3644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788872916.729188:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872916.729189:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788872916.729192:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327830400:0@lo:253:kworker.0 00000100:00100000:2.0:1788872916.729480:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c9d9e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872916.729671:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327831296 00000100:00100000:2.0:1788872916.729676:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327831296 00000100:00100000:3.0:1788872916.734540:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788872916.735724:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:94369:x1875765327831296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872916.735939:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:94369:x1875765327831296:12345-0@lo:501:mount.lustre.0 Request processed in 1349us (6831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872916.735962:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788872916.736272:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327831296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788872916.736332:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327831424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788872916.736387:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.736484:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3771900 going to sleep for 11 seconds 20000000:01000000:3.0:1788872916.738528:0:94381:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788872916.738537:0:94381:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788872916.738836:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:3646:x1875765327830656:12345-0@lo:253:kworker.0 Request processed in 21708us (24246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872916.738862:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:3.0:1788872916.738911:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788872916.738914:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788872916.738916:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788872916.738917:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788872916.738918:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788872916.738919:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788872916.738921:0:3646:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788872916.738922:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788872916.738924:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788872916.738927:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327830656:0@lo:253:kworker.0 00000100:00100000:3.0:1788872916.738965:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327831424 00000100:00100000:3.0:1788872916.738973:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327831424 20000000:01000000:0.0:1788872916.739046:0:94377:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788872916.739676:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872916.739715:0:94378:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94378:1875765327831040:192.168.204.39@tcp:104: 00010000:00010000:2.0:1788872916.739735:0:94378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872916.739762:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311228032 00000100:00100000:2.0:1788872916.739766:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311228032 00010000:00010000:2.0:1788872916.739789:0:26198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db600 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1cf expref: 10 pid: 94377 timeout: 3953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872916.739814:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2591 00000100:00100000:2.0:1788872916.739823:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311228032:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788872916.739836:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872916.739842:0:26198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db600 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1cf expref: 10 pid: 94377 timeout: 3953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.739852:0:26198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1cf expref: 10 pid: 94377 timeout: 3953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.739869:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1cf expref: 10 pid: 94377 timeout: 3953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.739888:0:26198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.739896:0:26198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788872916.739927:0:26198:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011559702s 00010000:00010000:2.0:1788872916.739932:0:26198:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.739939:0:26198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.739946:0:26198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.739952:0:26198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.739958:0:26198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872916.739962:0:26198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.739969:0:26198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.739983:0:26198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.739992:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872916.740034:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c67645b7-2296-4087-92b1-886500c47477+9:2404:x1875765311228032:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 211us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872916.740041:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2591 00010000:00010000:2.0:1788872916.740069:0:94378:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.740086:0:94378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.740093:0:94378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db631 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788872916.746895:0:94377:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788872916.746917:0:94377:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788872916.747121:0:94378:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788872916.747127:0:94378:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788872916.747162:0:94378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db646 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.747188:0:94378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db646 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788872916.747197:0:94378:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011559702s 00010000:00010000:2.0:1788872916.747202:0:94378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db646 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.747208:0:94378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db646 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.747215:0:94378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db646 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.747222:0:94378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db646 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.747229:0:94378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872916.747233:0:94378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db646 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.747259:0:94378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db646 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.747273:0:94378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db646 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.747281:0:94378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db646 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872916.747288:0:94378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db646 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872916.747749:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:3645:x1875765327830528:12345-0@lo:253:kworker.0 Request processed in 20652us (32733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872916.747770:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788872916.747821:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788872916.747832:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:94369:x1875765327831424:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872916.747963:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:94369:x1875765327831424:12345-0@lo:503:mount.lustre.0 Request processed in 134us (11576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872916.747969:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000020:01000004:2.0:1788872916.748071:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788872916.748073:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788872916.748075:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872916.748076:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872916.748077:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872916.748079:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872916.748080:0:3645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788872916.748082:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872916.748083:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788872916.748087:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327830528:0@lo:253:kworker.0 00000100:00100000:1.0:1788872916.752234:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327831424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788872916.754446:0:94383:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94383:1875765327831552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872916.754527:0:94383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.754600:0:94383:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3771780 going to sleep for 11 seconds 00000100:00100000:2.0:1788872916.754728:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327831552 00000100:00100000:2.0:1788872916.754735:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327831552 00000100:00100000:2.0:1788872916.754777:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788872916.754785:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:94383:x1875765327831552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872916.755421:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:94383:x1875765327831552:12345-0@lo:502:llog_process_th.0 Request processed in 634us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872916.755430:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788872916.755805:0:94383:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94383:1875765327831552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788872916.755836:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872916.755846:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872916.755849:0:94383:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788872916.755854:0:94383:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788872916.755857:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788872916.755870:0:94383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98a9e999cd40) 00000020:00000080:3.0:1788872916.755891:0:94383:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1788872916.755895:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788872916.755966:0:94383:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788872916.755972:0:94383:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01db654 00000020:00000080:3.0:1788872916.756290:0:94383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788872916.756296:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872916.756309:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872916.756318:0:94383:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788872916.756322:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872916.756326:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872916.756327:0:94383:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788872916.756338:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788872916.756345:0:94383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98a9e99999c0) 00000020:00000080:3.0:1788872916.756357:0:94383:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1788872916.756361:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788872916.756363:0:94383:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788872916.756366:0:94383:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788872916.756372:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788872916.756533:0:94383:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9fa734000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788872916.756546:0:94383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98a9e999b380) 00000020:00000080:3.0:1788872916.756721:0:94383:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1788872916.756777:0:94383:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788872916.756782:0:94383:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01db669 00000020:00000080:3.0:1788872916.756878:0:94383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788872916.756884:0:94383:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788872916.756888:0:94383:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe4e6e89fb01db670 00080000:01000000:3.0:1788872916.756893:0:94383:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788872916.756897:0:94383:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01db677 00010000:00010000:3.0:1788872916.909158:0:94383:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1788872916.909312:0:94383:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 115964116995 srv lr: 120259084288 lx: 0 gen 22 00000001:00080000:3.0:1788872916.909356:0:94383:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0804304d-5904-48ad-87f2-bcbc7642a62a idx: 2 lr: 0 srv lr: 120259084288 lx: 0 gen 24 00000001:00000004:3.0:1788872916.909379:0:94383:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 120259084288 00000001:00080000:3.0:1788872916.909809:0:94383:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788872916.909867:0:94383:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff98a9f9e83d80: xid 1875765327814912, transno 120259084298, client gen 22, slot idx 0 00000001:00080000:3.0:1788872916.909878:0:94383:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff98a9f9e83a80: xid 1875765327814656, transno 120259084297, client gen 22, slot idx 1 00000001:00080000:3.0:1788872916.909883:0:94383:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff98a9f9e83540: xid 1875765311213696, transno 120259084294, client gen 24, slot idx 2 00000001:00080000:3.0:1788872916.909887:0:94383:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff98a9f9e83e40: xid 1875765311213312, transno 120259084293, client gen 24, slot idx 3 00000020:00000080:3.0:1788872916.910510:0:94383:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98a8c1cf8000) 00000020:00000080:3.0:1788872916.910532:0:94383:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1788872916.910642:0:94383:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788872916.910650:0:94383:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01db693 00000020:00000080:3.0:1788872916.914013:0:94383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788872916.927080:0:94383:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe4e6e89fb01db69a 00000020:00000080:0.0:1788872916.927534:0:94383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788872916.927575:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872916.927582:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872916.927585:0:94383:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788872916.927589:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788872916.927592:0:94383:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788872916.927594:0:94383:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788872916.927595:0:94383:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788872916.927597:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788872916.927600:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872916.927601:0:94383:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788872916.927604:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872916.927609:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872916.927610:0:94383:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788872916.927615:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788872916.927659:0:94383:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788872916.927678:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872916.927681:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872916.927682:0:94383:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788872916.927685:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872916.927689:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872916.927691:0:94383:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788872916.927694:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788872916.927700:0:94383:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:00000080:0.0:1788872916.927735:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788872916.927750:0:94383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98a8c72e8000) 00000020:00000080:0.0:1788872916.927769:0:94383:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788872916.927773:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788872916.927835:0:94383:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788872916.927841:0:94383:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788872916.927846:0:94383:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01db6a8 00010000:00080000:0.0:1788872916.927878:0:94383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a8c9e82800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:0.0:1788872916.930687:0:94383:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1788872916.937110:0:94383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872916.937135:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788872916.937182:0:94383:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788872916.937213:0:94383:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01db6af 00000100:00080000:2.0:1788872916.937226:0:94383:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788872916.937232:0:94383:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98a8c9e82800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872916.937267:0:94383:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef2ddf80 x1875765327831680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872916.937296:0:94383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788872916.937577:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327831680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788872916.937654:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788872916.937731:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872916.937735:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872916.937737:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872916.937741:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3853 00000100:00080000:3.0:1788872916.937744:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872916.937748:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872916.937764:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c273e680 x1875765327831936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872916.937800:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872916.937804:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872916.937805:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872916.937809:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3853 00000100:00080000:3.0:1788872916.937811:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872916.937814:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872916.937826:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c273f100 x1875765327832192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872916.937841:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872916.937854:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872916.937856:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872916.937860:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3853 00000100:00080000:3.0:1788872916.937862:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872916.937866:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872916.937880:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c273e300 x1875765327832448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872916.937905:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872916.937907:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788872916.937909:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872916.937913:0:86506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3853 00000100:00080000:3.0:1788872916.937915:0:86506:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788872916.937918:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872916.937929:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5a4a680 x1875765327832832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872916.937957:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327832576:0@lo:400:kworker.0 00000100:00100000:3.0:1788872916.937989:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.938009:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788872916.938015:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327831808:0@lo:400:kworker.0 00000100:00100000:3.0:1788872916.938042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.938060:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327832704:0@lo:400:kworker.0 00000100:00100000:3.0:1788872916.938082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.938108:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327831936:0@lo:38:kworker.0 00000100:00100000:3.0:1788872916.938135:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.938163:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327832192:0@lo:38:kworker.0 00000100:00100000:3.0:1788872916.938188:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.938204:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327832448:0@lo:38:kworker.0 00000100:00100000:3.0:1788872916.938226:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.938242:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327832832:0@lo:38:kworker.0 00000100:00100000:3.0:1788872916.938264:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872916.938296:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327831936 00000100:00100000:3.0:1788872916.938304:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327831936 00000100:00100000:0.0:1788872916.938458:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327831680 00000100:00100000:0.0:1788872916.938463:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327831680 00000100:00100000:0.0:1788872916.938486:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327832448 00000100:00100000:0.0:1788872916.938489:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327832448 00000100:00100000:0.0:1788872916.938508:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:0.0:1788872916.938515:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327831680:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788872916.938539:0:23717:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3854 last 0 00000020:00000080:0.0:1788872916.938612:0:23717:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01db6b6 00000004:00100000:0.0:1788872916.938627:0:23717:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788872916.938726:0:23717:0:(import.c:65:import_set_state_nolock()) ffff98a9ff63f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872916.938787:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327831680:12345-0@lo:38:llog_process_th.0 Request processed in 270us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872916.938795:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:0.0:1788872916.938813:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:0.0:1788872916.938817:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327832448:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788872916.938850:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327832448:12345-0@lo:38:kworker.0 Request processed in 31us (623us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788872916.938856:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:0.0:1788872916.938881:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327832064:0@lo:400:kworker.0 00000100:00100000:2.0:1788872916.941043:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327832320:0@lo:400:kworker.0 00000100:00100000:1.0:1788872916.941164:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327832576 00000100:00100000:1.0:1788872916.941172:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327832576 00000100:00100000:1.0:1788872916.941234:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327832704 00000100:00100000:1.0:1788872916.941238:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327832704 00000100:00100000:1.0:1788872916.941258:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:1.0:1788872916.941267:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327832576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872916.941353:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327832192 00000100:00100000:3.0:1788872916.941358:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327832192 00000100:00100000:3.0:1788872916.941385:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327832832 00000100:00100000:3.0:1788872916.941388:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327832832 00000100:00100000:3.0:1788872916.941403:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1788872916.941409:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327831936:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788872916.946565:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872916.946643:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327831808 00000100:00100000:2.0:1788872916.946652:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327831808 00000100:00100000:2.0:1788872916.946705:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788872916.946715:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3646:x1875765327831808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872916.946790:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:3646:x1875765327831808:12345-0@lo:400:kworker.0 Request processed in 75us (8745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872916.946797:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:01000000:2.0:1788872916.946884:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872916.946889:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872916.946892:0:94383:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788872916.946895:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788872916.946898:0:94383:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788872916.946899:0:94383:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788872916.946901:0:94383:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788872916.946902:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788872916.946905:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872916.946906:0:94383:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788872916.946909:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788872916.946915:0:94383:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788872916.946919:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872916.946934:0:94383:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788872916.946938:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788872916.946941:0:94383:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:2.0:1788872916.946962:0:94383:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788872916.946965:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788872916.946979:0:94383:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98a9e9b08000) 00000020:00000080:2.0:1788872916.947004:0:94383:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788872916.947009:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788872916.947089:0:94383:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788872916.947095:0:94383:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788872916.947102:0:94383:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01db6c4 00010000:00080000:2.0:1788872916.947135:0:94383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a8c37f1000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:2.0:1788872916.947490:0:94383:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1788872916.950660:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327832576:12345-0@lo:400:kworker.0 Request processed in 9381us (12657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872916.950676:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:1.0:1788872916.950711:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1788872916.950723:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327832704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872916.950773:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327832704:12345-0@lo:400:kworker.0 Request processed in 55us (12690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872916.950780:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1788872916.950862:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327832320 00000100:00100000:1.0:1788872916.950869:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327832320 00000100:00100000:1.0:1788872916.950899:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1788872916.950905:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327832320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872916.950951:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327832320:12345-0@lo:400:kworker.0 Request processed in 46us (4418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872916.950957:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1788872916.950970:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1788872916.950974:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327832192:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788872916.951017:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327832192:12345-0@lo:38:kworker.0 Request processed in 41us (12828us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788872916.951023:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1788872916.951035:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1788872916.951040:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327832832:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788872916.951068:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327832832:12345-0@lo:38:kworker.0 Request processed in 27us (12803us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788872916.951086:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1788872916.951141:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327832320:0@lo:400:kworker.0 00000100:00080000:1.0:1788872916.951255:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872916.951261:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788872916.951265:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327832192:0@lo:38:kworker.0 00000100:00080000:1.0:1788872916.951277:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872916.951280:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788872916.951283:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327832448:0@lo:38:kworker.0 00000100:00080000:1.0:1788872916.951291:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872916.951294:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788872916.951297:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327832832:0@lo:38:kworker.0 00000100:00100000:1.0:1788872916.951313:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788872916.951320:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:1.0:1788872916.951344:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788872916.951349:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788872916.951352:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c9e82800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788872916.951364:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327831680:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788872916.951413:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872916.951423:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327832960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872916.951459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872916.951500:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327832960 00000100:00100000:1.0:1788872916.951504:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327832960 00000100:00100000:1.0:1788872916.951531:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:1.0:1788872916.951537:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327832960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872916.951677:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1788872916.951715:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327832960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872916.951722:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:1.0:1788872916.951752:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327832960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872916.951795:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327831808:0@lo:400:kworker.0 00000100:00100000:1.0:1788872916.951808:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327832704:0@lo:400:kworker.0 00000100:00100000:1.0:1788872916.951819:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327832576:0@lo:400:kworker.0 00000040:01000000:1.0:1788872916.954880:0:94383:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788872916.954911:0:94383:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788872916.955228:0:94383:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000040:00080000:1.0:1788872916.955889:0:94383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788872916.955916:0:94383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].29, 64 off10048 00000040:00080000:1.0:1788872916.956054:0:94383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].1, 64 off8256 00000100:00100000:3.0:1788872916.959091:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875765327831936:12345-0@lo:38:kworker.0 Request processed in 17673us (20946us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788872916.959108:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00080000:1.0:1788872916.959228:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872916.959234:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788872916.959238:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327831936:0@lo:38:kworker.0 00000100:00100000:0.0:1788872916.959824:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872916.959938:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327832064 00000100:00100000:1.0:1788872916.959946:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327832064 00000100:00100000:1.0:1788872916.960008:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1788872916.960018:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327832064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872916.960084:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327832064:12345-0@lo:400:kworker.0 Request processed in 68us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872916.960091:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:0.0:1788872916.960171:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327832064:0@lo:400:kworker.0 00000040:00080000:3.0:1788872916.963959:0:94389:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:3.0:1788872916.963968:0:94389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788872916.964205:0:94389:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 28, last_idx 29 00000040:00080000:3.0:1788872916.964229:0:94389:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788872916.964612:0:94389:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:3.0:1788872916.964616:0:94389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788872916.965494:0:94383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872916.965507:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788872916.965581:0:94383:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788872916.965607:0:94383:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01db6cb 00000100:00080000:2.0:1788872916.965618:0:94383:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788872916.965624:0:94383:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98a8c37f1000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872916.965659:0:94383:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef2df800 x1875765327833088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788872916.965684:0:94383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788872916.965796:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872916.965800:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872916.965802:0:94383:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788872916.965805:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788872916.965808:0:94383:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788872916.965809:0:94383:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788872916.965811:0:94383:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788872916.965812:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788872916.965815:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872916.965824:0:94383:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788872916.965828:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788872916.965832:0:94383:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788872916.965835:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872916.965836:0:94383:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788872916.965839:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788872916.965842:0:94383:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.139@tcp to nid 0x20000c0a8cc8b (192.168.204.139@tcp) 00000020:01000000:2.0:1788872916.965866:0:94383:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788872916.965869:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788872916.965879:0:94383:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98a9e9b099c0) 00000020:00000080:2.0:1788872916.965895:0:94383:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788872916.965900:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788872916.965960:0:94383:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788872916.965965:0:94383:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788872916.965972:0:94383:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe4e6e89fb01db6d9 00010000:00080000:2.0:1788872916.966002:0:94383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9e021b000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:2.0:1788872916.966199:0:94383:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1788872916.966272:0:94383:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788872916.966287:0:94383:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788872916.967085:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327833088:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788872916.967169:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872916.967309:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327833088 00000100:00100000:2.0:1788872916.967319:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327833088 00000100:00100000:2.0:1788872916.967474:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6001 00000100:00100000:2.0:1788872916.967482:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3643:x1875765327833088:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788872916.967512:0:26189:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3854 last 0 00000020:00000080:2.0:1788872916.967542:0:26189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01db6e0 00002000:00100000:2.0:1788872916.967585:0:26189:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98a9e021d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788872916.967590:0:26189:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788872916.967594:0:26189:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788872916.967662:0:26189:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788872916.967696:0:26189:0:(import.c:65:import_set_state_nolock()) ffff98a9e0219000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788872916.967754:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327833088:12345-0@lo:8:llog_process_th.0 Request processed in 271us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872916.967761:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6001 00000040:00080000:2.0:1788872916.967861:0:94383:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000100:00100000:3.0:1788872916.968449:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788872916.968461:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788872916.968469:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788872916.968481:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788872916.968485:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788872916.968509:0:3643:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:3.0:1788872916.968516:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327833088:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788872916.968590:0:94389:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788872916.968644:0:94389:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3854095094387ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788872916.968650:0:94389:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788872916.968883:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327833216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872916.968936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788872916.969638:0:94383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788872916.969667:0:94383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].29, 64 off10048 00000040:00080000:2.0:1788872916.969805:0:94383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x76:0x0].1, 64 off8256 00000100:00100000:3.0:1788872916.970211:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327833216 00000100:00100000:3.0:1788872916.970221:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327833216 00000100:00100000:3.0:1788872916.970996:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:3.0:1788872916.971007:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327833216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788872916.971037:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872916.971107:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327833216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872916.971115:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00100000:3.0:1788872916.971164:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327833216:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788872916.975036:0:94370:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1788872916.975322:0:94391:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:1.0:1788872916.975497:0:94391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788872916.975712:0:94391:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 28, last_idx 29 00000040:00080000:1.0:1788872916.975736:0:94391:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788872916.975865:0:94391:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:1.0:1788872916.975868:0:94391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00000100:00080000:0.0:1788872916.978370:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788872916.983965:0:94383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788872916.983980:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788872916.984028:0:94383:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788872916.984055:0:94383:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01db6e7 00000100:00080000:2.0:1788872916.984068:0:94383:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788872916.984075:0:94383:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98a9e021b000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:2.0:1788872916.984110:0:94383:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ef2ded80 x1875765327833344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872916.984234:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327833344:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788872916.984309:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872916.984424:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327833344 00000100:00100000:1.0:1788872916.984431:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327833344 00000100:00100000:1.0:1788872916.984461:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6002 00000100:00100000:1.0:1788872916.984468:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3643:x1875765327833344:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788872916.984494:0:26191:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3854 last 0 00000020:00000080:1.0:1788872916.984519:0:26191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe4e6e89fb01db6ee 00002000:00100000:1.0:1788872916.984532:0:26191:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98a9dfe94000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788872916.984536:0:26191:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788872916.984539:0:26191:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788872916.984647:0:26191:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788872916.984671:0:26191:0:(import.c:65:import_set_state_nolock()) ffff98a9c5f14800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872916.984724:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3643:x1875765327833344:12345-0@lo:8:llog_process_th.0 Request processed in 255us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872916.984732:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6002 00000100:00100000:3.0:1788872916.984952:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788872916.984961:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788872916.984969:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788872916.984973:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788872916.984975:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e021b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788872916.984987:0:3643:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:3.0:1788872916.984992:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327833344:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788872916.985074:0:94383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000004:00080000:1.0:1788872916.985336:0:94391:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788872916.985392:0:94391:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3854111841877ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788872916.985410:0:94391:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:2.0:1788872916.986249:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872916.986257:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872916.986259:0:94383:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788872916.986266:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872916.986270:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872916.986271:0:94383:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788872916.986274:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788872916.986276:0:94383:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788872916.986278:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872916.986281:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872916.986282:0:94383:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788872916.986284:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872916.986286:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872916.986288:0:94383:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788872916.986302:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788872916.986308:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788872916.986310:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872916.986311:0:94383:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000020:01000000:2.0:1788872916.986314:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788872916.986318:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788872916.986319:0:94383:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:2.0:1788872916.986322:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1788872916.986387:0:94383:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:0.0:1788872916.986583:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788872916.986598:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327833472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872916.986657:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872916.986703:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327833472 00000100:00100000:0.0:1788872916.986709:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327833472 00000100:00100000:0.0:1788872916.986754:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:0.0:1788872916.986763:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327833472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788872916.986787:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872916.986830:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327833472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872916.986837:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00080000:0.0:1788872916.986856:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872916.986887:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327833472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872916.989121:0:94383:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94383:1875765327833600:0@lo:502:llog_process_th.0 00000004:00080000:3.0:1788872916.989349:0:94370:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788872916.989679:0:94383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872916.989769:0:94383:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5ea8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788872916.998340:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327833600 00000100:00100000:1.0:1788872916.998357:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327833600 00000100:00100000:1.0:1788872916.998435:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788872916.998446:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:94383:x1875765327833600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872916.998665:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:94383:x1875765327833600:12345-0@lo:502:llog_process_th.0 Request processed in 221us (8986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872916.998674:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788872916.999361:0:94383:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94383:1875765327833600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788872916.999397:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872916.999416:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872916.999419:0:94383:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:0.0:1788872916.999424:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788872916.999431:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872916.999432:0:94383:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1788872916.999437:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1788872916.999455:0:94383:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1788872917.000390:0:94383:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94383:1875765327833728:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788872917.000512:0:94393:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9fa734000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788872917.000516:0:94393:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9fa734000 4 00000100:00100000:2.0:1788872917.000730:0:94383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.000770:0:94383:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5ea89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872917.000824:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327833728 00000100:00100000:1.0:1788872917.000831:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327833728 00000100:00100000:1.0:1788872917.000874:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788872917.000884:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:94383:x1875765327833728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872917.000999:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:94383:x1875765327833728:12345-0@lo:502:llog_process_th.0 Request processed in 116us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872917.001006:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788872917.001097:0:94383:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94383:1875765327833728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788872917.001124:0:94383:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788872917.001131:0:94383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788872917.001133:0:94383:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1788872917.001151:0:94383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:1.0:1788872917.001618:0:94369:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:1.0:1788872917.001646:0:94369:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788872917.001670:0:94369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db63f expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.001681:0:94369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db63f expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872917.001688:0:94369:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9fa734000 from 1 10000000:01000000:1.0:1788872917.001691:0:94369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788872917.001721:0:94369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.001728:0:94369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.001738:0:94369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872917.001765:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327833856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788872917.001800:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.001826:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.001937:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327833856 00000100:00100000:2.0:1788872917.001943:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327833856 00000100:00100000:2.0:1788872917.001979:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788872917.001988:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:94369:x1875765327833856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872917.001997:0:94382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872917.002012:0:94382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db6fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db6f5 expref: -99 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.002034:0:94382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db6f5 expref: 9 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.002045:0:94382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db6f5 expref: 9 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.002054:0:94382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa898400, rc 0) 00000100:00100000:2.0:1788872917.002699:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:94369:x1875765327833856:12345-0@lo:101:mount.lustre.0 Request processed in 709us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.002707:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788872917.006686:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327833856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872917.006718:0:94369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db6fc expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.006731:0:94369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db6fc expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.014137:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327833984:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788872917.014230:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.014373:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5ea80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872917.015269:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327833984 00000100:00100000:0.0:1788872917.015281:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327833984 00000100:00100000:0.0:1788872917.015380:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788872917.015392:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:94369:x1875765327833984:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788872917.015525:0:94375:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788872917.015657:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788872917.015663:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788872917.015666:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788872917.015668:0:94375:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 126 00000100:00100000:0.0:1788872917.015805:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:94369:x1875765327833984:12345-0@lo:256:mount.lustre.0 Request processed in 415us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872917.015814:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788872917.015891:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327833984:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788872917.016523:0:94369:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788872917.016579:0:94369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db6fc expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.016592:0:94369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db6fc expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872917.016601:0:94369:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9fa734000 from 1 10000000:01000000:2.0:1788872917.016604:0:94369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788872917.016640:0:94369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899600/0xe4e6e89fb01db703 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.016649:0:94369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa899600/0xe4e6e89fb01db703 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.016659:0:94369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa899600/0xe4e6e89fb01db703 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.016681:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327834112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788872917.016717:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.026604:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5ea80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872917.026782:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327834112 00000100:00100000:1.0:1788872917.026794:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327834112 00000100:00100000:1.0:1788872917.026856:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788872917.026866:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:94369:x1875765327834112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872917.026881:0:94376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872917.026900:0:94376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db70a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db703 expref: -99 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.026930:0:94376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db70a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db703 expref: 10 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.026942:0:94376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db70a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db703 expref: 10 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.026951:0:94376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d800, rc 0) 00000100:00100000:1.0:1788872917.027009:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:94369:x1875765327834112:12345-0@lo:101:mount.lustre.0 Request processed in 144us (10290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872917.027016:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788872917.029267:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327834112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872917.029303:0:94369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa899600/0xe4e6e89fb01db703 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db70a expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.029319:0:94369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa899600/0xe4e6e89fb01db703 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db70a expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.029435:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327834240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872917.029488:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.029536:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5ea80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872917.030068:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327834240 00000100:00100000:1.0:1788872917.030074:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327834240 00000100:00100000:1.0:1788872917.030122:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788872917.030131:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:94369:x1875765327834240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788872917.030268:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:94369:x1875765327834240:12345-0@lo:501:mount.lustre.0 Request processed in 137us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872917.030292:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788872917.030687:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327834240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872917.030730:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327834368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872917.030774:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.030799:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327834368 00000100:00100000:2.0:1788872917.030803:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327834368 00000100:00100000:2.0:1788872917.030831:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788872917.030838:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:94369:x1875765327834368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872917.030915:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:94369:x1875765327834368:12345-0@lo:503:mount.lustre.0 Request processed in 77us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.030923:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788872917.030965:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5ea80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.030977:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327834368:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872917.038245:0:94394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94394:1875765327834496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872917.038337:0:94394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872917.038390:0:94394:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f68c7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.038527:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327834496 00000100:00100000:2.0:1788872917.038534:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327834496 00000100:00100000:2.0:1788872917.038607:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788872917.038617:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:94394:x1875765327834496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872917.041824:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:94394:x1875765327834496:12345-0@lo:502:llog_process_th.0 Request processed in 3199us (3478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.041840:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788872917.047476:0:94394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94394:1875765327834496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872917.047529:0:94394:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788872917.047581:0:94394:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872917.047584:0:94394:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788872917.047596:0:94394:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a9fa734000 00000020:00000080:1.0:1788872917.047600:0:94394:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788872917.047609:0:94394:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872917.047612:0:94394:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872917.047614:0:94394:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788872917.047617:0:94394:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788872917.047620:0:94394:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872917.047622:0:94394:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788872917.047626:0:94394:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a9fa734000 00000020:00000080:1.0:1788872917.047629:0:94394:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788872917.047729:0:94394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94394:1875765327834624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872917.047804:0:94394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.047840:0:94394:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.047979:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327834624 00000100:00100000:2.0:1788872917.047987:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327834624 00000100:00100000:2.0:1788872917.048045:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788872917.048055:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:94394:x1875765327834624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872917.048205:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:94394:x1875765327834624:12345-0@lo:502:llog_process_th.0 Request processed in 151us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.048213:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788872917.048511:0:94394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94394:1875765327834624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872917.048534:0:94394:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872917.048538:0:94394:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872917.048540:0:94394:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788872917.048577:0:94394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788872917.048743:0:94369:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788872917.048770:0:94369:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788872917.048792:0:94369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899600/0xe4e6e89fb01db703 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db70a expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.048803:0:94369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa899600/0xe4e6e89fb01db703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db70a expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872917.048852:0:94369:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788872917.048855:0:94369:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98a9fa734000 10000000:01000000:2.0:1788872917.048858:0:94369:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98a9fa734000 10000000:01000000:2.0:1788872917.048862:0:94369:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788872917.048868:0:94369:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9fa734000 from 1 10000000:01000000:2.0:1788872917.048870:0:94369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788872917.048897:0:94369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.048905:0:94369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.048915:0:94369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.048941:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327834752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788872917.048971:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.048999:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5ea8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.049014:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327834752 00000100:00100000:2.0:1788872917.049018:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327834752 00000100:00100000:2.0:1788872917.049050:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788872917.049057:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:94369:x1875765327834752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872917.049066:0:94376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872917.049077:0:94376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa899c00/0xe4e6e89fb01db718 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db711 expref: -99 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.049096:0:94376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa899c00/0xe4e6e89fb01db718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db711 expref: 11 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.049106:0:94376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa899c00/0xe4e6e89fb01db718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db711 expref: 11 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.049114:0:94376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899c00, rc 0) 00000100:00100000:2.0:1788872917.049157:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94369:x1875765327834752:12345-0@lo:101:mount.lustre.0 Request processed in 101us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.049163:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788872917.049201:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327834752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788872917.049214:0:94369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db718 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.049222:0:94369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db718 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.049276:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327834880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872917.049301:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.049312:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5ea8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.049336:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327834880 00000100:00100000:2.0:1788872917.049340:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327834880 00000100:00100000:2.0:1788872917.049367:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788872917.049373:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94369:x1875765327834880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872917.049693:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94369:x1875765327834880:12345-0@lo:501:mount.lustre.0 Request processed in 319us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.049700:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788872917.049733:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327834880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788872917.049760:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327835008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872917.049793:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.049813:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327835008 00000100:00100000:2.0:1788872917.049817:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327835008 00000100:00100000:2.0:1788872917.049836:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788872917.049841:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94369:x1875765327835008:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788872917.049906:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94369:x1875765327835008:12345-0@lo:503:mount.lustre.0 Request processed in 64us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.049913:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788872917.049950:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f5ea8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.049962:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327835008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788872917.056842:0:94395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94395:1875765327835136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872917.056933:0:94395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872917.056980:0:94395:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef8a0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.057101:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327835136 00000100:00100000:2.0:1788872917.057117:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327835136 00000100:00100000:0.0:1788872917.057268:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788872917.057277:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94395:x1875765327835136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872917.057425:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94395:x1875765327835136:12345-0@lo:502:llog_process_th.0 Request processed in 148us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872917.057443:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788872917.057668:0:94395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94395:1875765327835136:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788872917.057728:0:94395:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788872917.057743:0:94395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98a9f6713380) 00000020:00000080:1.0:1788872917.057777:0:94395:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788872917.057949:0:94395:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9fa734000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788872917.057959:0:94395:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9fa734000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788872917.057962:0:94395:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9fa734000 4 00010000:00080000:1.0:1788872917.057992:0:94395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a8ca9bc000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.139@tcp at head 00010000:00010000:1.0:1788872917.066840:0:94395:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1788872917.066954:0:94395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788872917.067000:0:94395:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788872917.067015:0:94395:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe4e6e89fb01db726 00000100:00080000:1.0:1788872917.067027:0:94395:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788872917.067033:0:94395:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98a8ca9bc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872917.067068:0:94395:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c273ce00 x1875765327835264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872917.067100:0:94395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788872917.070042:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327835264:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788872917.070124:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.071393:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327835264 00000100:00100000:1.0:1788872917.072847:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327835264 00000100:00100000:1.0:1788872917.072890:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:1.0:1788872917.072906:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327835264:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788872917.077114:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875765327835264:12345-0@lo:38:llog_process_th.0 Request processed in 4210us (6984us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788872917.077128:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:1.0:1788872917.077341:0:94395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94395:1875765327835392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872917.077421:0:94395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.077465:0:94395:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.078292:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327835392 00000100:00100000:2.0:1788872917.078303:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327835392 00000100:00100000:2.0:1788872917.078366:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788872917.078376:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94395:x1875765327835392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872917.078523:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94395:x1875765327835392:12345-0@lo:502:llog_process_th.0 Request processed in 148us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.078531:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788872917.079578:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788872917.079590:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8ca9bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872917.079595:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788872917.079599:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327835264:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788872917.080348:0:94395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94395:1875765327835392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872917.080431:0:94395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94395:1875765327835520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872917.080499:0:94395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.080539:0:94395:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872917.080872:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327835520 00000100:00100000:0.0:1788872917.080878:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327835520 00000100:00100000:0.0:1788872917.080931:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788872917.080941:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94395:x1875765327835520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872917.081061:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94395:x1875765327835520:12345-0@lo:502:llog_process_th.0 Request processed in 121us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872917.081069:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788872917.082105:0:94395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94395:1875765327835520:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788872917.082150:0:94395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1788872917.082260:0:94369:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:0.0:1788872917.082286:0:94369:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788872917.082308:0:94369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db718 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.082319:0:94369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db718 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788872917.082385:0:94369:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788872917.082387:0:94369:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788872917.082388:0:94369:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872917.082390:0:94369:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872917.082391:0:94369:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872917.082392:0:94369:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872917.082393:0:94369:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872917.082395:0:94369:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788872917.082397:0:94369:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872917.082398:0:94369:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788872917.082413:0:94369:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788872917.082415:0:94369:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788872917.082416:0:94369:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788872917.082418:0:94369:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872917.082419:0:94369:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872917.082426:0:94369:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872917.082427:0:94369:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872917.082428:0:94369:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788872917.082429:0:94369:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788872917.082429:0:94369:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872917.082430:0:94369:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788872917.082452:0:94369:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788872917.082466:0:94369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327835648:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788872917.082508:0:94369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872917.082573:0:94369:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef8a0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.083189:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327835648 00000100:00100000:3.0:1788872917.083196:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327835648 00000100:00100000:3.0:1788872917.083246:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788872917.083254:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94369:x1875765327835648:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788872917.083281:0:94376:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788872917.083451:0:94376:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788872917.096420:0:94376:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788872917.096450:0:94376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788872917.096664:0:94378:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788872917.096670:0:94378:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788872917.096692:0:94378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.096712:0:94378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db6fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db6f5 expref: 11 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.096719:0:94378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.096760:0:94378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db6f5 expref: 11 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.096774:0:94378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db6fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db6f5 expref: 11 pid: 94382 timeout: 3954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872917.096790:0:94378:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94378:1875765327835776:0@lo:104: 00000100:00100000:0.0:1788872917.096858:0:94378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872917.096903:0:94378:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef8a0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.097053:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327835776 00000100:00100000:3.0:1788872917.097061:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327835776 00000100:00100000:3.0:1788872917.097106:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788872917.097115:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:94378:x1875765327835776:12345-0@lo:104: 00010000:00010000:3.0:1788872917.097129:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db6fc expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097198:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788872917.097205:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:94378:x1875765327835776:12345-0@lo:104: Request processed in 91us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.097213:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00010000:3.0:1788872917.097236:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872917.097242:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db6fc expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097252:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872917.097257:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db6fc expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097267:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db6fc expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872917.097276:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db6fc expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872917.097282:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788872917.097311:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db6fc expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097350:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872917.097372:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db6fc expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097380:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db6f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db6fc expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097396:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872917.097399:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872917.097400:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872917.097409:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872917.097422:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327835904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872917.097454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872917.097492:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327835904 00000100:00100000:3.0:1788872917.097496:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327835904 00010000:00010000:3.0:1788872917.097512:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db6fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db6f5 expref: 12 pid: 94382 timeout: 3954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872917.097536:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1788872917.097575:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:3646:x1875765327835904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872917.097589:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872917.097596:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db6fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db6f5 expref: 12 pid: 94382 timeout: 3954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097607:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db6fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db6f5 expref: 12 pid: 94382 timeout: 3954 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097625:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097641:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788872917.097656:0:7929:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011559702s 00010000:00010000:3.0:1788872917.097661:0:7929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097669:0:7929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097677:0:7929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097685:0:7929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097691:0:7929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52afa00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872917.097696:0:7929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097705:0:7929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097714:0:7929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.097725:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872917.097755:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:3646:x1875765327835904:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.097763:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1788872917.097813:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327835904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872917.098158:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:94369:x1875765327835648:12345-0@lo:253:mount.lustre.0 Request processed in 14903us (15648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872917.098168:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1788872917.098229:0:94378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa898400/0xe4e6e89fb01db6fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db6f5 expref: 10 pid: 94382 timeout: 3954 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872917.098240:0:94378:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94378:1875765327835776:0@lo:104: 00010000:00010000:0.0:1788872917.098255:0:94378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.098264:0:94378:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.098271:0:94378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.098278:0:94378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db72d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872917.098439:0:94369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:94369:1875765327835648:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788872917.098451:0:94369:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788872917.098455:0:94369:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788872917.098457:0:94369:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788872917.098458:0:94369:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872917.098460:0:94369:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872917.098462:0:94369:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872917.098463:0:94369:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872917.098464:0:94369:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788872917.098466:0:94369:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788872917.098468:0:94369:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872917.098470:0:94369:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788872917.098482:0:94369:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1788872917.124752:0:94369:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411353 00000040:01000000:1.0:1788872917.127983:0:94369:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788872917.128071:0:94402:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411353 00000020:00080000:2.0:1788872917.128076:0:94402:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411353 00000040:01000000:1.0:1788872917.128805:0:94403:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788872917.129181:0:94369:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788872917.129715:0:94403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788872917.130523:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94404:1875765327836032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872917.130659:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.130688:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f549f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.130827:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327836032 00000100:00100000:3.0:1788872917.130836:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327836032 00000100:00100000:3.0:1788872917.130882:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:3.0:1788872917.130891:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fbfc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94404:x1875765327836032:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788872917.130985:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fbfc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94404:x1875765327836032:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.130993:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:2.0:1788872917.131344:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94404:1875765327836032:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788872917.131378:0:94404:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788872917.131408:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94404:1875765327836160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872917.131445:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.131470:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f549f840 going to sleep for 11 seconds 00000040:01000000:0.0:1788872917.133075:0:94369:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788872917.133118:0:94369:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788872917.133271:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327836160 00000100:00100000:3.0:1788872917.133280:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327836160 00000100:00100000:3.0:1788872917.133352:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:3.0:1788872917.133364:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94404:x1875765327836160:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788872917.133575:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94404:x1875765327836160:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 178us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.133584:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00100000:2.0:1788872917.134469:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94404:1875765327836160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872917.134608:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94404:1875765327836288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788872917.134650:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.134677:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f549f840 going to sleep for 11 seconds 00000004:00000080:0.0:1788872917.135106:0:94369:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788872917.135121:0:94369:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788872917.139915:0:94369:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788872917.140663:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327836288 00000100:00100000:3.0:1788872917.140677:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327836288 00000100:00100000:3.0:1788872917.140740:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:3.0:1788872917.140751:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94404:x1875765327836288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788872917.140886:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94404:x1875765327836288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 138us (6235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.140894:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:3.0:1788872917.140950:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94404:1875765327836288:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788872917.141021:0:94404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788872917.144988:0:94369:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788872917.151974:0:94403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788872917.152091:0:94403:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788872917.152713:0:94369:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788872917.152774:0:94369:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788872917.152922:0:94369:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788872917.153965:0:94369:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (8/32) registered 00000040:00080000:3.0:1788872917.157479:0:94404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788872917.157603:0:94404:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788872917.157622:0:94404:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1788872917.162892:0:94369:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 120259084298 00010000:00080000:2.0:1788872917.164640:0:94405:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 94405 00010000:02000000:2.0:1788872917.164656:0:94405:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1788872917.164660:0:94405:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1788872917.164676:0:94405:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1788872917.165165:0:94369:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788872917.165197:0:94369:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788872917.165235:0:94369:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788872917.165256:0:94369:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788872917.166273:0:94369:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788872917.166597:0:94369:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788872917.304717:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788872917.752636:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788872917.752647:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9fa734000 from 127 10000000:01000000:1.0:1788872917.752654:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788872917.752714:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.752728:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.752742:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872917.752774:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327836416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872917.752858:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.752935:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7436a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.753448:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327836416 00000100:00100000:2.0:1788872917.753459:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327836416 00000100:00100000:2.0:1788872917.753526:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788872917.753547:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+10:6517:x1875765327836416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872917.753662:0:94382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872917.753680:0:94382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db73b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db734 expref: -99 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.753711:0:94382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db73b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db734 expref: 11 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.753723:0:94382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db73b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db734 expref: 11 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.753735:0:94382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899a00, rc 0) 00000100:00100000:2.0:1788872917.755859:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327836416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2306us (2993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.755872:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788872917.764843:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327836416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872917.764885:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db73b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.764902:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db73b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.765079:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327836544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.765155:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.765209:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f549ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872917.765283:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327836544 00000100:00100000:1.0:1788872917.765291:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327836544 00000100:00100000:1.0:1788872917.765356:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788872917.765366:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327836544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788872917.765388:0:94381:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788872917.765405:0:94381:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788872917.765409:0:94381:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 127 00000100:00100000:1.0:1788872917.765505:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327836544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872917.765513:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788872917.765892:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327836544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788872917.765944:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788872917.765953:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db73b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.765963:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db73b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872917.765973:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788872917.765976:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9d0cfb000 from 58 10000000:01000000:3.0:1788872917.765978:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788872917.766004:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.766011:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.766020:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872917.766035:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327836672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.766069:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872917.766103:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56b1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.766162:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327836672 00000100:00100000:2.0:1788872917.766166:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327836672 00000100:00100000:2.0:1788872917.766199:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788872917.766206:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+11:6517:x1875765327836672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872917.766216:0:94377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872917.766230:0:94377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db749 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db742 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.766256:0:94377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db742 expref: 12 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.766266:0:94377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db742 expref: 12 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.766275:0:94377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa898000, rc 0) 00000100:00100000:2.0:1788872917.766302:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327836672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.766317:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788872917.766422:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327836672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872917.766433:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db749 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.766441:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db749 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872917.766494:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327836800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.766515:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872917.766546:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56b1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.766737:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327836800 00000100:00100000:2.0:1788872917.766741:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327836800 00000100:00100000:2.0:1788872917.766774:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788872917.766780:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327836800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.766887:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327836800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.766894:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788872917.767852:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327836800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.767905:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327836928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.767961:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872917.767999:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56b1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.768108:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327836928 00000100:00100000:2.0:1788872917.768114:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327836928 00000100:00100000:2.0:1788872917.768154:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788872917.768161:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327836928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.768269:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327836928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.768277:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788872917.768416:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327836928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872917.769122:0:94424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1788872917.769192:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1788872917.769219:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788872917.769230:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db749 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.769242:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db749 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872917.769250:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788872917.769252:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9d0cfb000 from 124 10000000:01000000:1.0:1788872917.769255:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788872917.769286:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.769294:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.771846:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872917.771884:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872917.771962:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.772007:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7436e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.772112:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327837056 00000100:00100000:2.0:1788872917.772120:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327837056 00000100:00100000:2.0:1788872917.772183:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788872917.772192:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+12:6517:x1875765327837056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872917.772207:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872917.772224:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db750 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.772252:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db750 expref: 13 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.772265:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db750 expref: 13 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.772276:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa898200, rc 0) 00000100:00100000:2.0:1788872917.772335:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327837056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.772342:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788872917.772726:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872917.772743:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db757 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.772753:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db757 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872917.772815:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788872917.772848:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.772920:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7436e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.780730:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327837184 00000100:00100000:3.0:1788872917.780748:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327837184 00000100:00100000:2.0:1788872917.780890:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788872917.780902:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327837184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788872917.780928:0:94381:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788872917.780950:0:94381:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788872917.780954:0:94381:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788872917.780958:0:94381:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788872917.780962:0:94381:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788872917.780964:0:94381:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 127 00000100:00100000:2.0:1788872917.781125:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327837184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 225us (8275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.781134:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788872917.781443:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788872917.781544:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788872917.783677:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db757 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.783692:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db757 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872917.783702:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788872917.783706:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:1.0:1788872917.783724:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788872917.783764:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.783773:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.783784:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872917.783811:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872917.783876:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.783923:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7436e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.784042:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327837312 00000100:00100000:3.0:1788872917.784050:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327837312 00000100:00100000:3.0:1788872917.784101:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788872917.784111:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+13:6517:x1875765327837312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872917.784126:0:94382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872917.784140:0:94382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01db765 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db75e expref: -99 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.784165:0:94382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01db765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db75e expref: 14 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.784182:0:94382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01db765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db75e expref: 14 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.784190:0:94382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4c00, rc 0) 00000100:00100000:3.0:1788872917.784237:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327837312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.784244:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788872917.784381:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872917.784396:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.784406:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872917.784465:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872917.784493:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.784524:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7436e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872917.784621:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327837440 00000100:00100000:0.0:1788872917.784626:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327837440 00000100:00100000:0.0:1788872917.784659:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788872917.784667:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327837440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872917.784817:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327837440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872917.784824:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788872917.785275:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.785323:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.785373:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872917.785401:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56b1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872917.785494:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327837568 00000100:00100000:0.0:1788872917.785499:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327837568 00000100:00100000:0.0:1788872917.785543:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788872917.785584:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327837568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872917.785691:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327837568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872917.785698:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788872917.785842:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872917.786843:0:94425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:2.0:1788872917.797309:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:2.0:1788872917.797383:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788872917.797395:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.797408:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872917.797419:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1788872917.797422:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98a9d0cfb000 from 1 10000000:01000000:2.0:1788872917.797425:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788872917.797465:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db76c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.797473:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db76c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.797485:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db76c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.797513:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.798159:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.798204:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618900 going to sleep for 11 seconds 00000100:00100000:0.0:1788872917.798261:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327837696 00000100:00100000:0.0:1788872917.798269:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327837696 00000100:00100000:0.0:1788872917.798326:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788872917.798336:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+14:6517:x1875765327837696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872917.798352:0:94376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872917.798366:0:94376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52af800/0xe4e6e89fb01db773 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db76c expref: -99 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.798394:0:94376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52af800/0xe4e6e89fb01db773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db76c expref: 15 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.798405:0:94376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52af800/0xe4e6e89fb01db773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db76c expref: 15 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.798426:0:94376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af800, rc 0) 00000100:00100000:0.0:1788872917.798478:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327837696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872917.798486:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788872917.799285:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872917.799306:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db76c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.799327:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db76c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872917.799347:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788872917.799362:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db76c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.799369:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa898600/0xe4e6e89fb01db76c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872917.799377:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788872917.799379:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9d0cfb000 from 7 10000000:01000000:2.0:1788872917.799382:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788872917.799404:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899800/0xe4e6e89fb01db77a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.799411:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa899800/0xe4e6e89fb01db77a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.799419:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa899800/0xe4e6e89fb01db77a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.799437:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.799472:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.799507:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618900 going to sleep for 11 seconds 00000100:00100000:1.0:1788872917.799591:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327837824 00000100:00100000:1.0:1788872917.799596:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327837824 00000100:00100000:1.0:1788872917.799639:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788872917.799653:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327837824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872917.799664:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872917.799674:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db781 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db77a expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.799689:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db77a expref: 16 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.799696:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db77a expref: 16 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.799703:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c200, rc 0) 00000100:00100000:1.0:1788872917.799738:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327837824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872917.799744:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788872917.800196:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872917.800209:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa899800/0xe4e6e89fb01db77a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.800218:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa899800/0xe4e6e89fb01db77a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.800282:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.800321:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.800352:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618900 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.800410:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327837952 00000100:00100000:3.0:1788872917.800415:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327837952 00000100:00100000:3.0:1788872917.800439:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788872917.800445:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327837952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.800615:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327837952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.800623:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788872917.800838:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327837952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.800866:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.800905:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.800927:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618900 going to sleep for 11 seconds 00000100:00100000:0.0:1788872917.800977:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327838080 00000100:00100000:0.0:1788872917.800982:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327838080 00000100:00100000:0.0:1788872917.801028:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788872917.801035:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327838080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872917.801120:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327838080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872917.801127:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788872917.801332:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872917.803231:0:94426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788872917.809947:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788872917.809987:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788872917.809999:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899800/0xe4e6e89fb01db77a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.810013:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa899800/0xe4e6e89fb01db77a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872917.810024:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788872917.810026:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff5b1000 from 58 10000000:01000000:2.0:1788872917.810029:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788872917.810076:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.810084:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.810095:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.810123:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.810189:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.810242:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c36180c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872917.810402:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327838208 00000100:00100000:0.0:1788872917.810410:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327838208 00000100:00100000:0.0:1788872917.810624:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788872917.810635:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327838208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872917.810649:0:94377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872917.810670:0:94377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db78f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db788 expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.810691:0:94377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db788 expref: 17 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.810701:0:94377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db788 expref: 17 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.810710:0:94377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52afa00, rc 0) 00000100:00100000:0.0:1788872917.810765:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327838208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872917.810772:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788872917.810861:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872917.810875:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.810884:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.810935:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.810958:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.811515:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c36180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.812080:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327838336 00000100:00100000:3.0:1788872917.812088:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327838336 00000100:00100000:3.0:1788872917.812171:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788872917.812179:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327838336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.812362:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327838336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.812369:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788872917.812616:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.812672:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.812721:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.812949:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c36180c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.815395:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327838464 00000100:00100000:2.0:1788872917.815410:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327838464 00000100:00100000:2.0:1788872917.815484:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788872917.815494:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327838464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.815860:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327838464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 368us (3137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.815868:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788872917.815937:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788872917.817178:0:94427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:2.0:1788872917.817249:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:2.0:1788872917.817269:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788872917.817490:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.817503:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872917.817514:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788872917.817517:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788872917.817519:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788872917.817602:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.817611:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.817621:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.817646:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.817707:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.817826:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.817845:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327838592 00000100:00100000:2.0:1788872917.817851:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327838592 00000100:00100000:2.0:1788872917.817890:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788872917.817898:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327838592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872917.817911:0:94381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872917.817925:0:94381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa898a00/0xe4e6e89fb01db79d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db796 expref: -99 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.817950:0:94381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa898a00/0xe4e6e89fb01db79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db796 expref: 18 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.817970:0:94381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa898a00/0xe4e6e89fb01db79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db796 expref: 18 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.817978:0:94381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa898a00, rc 0) 00000100:00100000:2.0:1788872917.818016:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327838592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.818023:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788872917.818071:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872917.818083:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db79d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.818092:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db79d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.818142:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.818165:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.818180:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.818190:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327838720 00000100:00100000:2.0:1788872917.818193:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327838720 00000100:00100000:2.0:1788872917.818213:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788872917.818219:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327838720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.818451:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327838720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.818458:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788872917.818490:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.818525:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.818613:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.818632:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.818643:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327838848 00000100:00100000:2.0:1788872917.818646:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327838848 00000100:00100000:2.0:1788872917.818666:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788872917.818673:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327838848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.823040:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327838848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4353us (4413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.823056:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788872917.824647:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788872917.830059:0:94428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788872917.830600:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788872917.830630:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788872917.830642:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db79d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.830656:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db79d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872917.830665:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788872917.830668:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ff5b1000 from 7 10000000:01000000:3.0:1788872917.830671:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788872917.830712:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5000/0xe4e6e89fb01db7a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.830719:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9efac5000/0xe4e6e89fb01db7a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.830739:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9efac5000/0xe4e6e89fb01db7a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872917.830767:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.830840:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872917.830886:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56b1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788872917.831032:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327838976 00000100:00100000:2.0:1788872917.831039:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327838976 00000100:00100000:2.0:1788872917.831094:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788872917.831104:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327838976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872917.831118:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872917.831131:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa899e00/0xe4e6e89fb01db7ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db7a4 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.831156:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa899e00/0xe4e6e89fb01db7ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7a4 expref: 19 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.831167:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa899e00/0xe4e6e89fb01db7ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7a4 expref: 19 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.831175:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899e00, rc 0) 00000100:00100000:2.0:1788872917.831213:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327838976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872917.831236:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788872917.831375:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327838976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872917.831398:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9efac5000/0xe4e6e89fb01db7a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.831408:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9efac5000/0xe4e6e89fb01db7a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db7ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872917.831462:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.831487:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872917.831516:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56b1840 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.831539:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327839104 00000100:00100000:3.0:1788872917.831543:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327839104 00000100:00100000:3.0:1788872917.831748:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788872917.831756:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327839104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.831860:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327839104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.831867:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788872917.832543:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.834388:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.834463:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872917.834501:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56b1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788872917.834582:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327839232 00000100:00100000:0.0:1788872917.834590:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327839232 00000100:00100000:0.0:1788872917.834643:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788872917.834653:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327839232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872917.834894:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327839232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872917.834902:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788872917.835791:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872917.845929:0:94430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788872917.846174:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788872917.846206:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788872917.846220:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9efac5000/0xe4e6e89fb01db7a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.846233:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9efac5000/0xe4e6e89fb01db7a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872917.846242:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788872917.846245:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ef97c000 from 58 10000000:01000000:1.0:1788872917.846249:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788872917.846302:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.846310:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.846328:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872917.846354:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872917.846423:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.846471:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7436e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.847072:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327839360 00000100:00100000:3.0:1788872917.847082:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327839360 00000100:00100000:3.0:1788872917.847132:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788872917.847141:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327839360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872917.847160:0:94382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872917.847174:0:94382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac4a00/0xe4e6e89fb01db7b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db7b2 expref: -99 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.847198:0:94382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac4a00/0xe4e6e89fb01db7b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7b2 expref: 20 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.847210:0:94382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac4a00/0xe4e6e89fb01db7b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7b2 expref: 20 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.847219:0:94382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4a00, rc 0) 00000100:00100000:3.0:1788872917.847263:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327839360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.847270:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788872917.847413:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872917.847427:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.847435:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db7b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872917.847493:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872917.847523:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.847578:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7436e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.847717:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327839488 00000100:00100000:3.0:1788872917.847722:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327839488 00000100:00100000:3.0:1788872917.847830:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788872917.847837:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327839488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.849098:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327839488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1257us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.849108:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788872917.849845:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872917.849901:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872917.849968:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872917.850009:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c55810c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872917.850055:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327839616 00000100:00100000:1.0:1788872917.850061:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327839616 00000100:00100000:1.0:1788872917.850108:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788872917.850116:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327839616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872917.850220:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327839616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872917.850227:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788872917.850384:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788872917.851471:0:94431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1788872917.851887:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1788872917.851925:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788872917.851936:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.851959:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872917.851971:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788872917.851973:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788872917.851976:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788872917.852007:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.852016:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.852026:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872917.852046:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872917.852091:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872917.852115:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7436180 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.852416:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327839744 00000100:00100000:3.0:1788872917.852422:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327839744 00000100:00100000:3.0:1788872917.852475:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788872917.852484:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327839744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872917.852496:0:94376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872917.852510:0:94376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db7c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db7c0 expref: -99 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.852579:0:94376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7c0 expref: 21 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.852713:0:94376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7c0 expref: 21 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.852723:0:94376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4600, rc 0) 00000100:00100000:3.0:1788872917.852840:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327839744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 356us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.852847:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788872917.852939:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872917.852954:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.852963:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db7c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872917.853021:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872917.853048:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872917.853085:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c55810c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872917.853140:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327839872 00000100:00100000:1.0:1788872917.853145:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327839872 00000100:00100000:1.0:1788872917.853180:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788872917.853188:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327839872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872917.853383:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327839872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872917.853391:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788872917.853578:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327839872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872917.853690:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872917.853799:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872917.853822:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c55810c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.853863:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327840000 00000100:00100000:3.0:1788872917.853867:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327840000 00000100:00100000:3.0:1788872917.853896:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788872917.853903:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327840000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.859180:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327840000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5266us (5440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.859196:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788872917.859382:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788872917.860859:0:94432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1788872917.865170:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788872917.865218:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788872917.865231:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.865245:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872917.865254:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788872917.865256:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9ef97c000 from 7 10000000:01000000:2.0:1788872917.865259:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788872917.865876:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.865888:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.865900:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.865929:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.866081:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.866131:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7119240 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.866140:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327840128 00000100:00100000:3.0:1788872917.866148:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327840128 00000100:00100000:3.0:1788872917.866203:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788872917.866213:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327840128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872917.866227:0:94377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872917.866241:0:94377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac5400/0xe4e6e89fb01db7d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db7ce expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.866266:0:94377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac5400/0xe4e6e89fb01db7d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7ce expref: 22 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.866287:0:94377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac5400/0xe4e6e89fb01db7d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7ce expref: 22 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.866296:0:94377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5400, rc 0) 00000100:00100000:3.0:1788872917.866355:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327840128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.866362:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788872917.866406:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872917.866419:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.866429:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872917.866484:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.866509:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872917.866541:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56b1840 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.866584:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327840256 00000100:00100000:3.0:1788872917.866588:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327840256 00000100:00100000:3.0:1788872917.866613:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788872917.866619:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327840256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.866736:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327840256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.866744:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788872917.866777:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.866815:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.866853:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872917.866867:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618540 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.866880:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327840384 00000100:00100000:3.0:1788872917.866884:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327840384 00000100:00100000:3.0:1788872917.866907:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788872917.866912:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327840384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872917.866987:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327840384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.866994:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788872917.867048:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a48700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872917.872423:0:94434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788872917.872715:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788872917.872740:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788872917.872753:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.872777:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872917.872786:0:6517:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788872917.872789:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98a9e9b999c0 from 1 10000000:01000000:2.0:1788872917.872792:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788872917.872832:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899200/0xe4e6e89fb01db7dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.872840:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa899200/0xe4e6e89fb01db7dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.872851:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa899200/0xe4e6e89fb01db7dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.872878:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.872947:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.872984:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7119cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872917.873000:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327840512 00000100:00100000:0.0:1788872917.873007:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327840512 00000100:00100000:0.0:1788872917.873060:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788872917.873070:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327840512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872917.873084:0:94381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872917.873098:0:94381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db7e3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db7dc expref: -99 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.873121:0:94381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db7e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7dc expref: 23 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.873132:0:94381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52aea00/0xe4e6e89fb01db7e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7dc expref: 23 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872917.873140:0:94381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52aea00, rc 0) 00000100:00100000:0.0:1788872917.873189:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327840512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872917.873196:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788872917.873537:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872917.873584:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa899200/0xe4e6e89fb01db7dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.873594:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa899200/0xe4e6e89fb01db7dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db7e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872917.873612:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788872917.873617:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899200/0xe4e6e89fb01db7dc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.873669:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa899200/0xe4e6e89fb01db7dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872917.873678:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788872917.873680:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98a9e9b999c0 from 1 10000000:01000000:2.0:1788872917.873682:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788872917.873700:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.873707:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.873714:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.873732:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.873761:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.873784:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7119cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872917.873847:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327840640 00000100:00100000:3.0:1788872917.873851:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327840640 00000100:00100000:3.0:1788872917.873883:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788872917.873890:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327840640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872917.873898:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872917.873907:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01db7f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01db7ea expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.873921:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01db7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7ea expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.873929:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01db7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7ea expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.873935:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4000, rc 0) 00000100:00100000:3.0:1788872917.873981:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327840640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.873991:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788872917.874093:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872917.874107:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872917.874114:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db7f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872917.874156:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872917.874178:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872917.874205:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7119cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872917.874264:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327840768 00000100:00100000:0.0:1788872917.874268:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327840768 00000100:00100000:0.0:1788872917.874372:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788872917.874379:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327840768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872917.874566:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327840768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (283us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788872917.874580:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788872917.875734:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327840768:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788872917.875772:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788872917.875780:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872917.875789:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872917.897389:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872917.897508:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311228160 00000100:00100000:3.0:1788872917.897519:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311228160 00000100:00100000:3.0:1788872917.897606:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 73 00000100:00100000:3.0:1788872917.897616:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311228160:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872917.897633:0:94376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872917.897651:0:94376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9efac4200/0xe4e6e89fb01db7f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1eb expref: -99 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.897693:0:94376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9efac4200/0xe4e6e89fb01db7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1eb expref: 10 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.897705:0:94376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9efac4200/0xe4e6e89fb01db7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1eb expref: 10 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872917.897713:0:94376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4200, rc 0) 00000100:00100000:3.0:1788872917.897771:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311228160:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 155us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.897777:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 73 00000100:00100000:0.0:1788872917.904651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872917.904739:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311228288 00000100:00100000:3.0:1788872917.904750:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311228288 00000100:00100000:3.0:1788872917.904809:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 74 00000100:00100000:3.0:1788872917.904820:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311228288:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788872917.904851:0:94375:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788872917.904872:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788872917.904875:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788872917.904883:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788872917.904886:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788872917.904889:0:94375:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 127 00000100:00100000:3.0:1788872917.908068:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311228288:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 Request processed in 3238us (3414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872917.908083:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 74 00000100:00100000:3.0:1788872917.910358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872917.910446:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311228416 00000100:00100000:0.0:1788872917.910456:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311228416 00000100:00100000:0.0:1788872917.910513:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1444 00000100:00100000:0.0:1788872917.910520:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875765311228416:12345-192.168.204.39@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1788872917.910598:0:66979:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '0804304d-5904-48ad-87f2-bcbc7642a62a' at ffff98a9cb5ef800, cookie 0xe4e6e89fb01db685 00010000:00080000:0.0:1788872917.910605:0:66979:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp recovering/t120259084299 exp ffff98a9cb5ef800 cur 3855 last 1788872916 00010000:02000400:0.0:1788872917.910615:0:66979:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1788872917.910621:0:66979:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1788872917.910641:0:66979:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788872917.910781:0:66979:0:(import.c:65:import_set_state_nolock()) ffff98a8c6798800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872917.910852:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311228416:12345-192.168.204.39@tcp:38:ll_cfg_requeue.0 Request processed in 330us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872917.910860:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1444 00000100:00100000:0.0:1788872917.917158:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872917.917237:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311217920 00000100:00100000:3.0:1788872917.917250:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311217920 00000100:00100000:3.0:1788872917.917310:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1445 00000100:00100000:3.0:1788872917.917329:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311217920:12345-192.168.204.39@tcp:36:mcreate.0 00010000:00080000:3.0:1788872917.917348:0:66190:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 120259084299, current: 120259084299, replaying 00000100:00100000:3.0:1788872917.917367:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311217920:12345-192.168.204.39@tcp:36:mcreate.0 Request processed in 42us (219us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872917.917374:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1445 00010000:00080000:2.0:1788872917.917942:0:94405:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1788872918.347397:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872918.797196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872918.797242:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872918.797344:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311228544 00000100:00100000:2.0:1788872918.797355:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311228544 00000100:00100000:2.0:1788872918.797423:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 75 00000100:00100000:2.0:1788872918.797433:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311228544:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872918.797529:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311228544:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872918.797537:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 75 00000100:00100000:1.0:1788872918.798044:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311228672 00000100:00100000:1.0:1788872918.798050:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311228672 00000100:00100000:1.0:1788872918.798105:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1433 00000100:00100000:1.0:1788872918.798112:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2407:x1875765311228672:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872918.798152:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2407:x1875765311228672:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 41us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872918.798159:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1433 00000100:00080000:2.0:1788872918.798284:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788872919.353258:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872920.380122:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872920.760698:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872920.760725:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327840896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872920.760820:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872920.760868:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327840896 00000100:00100000:2.0:1788872920.760876:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327840896 00000100:00100000:2.0:1788872920.760930:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:2.0:1788872920.760939:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327840896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872920.760967:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872920.761011:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327840896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872920.761018:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00080000:2.0:1788872920.761039:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872920.761079:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327840896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872920.764155:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872920.764175:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327841024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872920.764237:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872920.766544:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327841024 00000100:00100000:0.0:1788872920.766573:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327841024 00000100:00100000:0.0:1788872920.766653:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196 00000100:00100000:0.0:1788872920.766663:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327841024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872920.766708:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872920.766787:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327841024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (2549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872920.766795:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196 00000100:00100000:1.0:1788872920.768119:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327841024:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788872920.768356:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788872921.401908:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872922.296750:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872922.296773:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327841152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872922.296866:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.296923:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327841152 00000100:00100000:1.0:1788872922.296931:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327841152 00000100:00100000:1.0:1788872922.296983:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:1.0:1788872922.296993:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327841152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872922.297038:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1788872922.297083:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327841152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.297100:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000100:00100000:1.0:1788872922.297276:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327841152:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788872922.307430:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872922.307437:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872922.307450:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872922.307463:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a8c1f5a800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872922.307485:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c273f480 x1875765327841408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872922.307518:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872922.307522:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872922.307524:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872922.307528:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98a9efadc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872922.307538:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c273ce00 x1875765327841664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872922.307574:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872922.307578:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872922.307579:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872922.307585:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98a9df8c9800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872922.307596:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c273f800 x1875765327841920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872922.307618:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872922.307621:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872922.307623:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872922.307635:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98a9dfe96800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872922.307646:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c5af5880 x1875765327842304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788872922.307666:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788872922.307669:0:86506:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788872922.307671:0:86506:0:(import.c:65:import_set_state_nolock()) ffff98a8ca9bc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872922.307675:0:86506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98a8ca9bc000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872922.307684:0:86506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9cb5d8a80 x1875765327842688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872922.307775:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327842048:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.307839:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.307877:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788872922.307884:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327841280:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.307915:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.307942:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327842176:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.307964:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.307990:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327841408:0@lo:38:kworker.0 00000100:00100000:1.0:1788872922.308032:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.308053:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327841664:0@lo:38:kworker.0 00000100:00100000:1.0:1788872922.308074:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.308091:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327841920:0@lo:38:kworker.0 00000100:00100000:1.0:1788872922.308126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.308142:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327842304:0@lo:38:kworker.0 00000100:00100000:1.0:1788872922.308165:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.308191:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327842688:0@lo:38:kworker.0 00000100:00100000:1.0:1788872922.308218:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.308248:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327841536:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.308271:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.308286:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327842432:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.308305:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.308320:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788872922.308326:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327841792:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.308347:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.308362:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327842560:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.308383:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872922.308415:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327842048 00000100:00100000:1.0:1788872922.308423:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327842048 00000100:00100000:1.0:1788872922.308483:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327842176 00000100:00100000:1.0:1788872922.308487:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327842176 00000100:00100000:1.0:1788872922.308507:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327842432 00000100:00100000:1.0:1788872922.308510:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327842432 00000100:00100000:1.0:1788872922.308526:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327842560 00000100:00100000:1.0:1788872922.308528:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327842560 00000100:00100000:1.0:1788872922.308572:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00100000:1.0:1788872922.308581:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327842048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.308634:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327842048:12345-0@lo:400:kworker.0 Request processed in 53us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.308642:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00100000:1.0:1788872922.308660:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722 00000100:00100000:1.0:1788872922.308666:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327842176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.308692:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327842176:12345-0@lo:400:kworker.0 Request processed in 26us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.308706:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722 00000100:00100000:1.0:1788872922.308720:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00100000:1.0:1788872922.308725:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327842432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.308758:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327842432:12345-0@lo:400:kworker.0 Request processed in 32us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.308764:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000100:00100000:1.0:1788872922.308776:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:1.0:1788872922.308783:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327842560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.308807:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327842560:12345-0@lo:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.308813:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00100000:1.0:1788872922.308834:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327841280 00000100:00100000:1.0:1788872922.308837:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327841280 00000100:00100000:1.0:1788872922.308867:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788872922.308874:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327841280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.308902:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327841280:12345-0@lo:400:kworker.0 Request processed in 28us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.308909:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788872922.308940:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327841408 00000100:00100000:1.0:1788872922.308944:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327841408 00000100:00100000:1.0:1788872922.308957:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327841664 00000100:00100000:1.0:1788872922.308959:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327841664 00000100:00100000:1.0:1788872922.308965:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327842304 00000100:00100000:1.0:1788872922.308967:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327842304 00000100:00100000:1.0:1788872922.308973:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327842688 00000100:00100000:1.0:1788872922.308975:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327842688 00000100:00100000:1.0:1788872922.308982:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327841536 00000100:00100000:1.0:1788872922.308990:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327841536 00000100:00100000:1.0:1788872922.309009:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327841792 00000100:00100000:1.0:1788872922.309011:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327841792 00000100:00100000:1.0:1788872922.309025:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:1.0:1788872922.309031:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327841536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.309061:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327841536:12345-0@lo:400:kworker.0 Request processed in 30us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.309067:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:1.0:1788872922.309078:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:1.0:1788872922.309083:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327841792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.309111:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327841792:12345-0@lo:400:kworker.0 Request processed in 27us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.309117:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:1.0:1788872922.309128:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1788872922.309132:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327841408:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788872922.309157:0:66979:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3859 last 0 00000020:00000080:1.0:1788872922.309196:0:66979:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe4e6e89fb01db7ff 00000004:00100000:1.0:1788872922.309212:0:66979:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788872922.309344:0:66979:0:(import.c:65:import_set_state_nolock()) ffff98a9f0830000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872922.309384:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875765327841408:12345-0@lo:38:kworker.0 Request processed in 251us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.309392:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1788872922.309404:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:1.0:1788872922.309408:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327841664:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788872922.309421:0:66979:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3859 last 0 00000020:00000080:1.0:1788872922.309457:0:66979:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe4e6e89fb01db806 00000004:00100000:1.0:1788872922.309470:0:66979:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788872922.309488:0:66979:0:(import.c:65:import_set_state_nolock()) ffff98a9f0835800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872922.309515:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875765327841664:12345-0@lo:38:kworker.0 Request processed in 105us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.309522:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:1.0:1788872922.309534:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:1.0:1788872922.309538:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327842304:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788872922.309573:0:66979:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3859 last 0 00000020:00000080:1.0:1788872922.309596:0:66979:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe4e6e89fb01db80d 00000004:00100000:1.0:1788872922.309602:0:66979:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788872922.309616:0:66979:0:(import.c:65:import_set_state_nolock()) ffff98a9df96f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872922.309641:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875765327842304:12345-0@lo:38:kworker.0 Request processed in 102us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.309648:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:1.0:1788872922.309660:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:1.0:1788872922.309664:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327842688:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788872922.309676:0:66979:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3859 last 0 00000020:00000080:1.0:1788872922.309694:0:66979:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe4e6e89fb01db814 00000004:00100000:1.0:1788872922.309701:0:66979:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788872922.309714:0:66979:0:(import.c:65:import_set_state_nolock()) ffff98a9df96c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872922.309741:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875765327842688:12345-0@lo:38:kworker.0 Request processed in 75us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.309747:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00080000:1.0:1788872922.309792:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872922.309796:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872922.309798:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872922.309861:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327841792:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.309873:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327842560:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.309884:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327841536:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.309895:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327842432:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.309933:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327841280:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.309944:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327842176:0@lo:400:kworker.0 00000100:00100000:1.0:1788872922.309953:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327842048:0@lo:400:kworker.0 00010000:00080000:1.0:1788872922.310000:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a8c273f480 x1875765327841408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872922.310015:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000100:00100000:3.0:1788872922.311871:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327841920 00000100:00100000:3.0:1788872922.311885:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327841920 00000100:00100000:3.0:1788872922.311933:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:3.0:1788872922.311941:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875765327841920:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788872922.311971:0:8446:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff98a9cb5ec800, cookie 0xe4e6e89fb01db67e 00010000:00080000:3.0:1788872922.311977:0:8446:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t120259084297 exp ffff98a9cb5ec800 cur 3859 last 1788872916 00000004:00100000:3.0:1788872922.311996:0:8446:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788872922.312061:0:8446:0:(import.c:65:import_set_state_nolock()) ffff98a8c2797800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788872922.312152:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327841920:12345-0@lo:38:kworker.0 Request processed in 210us (4024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872922.312160:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00010000:00080000:3.0:1788872922.312207:0:94405:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788872922.312212:0:94405:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 120259084299 00000020:00080000:3.0:1788872922.312217:0:94405:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872922.312221:0:94405:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084299 00010000:00080000:3.0:1788872922.312226:0:94405:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (120259084299) 00000020:00080000:3.0:1788872922.312228:0:94405:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872922.312239:0:94405:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311217920 t120259084299 from 192.168.204.39@tcp req@ffff98a8c5a42d80 x1875765311217920/t0(120259084299) o36->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:88/0 lens 528/0 e 0 to 0 dl 1788872928 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788872922.313338:0:94405:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1047us 00000100:00080000:1.0:1788872922.316668:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff98a8c273f480 x1875765327841408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872947 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872922.316684:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788872922.316690:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788872922.316695:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788872922.316702:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327841408:0@lo:38:kworker.0 00010000:00080000:1.0:1788872922.316741:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a8c273ce00 x1875765327841664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872922.316758:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 29 00000100:00080000:1.0:1788872922.317679:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff98a8c273ce00 x1875765327841664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872947 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872922.317689:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788872922.317713:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9efadc000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788872922.317717:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788872922.317722:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1875765327841664:0@lo:38:kworker.0 00000100:00100000:1.0:1788872922.317745:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084298 gen 3 00000004:00080000:1.0:1788872922.317751:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084297 committed transno 120259084298 00000004:00080000:1.0:1788872922.317772:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084298 committed transno 120259084298 00000100:00080000:1.0:1788872922.317786:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 29 00000100:00080000:1.0:1788872922.317795:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1788872922.317800:0:3643:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1788872922.317802:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084298 gen 3 00000100:00080000:1.0:1788872922.317805:0:3643:0:(recover.c:53:ptlrpc_replay_next()) import ffff98a9df8c9800 from lustre-MDT0000_UUID committed 120259084298 last 0 00000100:00080000:1.0:1788872922.317809:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1788872922.317941:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327841920:0@lo:38:kworker.0 00010000:00080000:1.0:1788872922.317958:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a8c5af5880 x1875765327842304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872922.317968:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 29 00010000:00080000:2.0:1788872922.320916:0:94604:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1788872922.320924:0:94604:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1788872922.320930:0:94604:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:2.0:1788872922.321460:0:94604:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5ae00/0xe4e6e89fb01daf5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01daf62 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788872922.321481:0:94604:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00080000:1.0:1788872922.336086:0:3643:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff98a8c5af5880 x1875765327842304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872947 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872922.336102:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788872922.336119:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe96800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788872922.336125:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788872922.336132:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875765327842304:0@lo:38:kworker.0 00010000:00080000:1.0:1788872922.336184:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9cb5d8a80 x1875765327842688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788872932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872922.336228:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 29 00000100:00080000:1.0:1788872922.336239:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788872922.336245:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788872922.336247:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8ca9bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788872922.336253:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875765327842688:0@lo:38:kworker.0 00000100:00100000:1.0:1788872922.336306:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327842816:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1788872922.336382:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872922.336662:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327842816 00000100:00100000:2.0:1788872922.336670:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327842816 00000100:00100000:2.0:1788872922.336726:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:2.0:1788872922.336736:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327842816:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788872922.336759:0:23717:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9ef2de680 x1875765327842816/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:93/0 lens 328/0 e 0 to 0 dl 1788872933 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872922.336771:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875765327842816:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 37us (389us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788872922.336778:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00010000:00010000:0.0:1788872922.381653:0:94405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db81b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.381675:0:94405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db81b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.381689:0:94405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db81b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.381702:0:94405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db822 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.381709:0:94405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db822 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.381716:0:94405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db822 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.382130:0:94405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db81b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.382139:0:94405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db81b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.382146:0:94405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db81b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.382165:0:94405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872922.382170:0:94405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db81b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.382177:0:94405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db81b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.382191:0:94405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c5daa900) 00010000:00010000:0.0:1788872922.382193:0:94405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872922.382197:0:94405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db81b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.382203:0:94405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db81b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872922.382221:0:94405:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005063cc95 reply state 00000000fdfda985 transno 120259084299 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db822 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.382232:0:94405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db822 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.382238:0:94405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5daa600) 00010000:00010000:0.0:1788872922.382240:0:94405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872922.382244:0:94405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788872922.382355:0:94405:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1788872922.382376:0:94405:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872922.382380:0:94405:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000020:00080000:0.0:1788872922.382384:0:94405:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872922.382386:0:94405:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000100:00100000:3.0:1788872922.398804:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872922.399088:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311218432 00000100:00100000:1.0:1788872922.399098:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311218432 00000100:00100000:1.0:1788872922.399171:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1450 00000100:00100000:1.0:1788872922.399182:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2403:x1875765311218432:12345-192.168.204.39@tcp:36:rm.0 00010000:00080000:1.0:1788872922.399201:0:66979:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 120259084300, current: 120259084300, replaying 00000100:00100000:1.0:1788872922.399214:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2403:x1875765311218432:12345-192.168.204.39@tcp:36:rm.0 Request processed in 35us (418us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872922.399221:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1450 00000020:00080000:0.0:1788872922.399361:0:94405:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872922.399377:0:94405:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 120259084300, next_transno: 120259084300 00010000:00080000:0.0:1788872922.399383:0:94405:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (120259084300) 00000020:00080000:0.0:1788872922.399386:0:94405:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788872922.399396:0:94405:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311218432 t120259084300 from 192.168.204.39@tcp req@ffff98a8c5a4a300 x1875765311218432/t0(120259084300) o36->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:93/0 lens 512/0 e 0 to 0 dl 1788872933 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788872922.399497:0:94405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db829 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.399514:0:94405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db829 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.399526:0:94405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db829 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.399538:0:94405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db830 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.399545:0:94405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db830 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.399572:0:94405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db830 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.399695:0:94405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01db837 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.399707:0:94405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01db837 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.399718:0:94405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01db837 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.399962:0:94405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01db837 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.399979:0:94405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01db837 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.399986:0:94405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01db837 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.399992:0:94405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ca00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872922.399996:0:94405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01db837 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.400004:0:94405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01db837 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.400016:0:94405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff98a9f1424000) 00010000:00010000:1.0:1788872922.400019:0:94405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788872922.400023:0:94405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01db837 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.400029:0:94405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01db837 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.400048:0:94405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db829 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.400054:0:94405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db829 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.400060:0:94405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db829 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.400065:0:94405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872922.400071:0:94405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db829 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.400078:0:94405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db829 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.400085:0:94405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c5daa900) 00010000:00010000:1.0:1788872922.400087:0:94405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872922.400089:0:94405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db829 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.400095:0:94405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae600/0xe4e6e89fb01db829 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872922.400105:0:94405:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0a1daa5 reply state 00000000f33a82ed transno 120259084300 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db830 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.400114:0:94405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db830 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.400120:0:94405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5daa600) 00010000:00010000:1.0:1788872922.400122:0:94405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872922.400125:0:94405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788872922.400192:0:94405:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788872922.400205:0:94405:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872922.400207:0:94405:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000020:00080000:1.0:1788872922.400211:0:94405:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788872922.400213:0:94405:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000001:00080000:1.0:1788872922.403655:0:94370:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084299 is committed 00010000:00010000:0.0:1788872922.403765:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db822 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.403779:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db822 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.403787:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db822 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.403814:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872922.403819:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db822 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.403839:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db822 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.403857:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5daa600) 00010000:00010000:0.0:1788872922.403860:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872922.403864:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db822 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.403871:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01db822 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872922.409461:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872922.409589:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311228800 00000100:00100000:3.0:1788872922.409601:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311228800 00000100:00100000:3.0:1788872922.409657:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1436 00000100:00100000:3.0:1788872922.409667:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2403:x1875765311228800:12345-192.168.204.39@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788872922.409689:0:66190:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a8c5a41500 x1875765311228800/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:93/0 lens 224/0 e 0 to 0 dl 1788872933 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872922.409710:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2403:x1875765311228800:12345-192.168.204.39@tcp:400:ldlm_lock_repla.0 Request processed in 46us (271us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872922.409717:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1436 00000020:00080000:3.0:1788872922.409736:0:94405:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872922.409740:0:94405:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 120259084301 00010000:00080000:3.0:1788872922.409744:0:94405:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788872922.409746:0:94405:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788872922.409752:0:94405:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788872922.409754:0:94405:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788872922.409761:0:94405:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff98a9ef2de680 x1875765327842816/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:93/0 lens 328/0 e 0 to 0 dl 1788872933 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788872922.409790:0:94405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872922.409821:0:94405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db83e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01daf5b expref: -99 pid: 94405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.409861:0:94405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db83e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01daf5b expref: 7 pid: 94405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.409878:0:94405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5e00/0xe4e6e89fb01db83e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01daf5b expref: 7 pid: 94405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.409897:0:94405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5e00, rc 0) 00010000:00080000:3.0:1788872922.409961:0:94405:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788872922.409973:0:94405:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00010000:3.0:1788872922.410019:0:3643:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff98a8c5c5ae00/0xe4e6e89fb01daf5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db83e expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788872922.410029:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788872922.410056:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327842816:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1788872922.410084:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327842944:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1788872922.410117:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872922.410156:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327842944 00000100:00100000:3.0:1788872922.410160:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327842944 00000100:00100000:3.0:1788872922.410187:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:3.0:1788872922.410194:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875765327842944:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1788872922.410205:0:8446:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a8c5a48380 x1875765327842944/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:93/0 lens 224/0 e 0 to 0 dl 1788872933 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872922.410229:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875765327842944:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 37us (112us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872922.410235:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00010000:00080000:3.0:1788872922.410249:0:94405:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788872922.410353:0:94405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 124554051584 00000001:00100000:3.0:1788872922.415973:0:94370:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788872922.415985:0:94370:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000001:00080000:3.0:1788872922.416007:0:94370:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00000001:00080000:2.0:1788872922.416122:0:94405:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1788872922.416186:0:94405:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1788872922.416204:0:94405:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.204.39@tcp: req@ffff98a8c5a41500 x1875765311228800/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:93/0 lens 224/0 e 0 to 0 dl 1788872933 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788872922.416336:0:94405:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff98a8c5a48380 x1875765327842944/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:93/0 lens 224/0 e 0 to 0 dl 1788872933 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788872922.416408:0:94405:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788872922.416902:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788872922.416912:0:3643:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff98a8c5a4aa00 x1875765327842944/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872938 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872922.416921:0:3643:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff98a8c5a4aa00 x1875765327842944/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872938 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872922.416941:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9df8c9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788872922.416959:0:3643:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788872922.416966:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e8e7b889): req@ffff98a9ef3d3800 x1875765327821696/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788872906 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872922.416981:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327842944:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1788872922.417104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872922.417132:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788872922.417141:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327843072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872922.417164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872922.417199:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327821696 00000100:00100000:3.0:1788872922.417206:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327821696 00000100:00100000:3.0:1788872922.417248:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327843072 00000100:00100000:3.0:1788872922.417265:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327843072 00000100:00100000:3.0:1788872922.417286:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:3.0:1788872922.417294:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3647:x1875765327821696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872922.417325:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1298812928 00000100:00100000:3.0:1788872922.417368:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3647:x1875765327821696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (264us total) trans 0 rc 0/0 00010000:00010000:1.0:1788872922.417512:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db830 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.417536:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db830 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.417544:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db830 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.417565:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872922.417570:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db830 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.417578:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db830 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.417593:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5daa600) 00010000:00010000:1.0:1788872922.417608:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872922.417613:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db830 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.417620:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01db830 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872922.419846:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00100000:3.0:1788872922.419887:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00100000:3.0:1788872922.419903:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327843072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872922.420738:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1298812928 00000100:00100000:3.0:1788872922.420816:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327843072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 919us (3649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872922.420823:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:00100000:1.0:1788872922.426029:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef3d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327821696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872922.428772:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327843072:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788872922.432389:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1788872922.456591:0:94405:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb002c866be10 00100000:10000000:3.0:1788872922.456610:0:94405:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1788872922.457543:0:94392:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x322:0x0] 00000100:00100000:3.0:1788872922.457671:0:94392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa58a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94392:1875765327843200:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788872922.457756:0:94392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872922.457791:0:94392:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9e9941600 going to sleep for 11 seconds 00000100:00100000:3.0:1788872922.457815:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327843200 00000100:00100000:3.0:1788872922.457823:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327843200 00000100:00100000:3.0:1788872922.457871:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6003 00000100:00100000:3.0:1788872922.457881:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:94392:x1875765327843200:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788872922.457910:0:9961:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 897 -> diff = -95 00002000:02000040:3.0:1788872922.457915:0:9961:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:803 to 0x2c0000401:897) 00000004:00080000:0.0:1788872922.459433:0:94390:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x323:0x0] 00000100:00100000:0.0:1788872922.459490:0:94390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94390:1875765327843328:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788872922.459576:0:94390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872922.459626:0:94390:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872922.459947:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327843328 00000100:00100000:2.0:1788872922.459956:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327843328 00000100:00100000:2.0:1788872922.460022:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6004 00000100:00100000:2.0:1788872922.460031:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:94390:x1875765327843328:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788872922.460059:0:26196:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 897 -> diff = -94 00002000:02000040:2.0:1788872922.460064:0:26196:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:804 to 0x280000401:897) 00002000:00010000:3.0:1788872922.473916:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x381:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.473929:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01db845 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.473948:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x381:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.473953:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x381:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.473961:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01db845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.473980:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01db845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.473991:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01db845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.474000:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01db845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.474026:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872922.474488:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x380:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.474495:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01db84c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.474505:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x380:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.474508:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x380:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.474512:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01db84c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.474537:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01db84c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.474545:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01db84c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.474630:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01db84c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475082:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872922.475089:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01db845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475097:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.475102:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01db845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475122:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01db845 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475141:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01db845 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475148:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d212d44/0xe4e6e89fb01db845 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475166:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.475168:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.475170:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.475223:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872922.475290:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.475296:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db853 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475305:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37f:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.475309:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.475313:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db853 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475323:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db853 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475330:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db853 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475349:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db853 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475360:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788872922.475401:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.475406:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db85a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475414:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37e:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.475417:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.475420:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db85a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475428:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db85a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475435:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db85a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475454:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db85a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475467:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788872922.475501:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.475505:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01db861 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475518:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37d:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.475521:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.475525:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01db861 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475534:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01db861 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.475543:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01db861 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475677:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788872922.475683:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01db84c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475690:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.475693:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01db84c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475701:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01db84c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475712:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01db84c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475732:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011def12d/0xe4e6e89fb01db84c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475745:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872922.475748:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db853 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475754:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.475757:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db853 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475764:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db853 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475774:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db853 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475782:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc15c5c/0xe4e6e89fb01db853 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475792:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872922.475795:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db85a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475801:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.475809:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db85a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475816:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db85a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475825:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db85a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475832:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db85a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.475845:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.475846:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.475847:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.475853:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.475857:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.479429:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01db861 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.479884:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872922.480031:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.480040:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01db868 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480056:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37c:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.480063:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.480070:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01db868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480087:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01db868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480119:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01db868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480127:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01db868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480157:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788872922.480204:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.480209:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01db86f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480217:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872922.480225:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37b:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.480226:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01db861 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480231:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.480241:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01db86f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480243:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.480251:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01db861 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480255:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01db86f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480275:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01db86f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480279:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01db861 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480292:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01db86f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480306:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01db861 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480326:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788872922.480330:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005818d696/0xe4e6e89fb01db861 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480357:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872922.480361:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01db868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480368:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.480371:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01db868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872922.480375:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.480379:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01db868 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480383:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01db876 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480393:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01db868 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480397:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37a:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.480405:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.480408:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074a4c48a/0xe4e6e89fb01db868 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480411:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01db876 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480428:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01db876 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480456:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01db876 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480459:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.480466:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01db86f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480469:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01db876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480483:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.480488:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01db86f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480492:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.480501:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01db86f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480512:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01db86f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480520:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095255154/0xe4e6e89fb01db86f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480535:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.480538:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01db876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872922.480539:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x379:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.480575:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.480576:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01db87d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480582:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01db876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480592:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x379:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.480604:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x379:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.480609:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01db87d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480627:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01db876 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.480630:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01db87d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480648:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01db876 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480655:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001905dbac/0xe4e6e89fb01db876 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.480668:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.480670:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.480671:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.484108:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.484121:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.484127:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.484225:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01db87d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.484238:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01db87d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.484538:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.484680:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.484689:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01db87d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.484700:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.484706:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01db87d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.484717:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01db87d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.484741:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01db87d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.484842:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b0d118d/0xe4e6e89fb01db87d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.484869:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.484871:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.484873:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.489187:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x378:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.489203:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01db884 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489225:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x378:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.489231:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x378:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.489238:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01db884 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489253:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01db884 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489263:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01db884 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489271:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01db884 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489305:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872922.489384:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x377:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.489397:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01db88b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489407:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x377:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.489410:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.489414:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01db88b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489424:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01db88b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489432:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01db88b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489449:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01db88b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489466:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788872922.489478:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872922.489484:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01db884 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489491:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ca00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.489496:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01db884 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489504:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01db884 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489527:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01db884 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489535:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b92130aa/0xe4e6e89fb01db884 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489577:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.489582:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01db88b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489588:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.489591:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01db88b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489610:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01db88b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489619:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01db88b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489627:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c74f5103/0xe4e6e89fb01db88b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489639:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.489641:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.489648:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.489690:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x376:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.489695:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01db892 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489702:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x376:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.489705:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x376:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.489708:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01db892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489716:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01db892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489722:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01db892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489728:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01db892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489743:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872922.489783:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x375:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.489788:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01db899 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489794:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x375:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.489796:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x375:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.489800:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01db899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489819:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01db899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489827:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01db899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489833:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01db899 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489845:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788872922.489852:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872922.489857:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01db892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489863:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.489867:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01db892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489874:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01db892 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489884:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01db892 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489891:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d80d3e6/0xe4e6e89fb01db892 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489911:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.489914:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01db899 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489920:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58afa00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.489923:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01db899 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489930:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01db899 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489940:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01db899 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489947:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000601830aa/0xe4e6e89fb01db899 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.489957:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.489958:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.489960:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.490000:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x374:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.490005:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01db8a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490012:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x374:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.490021:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x374:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.490025:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01db8a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490034:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01db8a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490042:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01db8a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490050:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01db8a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490062:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.490069:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.490072:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01db8a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490077:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.490080:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01db8a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490087:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01db8a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490096:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01db8a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490112:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000885bc137/0xe4e6e89fb01db8a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490126:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.490127:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.490129:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.490171:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x373:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.490176:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01db8a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490183:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x373:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.490186:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x373:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.490190:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01db8a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490199:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01db8a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490206:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01db8a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490212:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01db8a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490223:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.490229:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.490238:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01db8a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490244:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.490248:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01db8a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490255:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01db8a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490266:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01db8a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490273:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003444c81e/0xe4e6e89fb01db8a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490285:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.490286:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.490288:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.490328:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x372:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.490333:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd414c3b/0xe4e6e89fb01db8ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490340:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x372:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.490343:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x372:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.490347:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd414c3b/0xe4e6e89fb01db8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490366:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd414c3b/0xe4e6e89fb01db8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490373:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd414c3b/0xe4e6e89fb01db8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490379:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd414c3b/0xe4e6e89fb01db8ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490392:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.490399:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.490403:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd414c3b/0xe4e6e89fb01db8ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490410:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58afc00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.490413:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd414c3b/0xe4e6e89fb01db8ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490421:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd414c3b/0xe4e6e89fb01db8ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490430:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd414c3b/0xe4e6e89fb01db8ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490448:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd414c3b/0xe4e6e89fb01db8ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490467:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.490469:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.490471:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.490511:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x371:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.490516:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01db8b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490523:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x371:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.490526:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x371:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.490530:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01db8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490538:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01db8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490545:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01db8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490570:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01db8b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490581:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.490586:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.490590:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01db8b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490607:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.490610:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01db8b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490617:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01db8b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490629:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01db8b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490636:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092a37b12/0xe4e6e89fb01db8b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490649:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.490651:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.490652:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.490693:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x370:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.490698:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01db8bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490706:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x370:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.490709:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x370:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.490712:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01db8bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490721:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01db8bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490734:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01db8bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490742:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01db8bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490754:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.490760:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.490763:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01db8bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490770:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aea00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.490773:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01db8bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490779:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01db8bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490790:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01db8bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490797:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000068f9c74/0xe4e6e89fb01db8bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490810:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.490816:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.490818:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.490860:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.490865:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000365a4918/0xe4e6e89fb01db8c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490873:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36f:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.490876:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.490880:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000365a4918/0xe4e6e89fb01db8c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490889:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000365a4918/0xe4e6e89fb01db8c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490897:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000365a4918/0xe4e6e89fb01db8c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490905:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000365a4918/0xe4e6e89fb01db8c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490918:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.490924:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.490927:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000365a4918/0xe4e6e89fb01db8c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490932:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.490935:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000365a4918/0xe4e6e89fb01db8c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490952:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000365a4918/0xe4e6e89fb01db8c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490963:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000365a4918/0xe4e6e89fb01db8c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490970:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000365a4918/0xe4e6e89fb01db8c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.490983:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.490984:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.490985:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.491028:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.491033:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01db8ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491041:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36e:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.491043:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.491047:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01db8ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491056:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01db8ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491063:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01db8ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491076:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01db8ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491087:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.491094:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.491098:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01db8ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491104:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.491108:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01db8ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491116:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01db8ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491126:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01db8ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491133:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5493920/0xe4e6e89fb01db8ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.491147:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.491148:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.491188:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.491199:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01db8d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491207:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36d:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.491209:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.491213:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01db8d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491221:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01db8d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491229:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01db8d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491236:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01db8d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491248:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.491255:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.491258:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01db8d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491264:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.491267:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01db8d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491273:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01db8d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491291:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01db8d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491299:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e69f0f8e/0xe4e6e89fb01db8d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491312:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.491314:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.491316:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.491359:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.491364:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01db8d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491373:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36c:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.491376:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.491380:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01db8d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491390:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01db8d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491398:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01db8d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491405:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01db8d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491428:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.491434:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.491451:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01db8d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491459:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.491462:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01db8d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491470:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01db8d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491480:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01db8d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491487:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d588c795/0xe4e6e89fb01db8d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491500:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.491502:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.491503:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.491546:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.491573:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01db8df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491581:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36b:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.491590:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.491596:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01db8df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491605:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01db8df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491612:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01db8df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491619:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01db8df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491631:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.491638:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.491642:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01db8df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491648:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58afe00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.491652:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01db8df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491658:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01db8df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491667:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01db8df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491685:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039a3a9b9/0xe4e6e89fb01db8df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491697:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.491699:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.491701:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.491743:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.491748:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01db8e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491756:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36a:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.491759:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.491763:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01db8e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491771:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01db8e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491779:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01db8e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491786:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01db8e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491798:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788872922.491803:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.491812:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01db8e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491820:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872922.491822:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01db8e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491830:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01db8e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491841:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01db8e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491848:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087c86769/0xe4e6e89fb01db8e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491861:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.491862:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.491863:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788872922.491902:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x369:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.491907:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01db8ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491915:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x369:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.491917:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x369:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.491921:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01db8ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.491942:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01db8ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.492021:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788872922.492384:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788872922.492689:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.493460:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01db8ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.493476:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01db8ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.493543:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872922.493648:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x368:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.493654:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01db8f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.493664:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x368:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.493667:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x368:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.493672:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01db8f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.493683:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01db8f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.493690:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01db8f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.493713:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01db8f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872922.496378:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x381:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.496396:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db8fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.496417:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x381:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.496422:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x381:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.496429:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db8fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.496454:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db8fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.496486:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db8fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.496494:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db8fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500429:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788872922.500457:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01db8ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500475:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.500480:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01db8ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500521:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01db8ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500561:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01db8ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500570:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000274d6010/0xe4e6e89fb01db8ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500894:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872922.500900:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01db8f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500907:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aee00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.500911:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01db8f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500919:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01db8f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500931:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01db8f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500939:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872922.500943:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db8fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500956:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.500959:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db8fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500966:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db8fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500976:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db8fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.500986:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.500987:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.500990:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.501173:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788872922.501181:0:9961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b14c590e/0xe4e6e89fb01db8f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872922.501316:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x367:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.501333:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01db902 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501345:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x367:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.501350:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x367:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.501356:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01db902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501367:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01db902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501376:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01db902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501384:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01db902 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501421:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788872922.501476:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x366:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.501482:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01db909 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501489:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x366:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.501492:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x366:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.501496:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01db909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501504:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01db909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501511:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01db909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501517:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01db909 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501529:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788872922.501592:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x365:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.501675:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01db910 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501684:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x365:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.501694:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x365:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.501698:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01db910 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501707:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01db910 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501715:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01db910 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501721:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01db910 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501745:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788872922.501852:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x364:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.501858:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01db917 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501865:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x364:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.501868:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x364:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.501872:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01db917 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501881:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01db917 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501888:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01db917 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501902:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01db917 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501909:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788872922.501948:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x363:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.501953:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01db91e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501960:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x363:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.501962:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x363:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.501967:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01db91e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501974:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01db91e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501982:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01db91e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501990:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01db91e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.501998:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788872922.502031:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x362:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788872922.502036:0:9961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01db925 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.502048:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x362:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:1.0:1788872922.502051:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x362:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872922.502055:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01db925 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.502064:0:9961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01db925 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.502072:0:9961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01db925 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.502080:0:9961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01db925 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.502088:0:9961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1788872922.502307:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788872922.502315:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01db902 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502327:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aec00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872922.502331:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01db902 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502343:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01db902 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502360:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01db902 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502371:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000784377c2/0xe4e6e89fb01db902 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502394:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788872922.502398:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01db909 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502405:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872922.502409:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01db909 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502425:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01db909 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502450:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01db909 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502458:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e647113/0xe4e6e89fb01db909 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502474:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788872922.502478:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01db910 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502487:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872922.502490:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01db910 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502499:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01db910 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502511:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01db910 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502519:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006595c031/0xe4e6e89fb01db910 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788872922.502533:0:9961:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:802 00010000:00010000:2.0:1788872922.502566:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788872922.502570:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01db917 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502578:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872922.502581:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01db917 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502590:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01db917 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502600:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01db917 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502607:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019f48cc7/0xe4e6e89fb01db917 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502619:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788872922.502622:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01db91e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502628:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872922.502631:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01db91e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502663:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01db91e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502673:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01db91e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502679:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035762e2c/0xe4e6e89fb01db91e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502691:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872922.502694:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01db925 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502700:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:2.0:1788872922.502702:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01db925 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502709:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01db925 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502717:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01db925 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502723:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078373df3/0xe4e6e89fb01db925 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872922.502747:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872922.502749:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872922.502751:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.502793:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872922.502949:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:94392:x1875765327843200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 45065us (45189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872922.502960:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6003 00010000:00010000:3.0:1788872922.503006:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788872922.503013:0:26196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db8fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.503039:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.503045:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872922.503295:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872922.503394:0:94392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa58a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94392:1875765327843200:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788872922.503412:0:94392:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x381:0x0] from OST, last_created [0x2c0000401:0x381:0x0]last_used is [0x2c0000401:0x322:0x0] 00000100:00100000:0.0:1788872922.503501:0:94392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94392:1875765327843584:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788872922.503541:0:94392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872922.503590:0:94392:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788872922.504782:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872922.504806:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327843456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872922.504855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872922.504896:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327843584 00000100:00100000:0.0:1788872922.504903:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327843584 00000100:00100000:0.0:1788872922.504956:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6005 00000100:00100000:0.0:1788872922.504966:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:94392:x1875765327843584:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788872922.505006:0:26187:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 898 00000100:00100000:2.0:1788872922.506111:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327843456 00000100:00100000:2.0:1788872922.506119:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327843456 00000100:00100000:2.0:1788872922.506166:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197 00000100:00100000:2.0:1788872922.506177:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327843456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872922.506198:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 896 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872922.506284:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327843456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872922.506293:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197 00000100:00100000:2.0:1788872922.506362:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327843456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872922.506524:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:94392:x1875765327843584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1558us (2981us total) trans 4294969458 rc 0/0 00000100:00100000:0.0:1788872922.506532:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6005 00000100:00100000:2.0:1788872922.506572:0:94392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94392:1875765327843584:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788872922.506589:0:94392:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x381:0x0]-[0x2c0000401:0x3a1:0x0] 00002000:00010000:3.0:1788872922.508790:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x380:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.508803:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01db92c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.508819:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x380:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.508823:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x380:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.508829:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01db92c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.508842:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01db92c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.508851:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01db92c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.508867:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01db92c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.508887:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872922.510530:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872922.510787:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01db92c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.510802:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.510807:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01db92c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.510818:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01db92c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.510839:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01db92c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.510847:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ab4cb9/0xe4e6e89fb01db92c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.510867:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.510869:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.510871:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872922.511835:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.511846:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01db933 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.511862:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37f:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.511867:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.511873:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01db933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.511887:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01db933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.511897:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01db933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.511906:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01db933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.511930:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872922.511982:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.511987:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01db93a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512003:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37e:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.512006:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.512010:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01db93a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512019:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01db93a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512026:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01db93a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512034:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01db93a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512049:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788872922.512059:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872922.512063:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01db933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512071:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.512075:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01db933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512082:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01db933 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512103:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01db933 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512110:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abca7289/0xe4e6e89fb01db933 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512127:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872922.512131:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01db93a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512138:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.512141:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01db93a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512148:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01db93a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512155:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01db93a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512161:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2a37838/0xe4e6e89fb01db93a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512172:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.512174:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.512180:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872922.512358:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.512364:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01db941 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512373:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37d:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.512376:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.512381:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01db941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512390:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01db941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512398:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01db941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512406:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01db941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512423:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872922.512479:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.512485:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01db948 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512493:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37c:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.512497:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.512501:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01db948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512522:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01db948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512530:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01db948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512538:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01db948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512574:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788872922.512618:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.512623:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01db94f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.512632:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37b:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.512635:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.514397:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01db94f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514431:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01db94f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514453:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01db94f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514472:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01db94f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514502:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788872922.514625:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.514632:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db956 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514652:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37a:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.514656:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.514662:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514672:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514680:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514688:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514697:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788872922.514734:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x379:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.514739:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01db95d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514751:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x379:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.514755:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x379:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.514759:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01db95d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514767:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01db95d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514774:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01db95d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514781:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01db95d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514790:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788872922.514828:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x378:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.514833:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01db964 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514841:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x378:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.514843:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x378:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.514847:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01db964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514856:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01db964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514875:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01db964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514882:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01db964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514890:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788872922.514929:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x377:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.514934:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01db96b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514942:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x377:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.514944:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.514959:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01db96b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514971:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01db96b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514979:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01db96b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.514986:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01db96b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.515007:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788872922.515044:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x376:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.515049:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db972 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.515057:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x376:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.515059:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x376:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.515064:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db972 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.515071:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db972 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.515079:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db972 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.515086:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db972 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.515095:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788872922.515131:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x375:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.515135:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01db979 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.515142:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x375:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.515151:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x375:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.515155:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01db979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.515164:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01db979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.515171:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01db979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.515177:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01db979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.515185:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:0.0:1788872922.516316:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00002000:00010000:3.0:1788872922.516328:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x374:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.516339:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01db980 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516347:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01db941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.516353:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x374:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.516362:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x374:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872922.516364:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.516369:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01db980 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516370:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01db941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516395:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01db941 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.516398:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01db980 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.516418:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01db980 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516425:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01db941 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.516458:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01db980 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516458:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089519355/0xe4e6e89fb01db941 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.516486:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:0.0:1788872922.516505:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788872922.516510:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01db948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516517:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.516521:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01db948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516529:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01db948 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872922.516576:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x373:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872922.516578:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01db948 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.516583:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01db987 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516592:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01db948 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.516599:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x373:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.516604:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x373:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.516609:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01db987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.516618:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01db987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.516626:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01db987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.516634:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01db987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516723:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788872922.516729:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01db94f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516737:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.516740:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01db94f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516748:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01db94f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516758:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01db94f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516765:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d42b969d/0xe4e6e89fb01db94f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516778:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788872922.516782:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516794:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.516797:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516804:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db956 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516816:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db956 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516823:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9102515/0xe4e6e89fb01db956 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516835:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788872922.516838:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01db95d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516845:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.516847:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01db95d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516854:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01db95d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516862:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01db95d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516875:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a462e5c2/0xe4e6e89fb01db95d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516888:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788872922.516892:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01db964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516899:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.516902:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01db964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516909:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01db964 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516919:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01db964 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516926:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f26578c/0xe4e6e89fb01db964 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516937:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788872922.516941:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01db96b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516947:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.516955:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01db96b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516964:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01db96b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516974:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01db96b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516981:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ac26acb/0xe4e6e89fb01db96b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.516997:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788872922.517000:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db972 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517006:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.517009:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db972 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517015:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db972 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517023:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db972 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517031:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ceadcfd/0xe4e6e89fb01db972 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517050:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872922.517053:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01db979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517059:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.517062:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01db979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517069:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01db979 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517077:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01db979 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517083:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01db979 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517093:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872922.517096:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01db980 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517101:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.517104:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01db980 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517120:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01db980 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517129:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01db980 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517135:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01db980 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.517148:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.517149:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.517151:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.517161:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.517450:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872922.517463:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872922.517467:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01db987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517483:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.517486:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01db987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517493:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01db987 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517504:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01db987 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517511:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01db987 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517526:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.517527:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.517529:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872922.517631:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x372:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.517636:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01db98e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517792:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x372:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.517797:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x372:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.517802:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01db98e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517813:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01db98e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517829:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01db98e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517837:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01db98e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517853:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872922.517862:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872922.517867:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01db98e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517875:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.517879:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01db98e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517887:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01db98e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517901:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01db98e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517909:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01db98e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517925:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.517933:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.517935:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872922.517984:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x371:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.517990:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01db995 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.517998:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x371:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.518001:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x371:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.518005:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01db995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518014:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01db995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518022:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01db995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518029:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01db995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518043:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872922.518051:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872922.518054:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01db995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518062:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.518066:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01db995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518086:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01db995 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518098:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01db995 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518105:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01db995 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518118:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.518119:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.518121:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872922.518173:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x370:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.518179:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01db99c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518186:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x370:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.518188:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x370:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.518192:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01db99c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518200:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01db99c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518208:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01db99c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518222:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01db99c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518236:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872922.518244:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872922.518248:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01db99c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518255:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.518258:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01db99c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.518265:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01db99c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.518289:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872922.518588:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788872922.520777:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788872922.521163:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01db99c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521172:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fa1453e/0xe4e6e89fb01db99c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521197:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.521200:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.521202:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872922.521347:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.521361:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01db9a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521375:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36f:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.521379:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.521386:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01db9a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521398:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01db9a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521408:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01db9a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521416:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01db9a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521453:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872922.521472:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872922.521481:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01db9a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.521492:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9800 already unused, calling callback (ffffffffc0dc5220) 00002000:00010000:3.0:1788872922.521497:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788872922.521498:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01db9a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521507:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01db9aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.521514:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01db9a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521519:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36e:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.521528:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.521533:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01db9aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.521535:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01db9a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521544:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01db9aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.521577:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf3e908/0xe4e6e89fb01db9a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521599:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01db9aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521608:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01db9aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.521610:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.521614:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.521617:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.521631:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788872922.521639:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872922.521644:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01db9aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.521652:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.521655:0:14981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01db9aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.521663:0:14981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01db9aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.521673:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01db9aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.521680:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bbe5635/0xe4e6e89fb01db9aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.521692:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.521693:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.521700:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872922.521809:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.521815:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01db9b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521825:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36d:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.521828:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.521832:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01db9b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521842:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01db9b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521851:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01db9b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521859:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01db9b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521893:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872922.521933:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.521938:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01db9b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521947:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36c:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.521950:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.521954:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01db9b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521962:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01db9b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521969:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01db9b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521977:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01db9b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.521992:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788872922.522000:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872922.522004:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01db9b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.522010:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.522020:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01db9b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.522021:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872922.522029:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01db9b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.522033:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01db9b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.522045:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.522051:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01db9b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.522054:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01db9b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.522061:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01db9b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.522067:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d06cd0a/0xe4e6e89fb01db9b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.522076:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01db9b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.522083:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.522085:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01db9b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.522087:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.522091:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.522105:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.522108:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.522110:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872922.522139:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.522145:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01db9bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.522152:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36b:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.522155:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.522159:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01db9bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.522168:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01db9bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.522186:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01db9bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.522192:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01db9bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.522297:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872922.522302:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01db9bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.522309:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8c00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.522311:0:20230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01db9bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.522339:0:20230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01db9bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.522351:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01db9bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.522358:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.522360:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.522361:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.524331:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788872922.524349:0:26196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01db9bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872922.524485:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.524491:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01db9c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524503:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36a:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.524507:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.524513:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01db9c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524526:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01db9c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524536:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01db9c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524569:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01db9c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524587:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872922.524627:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x369:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.524631:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01db9cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524710:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x369:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.524714:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x369:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.524719:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01db9cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524729:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01db9cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524735:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01db9cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524742:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01db9cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524759:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788872922.524775:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872922.524780:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01db9c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524793:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9600 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.524797:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01db9c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524806:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01db9c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524820:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01db9c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524828:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008d150c4/0xe4e6e89fb01db9c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524844:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872922.524847:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01db9cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524852:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.524855:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01db9cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524861:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01db9cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524868:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01db9cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524881:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036a6522d/0xe4e6e89fb01db9cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524894:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.524895:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.524897:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872922.524940:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x368:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.524946:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01db9d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524954:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x368:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.524957:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x368:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.524961:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01db9d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524968:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01db9d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524975:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01db9d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524982:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01db9d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.524994:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872922.525032:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x367:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.525036:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01db9db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525044:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x367:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.525047:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x367:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.525050:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01db9db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525059:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01db9db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525067:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01db9db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525074:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01db9db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525085:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788872922.525115:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x366:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.525119:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01db9e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525128:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x366:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.525131:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x366:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.525135:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01db9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525154:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01db9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525162:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01db9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525169:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01db9e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525181:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788872922.525187:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788872922.525191:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01db9d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525197:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9200 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.525200:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01db9d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525207:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01db9d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.525215:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01db9d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.527351:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01db9d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.527400:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872922.527404:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01db9db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.527412:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9a00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.527416:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01db9db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.527426:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01db9db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.527455:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01db9db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.527463:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01db9db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.527475:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872922.527479:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01db9e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.527485:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9e00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.527489:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01db9e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.527508:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01db9e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.527519:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01db9e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.527525:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01db9e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.527538:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.527540:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.527542:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.528859:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.528871:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.528876:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872922.529369:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x365:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.529381:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db9e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.529398:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x365:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.529403:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x365:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.529411:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db9e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.529425:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db9e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.529448:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db9e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.529468:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db9e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.532189:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872922.532321:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x364:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.532330:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048174450/0xe4e6e89fb01db9f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.532347:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x364:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.532351:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x364:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.532357:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048174450/0xe4e6e89fb01db9f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.532371:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048174450/0xe4e6e89fb01db9f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.532381:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048174450/0xe4e6e89fb01db9f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.532389:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048174450/0xe4e6e89fb01db9f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.538734:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872922.538750:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db9e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.538764:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449b800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.538769:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db9e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.538781:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db9e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.538807:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db9e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.538829:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b40b80c8/0xe4e6e89fb01db9e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.539808:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872922.539821:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048174450/0xe4e6e89fb01db9f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.539833:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449ba00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.539837:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048174450/0xe4e6e89fb01db9f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.539846:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048174450/0xe4e6e89fb01db9f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.539862:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048174450/0xe4e6e89fb01db9f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.539872:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.539873:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.539877:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872922.541174:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788872922.541187:0:26196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048174450/0xe4e6e89fb01db9f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.541308:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788872922.541459:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x363:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.541466:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db9f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.541480:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x363:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.541485:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x363:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.541492:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db9f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.541505:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db9f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.541514:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db9f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.541522:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db9f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.541605:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788872922.541657:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x362:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788872922.541662:0:26196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db9fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.541671:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x362:0x0].0x0 since=3859s v=(0 0) 00010000:00010000:3.0:1788872922.541674:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x362:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872922.541684:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db9fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.541693:0:26196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db9fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.541700:0:26196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db9fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872922.541706:0:26196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db9fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.549049:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788872922.549070:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db9f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.549087:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449be00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872922.549103:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db9f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.549117:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db9f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.549143:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db9f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872922.549153:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec0ac1f9/0xe4e6e89fb01db9f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.549302:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872922.549310:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db9fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.549335:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449ac00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872922.549341:0:26196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788872922.549345:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db9fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.549356:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db9fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.549367:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db9fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.549374:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b20a1d6/0xe4e6e89fb01db9fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872922.549389:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.549391:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872922.549393:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872922.549736:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788872922.549974:0:26196:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:803 00000100:00100000:3.0:1788872922.550088:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:94390:x1875765327843328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 90054us (90508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872922.550101:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6004 00000100:00100000:0.0:1788872922.551391:0:94390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94390:1875765327843328:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788872922.551411:0:94390:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x381:0x0] from OST, last_created [0x280000401:0x381:0x0]last_used is [0x280000401:0x323:0x0] 00000100:00100000:0.0:1788872922.551513:0:94390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94390:1875765327843840:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788872922.551581:0:94390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872922.551613:0:94390:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872922.551651:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327843840 00000100:00100000:0.0:1788872922.551658:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327843840 00000100:00100000:0.0:1788872922.551705:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6006 00000100:00100000:0.0:1788872922.551714:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:94390:x1875765327843840:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788872922.551753:0:26183:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 898 00000100:00100000:3.0:1788872922.551949:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872922.551961:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327843712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872922.551995:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872922.556696:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327843712 00000100:00100000:3.0:1788872922.556716:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327843712 00000100:00100000:3.0:1788872922.556784:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198 00000100:00100000:3.0:1788872922.556795:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327843712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788872922.556824:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872922.556910:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327843712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (4913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872922.556933:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198 00000100:00100000:3.0:1788872922.556988:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327843712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872922.563700:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:94390:x1875765327843840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11975us (12107us total) trans 4294969456 rc 0/0 00000100:00100000:1.0:1788872922.563717:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6006 00000100:00100000:3.0:1788872922.563947:0:94390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94390:1875765327843840:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788872922.563965:0:94390:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x381:0x0]-[0x280000401:0x3a1:0x0] 00000100:00100000:3.0:1788872922.827677:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872922.827732:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872922.827763:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311228928 00000100:00100000:3.0:1788872922.827774:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311228928 00000100:00100000:3.0:1788872922.827827:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 77 00000100:00100000:3.0:1788872922.827837:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311228928:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872922.827902:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311228928:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 66us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872922.827910:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 77 00000100:00100000:3.0:1788872922.827941:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311229056 00000100:00100000:3.0:1788872922.827944:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311229056 00000100:00100000:3.0:1788872922.827983:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1437 00000100:00100000:3.0:1788872922.827990:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2405:x1875765311229056:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872922.828019:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2405:x1875765311229056:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872922.828026:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1437 00000100:00080000:3.0:1788872922.828150:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1788872922.833660:0:75620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:3.0:1788872923.219174:0:94659:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788872923.450002:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788872924.202353:0:94711:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788872924.202804:0:94711:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788872924.474762:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788872925.447641:0:94761:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788872925.447865:0:94761:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788872925.504192:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872925.880924:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f9ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327843968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872925.881049:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872925.881171:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327843968 00000100:00100000:0.0:1788872925.881180:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327843968 00000100:00100000:0.0:1788872925.881246:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199 00000100:00100000:0.0:1788872925.881270:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327843968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872925.881312:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872925.881360:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327843968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872925.881367:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199 00000100:00100000:2.0:1788872925.881531:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327844096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872925.881589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872925.881673:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327844096 00000100:00100000:0.0:1788872925.881677:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327844096 00000100:00100000:0.0:1788872925.881707:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200 00000100:00100000:0.0:1788872925.881713:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327844096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872925.881729:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872925.881763:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327844096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872925.881770:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200 00000100:00100000:0.0:1788872925.881812:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327844096:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788872925.881885:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872925.881891:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872925.881915:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f9ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327843968:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788872926.521055:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872927.417870:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872927.417895:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327844224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872927.417981:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872927.418261:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327844224 00000100:00100000:1.0:1788872927.418271:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327844224 00000100:00100000:1.0:1788872927.418359:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00100000:1.0:1788872927.418370:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327844224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872927.418410:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1788872927.418466:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327844224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872927.418473:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00000100:00100000:0.0:1788872927.418573:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327844224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872927.418835:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327844736:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.418881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872927.418913:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327845248:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.418937:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872927.418953:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327845760:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.418975:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872927.418993:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788872927.418999:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327844608:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872927.419045:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327845120:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872927.419087:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327845632:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419109:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872927.419151:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327845248 00000100:00100000:2.0:1788872927.419156:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327845248 00000100:00100000:2.0:1788872927.419196:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327845120 00000100:00100000:2.0:1788872927.419199:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327845120 00000100:00100000:2.0:1788872927.419217:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327845632 00000100:00100000:2.0:1788872927.419219:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327845632 00000100:00100000:2.0:1788872927.419237:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00100000:2.0:1788872927.419243:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327845248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419297:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327845248:12345-0@lo:400:kworker.0 Request processed in 53us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872927.419304:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000100:00100000:2.0:1788872927.419319:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726 00000100:00100000:2.0:1788872927.419325:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327845120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419366:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327845120:12345-0@lo:400:kworker.0 Request processed in 41us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872927.419379:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726 00000100:00100000:2.0:1788872927.419391:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727 00000100:00100000:2.0:1788872927.419397:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327845632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419425:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765327845632:12345-0@lo:400:kworker.0 Request processed in 28us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872927.419430:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727 00000100:00100000:2.0:1788872927.419454:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327844480:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419480:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872927.419497:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327844992:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872927.419533:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327845504:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419600:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872927.419619:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788872927.419625:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327844352:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419651:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872927.419674:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327844864:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872927.419706:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327845376:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419723:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872927.419754:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327845120:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419765:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327845632:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.419774:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327845248:0@lo:400:kworker.0 00000100:00100000:0.0:1788872927.420273:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327844736 00000100:00100000:0.0:1788872927.420279:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327844736 00000100:00100000:0.0:1788872927.420312:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327845760 00000100:00100000:0.0:1788872927.420315:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327845760 00000100:00100000:0.0:1788872927.420328:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327844608 00000100:00100000:0.0:1788872927.420330:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327844608 00000100:00100000:0.0:1788872927.420354:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327844480 00000100:00100000:0.0:1788872927.420357:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327844480 00000100:00100000:0.0:1788872927.420384:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327844864 00000100:00100000:0.0:1788872927.420387:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327844864 00000100:00100000:0.0:1788872927.420398:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327845376 00000100:00100000:0.0:1788872927.420400:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327845376 00000100:00100000:0.0:1788872927.420411:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:0.0:1788872927.420418:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327844736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872927.420477:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327844736:12345-0@lo:400:kworker.0 Request processed in 59us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872927.420485:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:0.0:1788872927.420499:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1788872927.420504:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327845760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872927.420532:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327845760:12345-0@lo:400:kworker.0 Request processed in 28us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872927.420539:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1788872927.420570:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:0.0:1788872927.420578:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327844608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872927.420605:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327844608:12345-0@lo:400:kworker.0 Request processed in 28us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872927.420611:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:0.0:1788872927.420622:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1788872927.420628:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327844480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872927.420661:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327844480:12345-0@lo:400:kworker.0 Request processed in 33us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872927.420667:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1788872927.420678:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1788872927.420683:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327844864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872927.420723:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327844864:12345-0@lo:400:kworker.0 Request processed in 39us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872927.420730:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1788872927.420741:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1788872927.420745:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327845376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872927.420769:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327845376:12345-0@lo:400:kworker.0 Request processed in 23us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872927.420775:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1788872927.420797:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327844352 00000100:00100000:0.0:1788872927.420801:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327844352 00000100:00100000:0.0:1788872927.420823:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788872927.420828:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327844352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872927.420857:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327844352:12345-0@lo:400:kworker.0 Request processed in 29us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872927.420863:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788872927.420926:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327844352:0@lo:400:kworker.0 00000100:00100000:0.0:1788872927.420939:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327844864:0@lo:400:kworker.0 00000100:00100000:0.0:1788872927.420947:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327845376:0@lo:400:kworker.0 00000100:00100000:0.0:1788872927.420956:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327844480:0@lo:400:kworker.0 00000100:00100000:1.0:1788872927.421666:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327845504 00000100:00100000:1.0:1788872927.421673:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327845504 00000100:00100000:1.0:1788872927.421726:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00100000:1.0:1788872927.421734:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327845504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872927.421794:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3645:x1875765327845504:12345-0@lo:400:kworker.0 Request processed in 62us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872927.421801:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00100000:1.0:1788872927.421834:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327844992 00000100:00100000:1.0:1788872927.421838:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327844992 00000100:00100000:1.0:1788872927.421861:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00000100:00100000:1.0:1788872927.421867:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327844992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872927.421899:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327844992:12345-0@lo:400:kworker.0 Request processed in 33us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872927.421906:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00000100:00080000:1.0:1788872927.421935:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872927.421940:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872927.421943:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872927.421944:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872927.422036:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327844992:0@lo:400:kworker.0 00000100:00100000:3.0:1788872927.422066:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327845504:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.422383:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327844608:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.422403:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327844736:0@lo:400:kworker.0 00000100:00100000:2.0:1788872927.422416:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327845760:0@lo:400:kworker.0 00010000:00010000:2.0:1788872927.545705:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872927.928778:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327845888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872927.928926:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872927.928976:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872927.928983:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327846016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872927.929032:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872927.929853:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327846144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872927.929894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872927.929938:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327845888 00000100:00100000:3.0:1788872927.929944:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327845888 00000100:00100000:3.0:1788872927.929981:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327846144 00000100:00100000:3.0:1788872927.929985:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327846144 00000100:00100000:3.0:1788872927.930003:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201 00000100:00100000:3.0:1788872927.930012:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327845888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872927.930039:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872927.930080:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327845888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872927.930087:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201 00000100:00100000:3.0:1788872927.930102:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202 00000100:00100000:3.0:1788872927.930108:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327846144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788872927.930123:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872927.930152:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327846144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872927.930157:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202 00000100:00100000:3.0:1788872927.930201:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327846144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872927.932267:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327845888:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788872927.950342:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969458 is committed 00000100:00100000:1.0:1788872927.951167:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327846016 00000100:00100000:1.0:1788872927.951189:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327846016 00000100:00100000:1.0:1788872927.951263:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037 00000100:00100000:1.0:1788872927.951273:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327846016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788872927.951346:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1298812928 00000100:00100000:1.0:1788872927.951447:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327846016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 176us (22414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872927.951455:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037 00000100:00100000:0.0:1788872927.951908:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327846016:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1788872927.959746:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969456 is committed 00000100:00100000:3.0:1788872928.010213:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872928.010407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872928.010443:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872928.010595:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311229440 00000100:00100000:2.0:1788872928.010606:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311229440 00000100:00100000:2.0:1788872928.010663:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311229312 00000100:00100000:2.0:1788872928.010667:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311229312 00000100:00100000:2.0:1788872928.010690:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1444 00000100:00100000:2.0:1788872928.010701:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2406:x1875765311229440:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872928.010771:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2406:x1875765311229440:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 71us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872928.010778:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1444 00000100:00100000:2.0:1788872928.010796:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1445 00000100:00100000:2.0:1788872928.010802:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2406:x1875765311229312:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872928.010838:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2406:x1875765311229312:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 36us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872928.010844:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1445 00000100:00080000:3.0:1788872928.011591:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872928.011597:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872928.011665:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311229184 00000100:00100000:1.0:1788872928.011671:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311229184 00000100:00100000:1.0:1788872928.011712:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 79 00000100:00100000:1.0:1788872928.011720:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311229184:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872928.011759:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311229184:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 40us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872928.011766:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 79 00000100:00100000:3.0:1788872928.015228:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872928.015580:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311229568 00000100:00100000:0.0:1788872928.015591:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311229568 00000100:00100000:0.0:1788872928.015651:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1451 00000100:00100000:0.0:1788872928.015660:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+6:72447:x1875765311229568:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:0.0:1788872928.015679:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872928.015699:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1f2 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872928.015760:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aec00/0xe4e6e89fb01dba0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872928.015775:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aec00/0xe4e6e89fb01dba0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872928.015788:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aec00/0xe4e6e89fb01dba0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872928.015904:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788872928.015908:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788872928.015942:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aec00/0xe4e6e89fb01dba0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872928.015966:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1f2 expref: 8 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872928.015985:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aec00/0xe4e6e89fb01dba0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1f2 expref: 7 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872928.016002:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:0.0:1788872928.016005:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788872928.016009:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52aec00, rc 0) 00000100:00100000:0.0:1788872928.016129:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72447:x1875765311229568:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 469us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872928.016136:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1451 00000100:00100000:0.0:1788872928.023781:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872928.023936:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311229696 00000100:00100000:2.0:1788872928.023945:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311229696 00000100:00100000:2.0:1788872928.024053:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1452 00000100:00100000:2.0:1788872928.024065:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72447:x1875765311229696:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:2.0:1788872928.024099:0:83669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1298812928 00000100:00100000:2.0:1788872928.024404:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72447:x1875765311229696:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 341us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872928.024425:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1452 00000100:00100000:1.0:1788872928.031272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872928.031348:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311229824 00000100:00100000:3.0:1788872928.031360:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311229824 00000100:00100000:3.0:1788872928.031434:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1453 00000100:00100000:3.0:1788872928.031447:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72447:x1875765311229824:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872928.031493:0:66190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1788872928.031605:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72447:x1875765311229824:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 160us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872928.031613:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1453 00000100:00100000:2.0:1788872928.036688:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872928.036862:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311229952 00000100:00100000:1.0:1788872928.036874:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311229952 00000100:00100000:1.0:1788872928.036919:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6007 00000100:00100000:1.0:1788872928.036928:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2403:x1875765311229952:12345-192.168.204.39@tcp:8:lfs.0 00010000:00080000:1.0:1788872928.036962:0:26188:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp t0 exp 0000000000000000 cur 3865 last 0 00000020:00000080:1.0:1788872928.037004:0:26188:0:(genops.c:1406:class_connect()) connect: client 0804304d-5904-48ad-87f2-bcbc7642a62a, cookie 0xe4e6e89fb01dba13 00002000:00100000:1.0:1788872928.037017:0:26188:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0804304d-5904-48ad-87f2-bcbc7642a62a/ffff98a9e98d6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788872928.037028:0:26188:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788872928.037453:0:26188:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788872928.037489:0:26188:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872928.037605:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311229952:12345-192.168.204.39@tcp:8:lfs.0 Request processed in 675us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872928.037614:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6007 00000100:00100000:1.0:1788872928.040460:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872928.040573:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311230080 00000100:00100000:3.0:1788872928.040584:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311230080 00000100:00100000:3.0:1788872928.040660:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2203 00000100:00100000:3.0:1788872928.040671:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+6:72447:x1875765311230080:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872928.040696:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872928.040812:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+6:72447:x1875765311230080:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 143us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872928.040830:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2203 00000100:00080000:1.0:1788872928.040992:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872928.050414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872928.050642:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311230208 00000100:00100000:1.0:1788872928.050655:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311230208 00000100:00100000:1.0:1788872928.050702:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6008 00000100:00100000:1.0:1788872928.050710:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2403:x1875765311230208:12345-192.168.204.39@tcp:8:lfs.0 00010000:00080000:1.0:1788872928.050746:0:26193:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp t0 exp 0000000000000000 cur 3865 last 0 00000020:00000080:1.0:1788872928.050783:0:26193:0:(genops.c:1406:class_connect()) connect: client 0804304d-5904-48ad-87f2-bcbc7642a62a, cookie 0xe4e6e89fb01dba1a 00002000:00100000:1.0:1788872928.050796:0:26193:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0804304d-5904-48ad-87f2-bcbc7642a62a/ffff98a9c2a7b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788872928.050808:0:26193:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788872928.050905:0:26193:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788872928.050949:0:26193:0:(import.c:65:import_set_state_nolock()) ffff98a9e99ac000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788872928.051095:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311230208:12345-192.168.204.39@tcp:8:lfs.0 Request processed in 384us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872928.051103:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6008 00000100:00100000:2.0:1788872928.066539:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872928.066678:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311230336 00000100:00100000:0.0:1788872928.066688:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311230336 00000100:00100000:0.0:1788872928.066754:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2204 00000100:00100000:0.0:1788872928.066764:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+6:72447:x1875765311230336:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:0.0:1788872928.066793:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00080000:1.0:1788872928.066986:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872928.067020:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+6:72447:x1875765311230336:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 257us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872928.067028:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2204 00010000:00010000:2.0:1788872928.571474:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872929.592652:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872930.623221:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872931.000783:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872931.000806:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327846272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872931.000874:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872931.000918:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327846272 00000100:00100000:1.0:1788872931.000924:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327846272 00000100:00100000:1.0:1788872931.000971:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205 00000100:00100000:1.0:1788872931.000981:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327846272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872931.001007:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872931.001068:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327846272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872931.001093:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205 00000100:00080000:1.0:1788872931.001114:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872931.001150:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327846272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872931.001827:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872931.001839:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327846400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872931.001874:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872931.001919:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327846400 00000100:00100000:0.0:1788872931.001923:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327846400 00000100:00100000:0.0:1788872931.001955:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206 00000100:00100000:0.0:1788872931.001962:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327846400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788872931.001981:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872931.002020:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327846400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872931.002046:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206 00000100:00100000:0.0:1788872931.002091:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327846400:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788872931.005188:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788872931.640688:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872932.537032:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327846656:0@lo:400:kworker.0 00000100:00100000:0.0:1788872932.537110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872932.537313:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327847168:0@lo:400:kworker.0 00000100:00100000:0.0:1788872932.537342:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872932.537367:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327847680:0@lo:400:kworker.0 00000100:00100000:0.0:1788872932.537389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872932.537468:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788872932.537475:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327846784:0@lo:400:kworker.0 00000100:00100000:0.0:1788872932.537500:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872932.537523:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327847296:0@lo:400:kworker.0 00000100:00100000:0.0:1788872932.537572:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872932.537594:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327847808:0@lo:400:kworker.0 00000100:00100000:0.0:1788872932.537615:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872932.537651:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327846656 00000100:00100000:0.0:1788872932.537657:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327846656 00000100:00100000:0.0:1788872932.537780:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327846784 00000100:00100000:0.0:1788872932.537784:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327846784 00000100:00100000:0.0:1788872932.537807:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1788872932.537816:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327846656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872932.537869:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327846656:12345-0@lo:400:kworker.0 Request processed in 54us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872932.537876:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1788872932.537907:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1788872932.537913:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327846784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872932.537946:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327846784:12345-0@lo:400:kworker.0 Request processed in 33us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872932.537952:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1788872932.537972:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327847168 00000100:00100000:0.0:1788872932.537976:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327847168 00000100:00100000:0.0:1788872932.538000:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327847680 00000100:00100000:0.0:1788872932.538002:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327847680 00000100:00100000:0.0:1788872932.538018:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038 00000100:00100000:0.0:1788872932.538024:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327847168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872932.538059:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327847168:12345-0@lo:400:kworker.0 Request processed in 36us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872932.538180:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327846528:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.538226:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872932.538267:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327847040:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.538291:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872932.538304:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327847552:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.538348:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872932.538364:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ef9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327848064:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.538383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872932.538399:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788872932.538404:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327846912:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.538423:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872932.538435:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c38b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327847424:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.538471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872932.538490:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327847936:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.538510:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872932.538538:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327847040 00000100:00100000:2.0:1788872932.538542:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327847040 00000100:00100000:2.0:1788872932.538611:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327847552 00000100:00100000:2.0:1788872932.538615:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327847552 00000100:00100000:2.0:1788872932.538625:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327848064 00000100:00100000:2.0:1788872932.538636:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327848064 00000100:00100000:2.0:1788872932.538650:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327846912 00000100:00100000:2.0:1788872932.538653:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327846912 00000100:00100000:2.0:1788872932.538667:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1788872932.538673:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327847040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.538725:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327847040:12345-0@lo:400:kworker.0 Request processed in 52us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872932.538731:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1788872932.538745:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1788872932.538750:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327847552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.538778:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327847552:12345-0@lo:400:kworker.0 Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872932.538783:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1788872932.538794:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:2.0:1788872932.538799:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327848064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.538821:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327848064:12345-0@lo:400:kworker.0 Request processed in 22us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872932.538826:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:2.0:1788872932.538836:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:2.0:1788872932.538841:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327846912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.538864:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327846912:12345-0@lo:400:kworker.0 Request processed in 23us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872932.538869:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:2.0:1788872932.538888:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039 00000100:00100000:2.0:1788872932.538895:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327847680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.538926:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327847680:12345-0@lo:400:kworker.0 Request processed in 31us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872932.538938:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039 00000100:00100000:2.0:1788872932.538960:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327846528 00000100:00100000:2.0:1788872932.538963:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327846528 00000100:00100000:2.0:1788872932.538990:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788872932.538996:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327846528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539024:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327846528:12345-0@lo:400:kworker.0 Request processed in 29us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872932.539030:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788872932.539061:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327847296 00000100:00100000:2.0:1788872932.539076:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327847296 00000100:00100000:2.0:1788872932.539100:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327847808 00000100:00100000:2.0:1788872932.539102:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327847808 00000100:00100000:2.0:1788872932.539116:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327847424 00000100:00100000:2.0:1788872932.539118:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327847424 00000100:00100000:2.0:1788872932.539129:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327847936 00000100:00100000:2.0:1788872932.539131:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327847936 00000100:00100000:2.0:1788872932.539147:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00100000:2.0:1788872932.539153:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6a9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327847296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539191:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6a9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327847296:12345-0@lo:400:kworker.0 Request processed in 32us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872932.539197:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000100:00100000:2.0:1788872932.539382:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730 00000100:00100000:2.0:1788872932.539388:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327847808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539419:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327847808:12345-0@lo:400:kworker.0 Request processed in 31us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872932.539425:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730 00000100:00100000:2.0:1788872932.539435:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:2.0:1788872932.539450:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327847424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539479:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327847424:12345-0@lo:400:kworker.0 Request processed in 31us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872932.539485:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00100000:2.0:1788872932.539497:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00100000:2.0:1788872932.539503:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327847936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539527:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327847936:12345-0@lo:400:kworker.0 Request processed in 24us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872932.539532:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00100000:2.0:1788872932.539599:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327846912:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539609:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327847424:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539617:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969458 gen 2 00000100:00100000:2.0:1788872932.539631:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327847936:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539639:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327846528:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539649:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327847040:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539658:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327847552:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539667:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ef9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327848064:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539742:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327846784:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539752:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327847296:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539760:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969456 gen 2 00000100:00100000:2.0:1788872932.539769:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327847808:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539790:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327846656:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539799:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c38b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327847168:0@lo:400:kworker.0 00000100:00100000:2.0:1788872932.539809:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327847680:0@lo:400:kworker.0 00000100:00080000:2.0:1788872932.539851:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872932.539856:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872932.539858:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872932.539861:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872932.540359:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038 00000100:00100000:2.0:1788872932.542581:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327848192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872932.542656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872932.542835:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327848192 00000100:00100000:3.0:1788872932.542843:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327848192 00000100:00100000:3.0:1788872932.542894:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040 00000100:00100000:3.0:1788872932.542903:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327848192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788872932.542935:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1788872932.542988:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327848192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872932.542995:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040 00000100:00100000:1.0:1788872932.543087:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327848192:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788872932.664967:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872933.049320:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327848320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872933.049410:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872933.049669:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327848320 00000100:00100000:3.0:1788872933.049693:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327848320 00000100:00100000:3.0:1788872933.049757:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207 00000100:00100000:3.0:1788872933.049768:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327848320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788872933.049804:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872933.049872:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327848320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872933.049881:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207 00000100:00100000:0.0:1788872933.050344:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327848320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872933.050901:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327848576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872933.050945:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872933.050983:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872933.050989:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327848448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872933.051016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872933.051051:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327848448 00000100:00100000:2.0:1788872933.051055:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327848448 00000100:00100000:2.0:1788872933.051090:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041 00000100:00100000:2.0:1788872933.051097:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327848448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872933.051126:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1298812928 00000100:00100000:2.0:1788872933.051180:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327848448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872933.051186:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041 00000100:00100000:2.0:1788872933.051222:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327848448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872933.051511:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327848576 00000100:00100000:1.0:1788872933.051516:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327848576 00000100:00100000:1.0:1788872933.051576:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208 00000100:00100000:1.0:1788872933.051584:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327848576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872933.051602:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872933.051643:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327848576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872933.051650:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208 00000100:00100000:1.0:1788872933.051681:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327848576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788872933.132472:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872933.132530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872933.132603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872933.132635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872933.132660:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872933.132754:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311230976 00000100:00100000:2.0:1788872933.132777:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311230976 00000100:00100000:2.0:1788872933.132841:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311230848 00000100:00100000:2.0:1788872933.132844:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311230848 00000100:00100000:2.0:1788872933.132868:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2733 00000100:00100000:2.0:1788872933.132876:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2405:x1875765311230976:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872933.132951:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2405:x1875765311230976:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872933.132959:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2733 00000100:00100000:2.0:1788872933.132997:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2734 00000100:00100000:2.0:1788872933.133006:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2405:x1875765311230848:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872933.133042:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2405:x1875765311230848:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 38us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872933.133049:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2734 00000100:00100000:2.0:1788872933.133181:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311230720 00000100:00100000:2.0:1788872933.133185:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311230720 00000100:00100000:2.0:1788872933.133215:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311230592 00000100:00100000:2.0:1788872933.133218:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311230592 00000100:00100000:2.0:1788872933.133253:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1452 00000100:00100000:2.0:1788872933.133261:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2405:x1875765311230720:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872933.133297:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2405:x1875765311230720:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 38us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872933.133304:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1452 00000100:00100000:2.0:1788872933.133316:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1453 00000100:00100000:2.0:1788872933.133323:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311230592:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872933.133344:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311230592:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 22us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872933.133358:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1453 00000100:00080000:0.0:1788872933.133990:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872933.134007:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872933.134016:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872933.134018:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872933.135492:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311230464 00000100:00100000:1.0:1788872933.135507:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311230464 00000100:00100000:1.0:1788872933.135684:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 81 00000100:00100000:1.0:1788872933.135694:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311230464:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872933.135846:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311230464:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 153us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872933.135854:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 81 00010000:00010000:1.0:1788872933.693157:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788872934.074247:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000001:00100000:2.0:1788872934.076683:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00010000:00010000:2.0:1788872934.713849:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788872935.166076:0:94954:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1788872935.741615:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872936.121023:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327848704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872936.121138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872936.121639:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872936.121648:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327848832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872936.121709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872936.121853:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327848704 00000100:00100000:3.0:1788872936.121865:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327848704 00000100:00100000:3.0:1788872936.121974:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327848832 00000100:00100000:3.0:1788872936.121978:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327848832 00000100:00100000:3.0:1788872936.122007:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00100000:3.0:1788872936.122019:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327848704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872936.122060:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872936.122134:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327848704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872936.122143:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00100000:3.0:1788872936.122164:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210 00000100:00100000:3.0:1788872936.122182:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327848832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872936.122199:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872936.122225:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327848832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872936.122230:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210 00000100:00080000:2.0:1788872936.122631:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872936.122635:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872936.122690:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327848832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872936.122707:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327848704:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788872936.765005:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788872936.823046:0:95003:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1788872937.656914:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872937.656953:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9cb5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327848960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872937.657074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872937.658099:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327848960 00000100:00100000:0.0:1788872937.658114:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327848960 00000100:00100000:0.0:1788872937.658201:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042 00000100:00100000:0.0:1788872937.658214:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327848960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788872937.658256:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:0.0:1788872937.658356:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327848960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872937.658364:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042 00000100:00100000:1.0:1788872937.658681:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9cb5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327848960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872937.658894:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327849344:0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.658945:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872937.658973:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327849856:0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872937.659096:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327850368:0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872937.659163:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788872937.659170:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327849216:0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872937.659211:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327849728:0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872937.659267:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327850240:0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659288:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872937.659313:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327849856 00000100:00100000:3.0:1788872937.659318:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327849856 00000100:00100000:3.0:1788872937.659355:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327850368 00000100:00100000:3.0:1788872937.659359:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327850368 00000100:00100000:3.0:1788872937.659385:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327850240 00000100:00100000:3.0:1788872937.659387:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327850240 00000100:00100000:3.0:1788872937.659436:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735 00000100:00100000:3.0:1788872937.659444:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327849856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659489:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327849856:12345-0@lo:400:kworker.0 Request processed in 46us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872937.659496:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735 00000100:00100000:3.0:1788872937.659510:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736 00000100:00100000:3.0:1788872937.659516:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327850368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659543:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327850368:12345-0@lo:400:kworker.0 Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872937.659579:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736 00000100:00100000:3.0:1788872937.659599:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737 00000100:00100000:3.0:1788872937.659605:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327850240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659636:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327850240:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872937.659642:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737 00000100:00100000:3.0:1788872937.659664:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327849344 00000100:00100000:3.0:1788872937.659667:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327849344 00000100:00100000:3.0:1788872937.659692:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327849216 00000100:00100000:3.0:1788872937.659695:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327849216 00000100:00100000:3.0:1788872937.659712:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1788872937.659718:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327849344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659746:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765327849344:12345-0@lo:400:kworker.0 Request processed in 29us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872937.659753:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1788872937.659764:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1788872937.659769:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327849216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659796:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327849216:12345-0@lo:400:kworker.0 Request processed in 26us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872937.659801:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1788872937.659836:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327849216:0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659847:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327850240:0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659856:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765327849344:0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659864:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327849856:0@lo:400:kworker.0 00000100:00100000:3.0:1788872937.659873:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327850368:0@lo:400:kworker.0 00000100:00100000:2.0:1788872937.661112:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327849728 00000100:00100000:2.0:1788872937.661125:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327849728 00000100:00100000:2.0:1788872937.661202:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043 00000100:00100000:2.0:1788872937.661211:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327849728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872937.661294:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327849728:12345-0@lo:400:kworker.0 Request processed in 83us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872937.661300:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043 00000100:00080000:2.0:1788872937.661321:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788872937.661327:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872937.661342:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872937.661345:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872937.661406:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327849728:0@lo:400:kworker.0 00000100:00100000:1.0:1788872937.661704:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327849088:0@lo:400:kworker.0 00000100:00100000:1.0:1788872937.661754:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872937.661796:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327849600:0@lo:400:kworker.0 00000100:00100000:1.0:1788872937.661833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872937.661854:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327850112:0@lo:400:kworker.0 00000100:00100000:1.0:1788872937.661875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872937.661896:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788872937.661903:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327849472:0@lo:400:kworker.0 00000100:00100000:1.0:1788872937.661935:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872937.661953:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327849984:0@lo:400:kworker.0 00000100:00100000:1.0:1788872937.661977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872937.661994:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327850496:0@lo:400:kworker.0 00000100:00100000:1.0:1788872937.662014:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872937.662081:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327849600 00000100:00100000:1.0:1788872937.662086:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327849600 00000100:00100000:1.0:1788872937.662122:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327850112 00000100:00100000:1.0:1788872937.662125:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327850112 00000100:00100000:1.0:1788872937.662137:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327849472 00000100:00100000:1.0:1788872937.662151:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327849472 00000100:00100000:1.0:1788872937.662165:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327850496 00000100:00100000:1.0:1788872937.662167:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327850496 00000100:00100000:1.0:1788872937.662178:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:1.0:1788872937.662184:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327849600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872937.662224:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327849600:12345-0@lo:400:kworker.0 Request processed in 40us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872937.662240:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:1.0:1788872937.662255:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1788872937.662261:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327850112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872937.662291:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327850112:12345-0@lo:400:kworker.0 Request processed in 31us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872937.662297:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1788872937.662308:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:1.0:1788872937.662313:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327849472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872937.662338:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327849472:12345-0@lo:400:kworker.0 Request processed in 26us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872937.662343:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:1.0:1788872937.662355:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:1.0:1788872937.662359:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327850496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872937.662384:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327850496:12345-0@lo:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872937.662389:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:0.0:1788872937.662967:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327849984 00000100:00100000:0.0:1788872937.662974:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327849984 00000100:00100000:0.0:1788872937.663009:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738 00000100:00100000:0.0:1788872937.663019:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327849984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872937.663084:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327849984:12345-0@lo:400:kworker.0 Request processed in 68us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872937.663090:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738 00000100:00100000:0.0:1788872937.663152:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327849472:0@lo:400:kworker.0 00000100:00100000:0.0:1788872937.663166:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327849984:0@lo:400:kworker.0 00000100:00100000:0.0:1788872937.663182:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327850496:0@lo:400:kworker.0 00000100:00100000:0.0:1788872937.663193:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327849600:0@lo:400:kworker.0 00000100:00100000:0.0:1788872937.663201:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327850112:0@lo:400:kworker.0 00000100:00100000:2.0:1788872937.663636:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327849088 00000100:00100000:2.0:1788872937.663642:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327849088 00000100:00100000:2.0:1788872937.663675:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788872937.663682:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327849088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872937.663732:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327849088:12345-0@lo:400:kworker.0 Request processed in 50us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872937.663738:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788872937.663793:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788872937.663799:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872937.664047:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327849088:0@lo:400:kworker.0 00010000:00010000:1.0:1788872937.785276:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872938.169169:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788872938.169197:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327850624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872938.169336:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872938.169528:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327850752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872938.169582:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872938.169617:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872938.169624:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327850880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872938.169656:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327850752 00000100:00100000:1.0:1788872938.169664:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327850752 00000100:00100000:1.0:1788872938.169726:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044 00000100:00100000:1.0:1788872938.169734:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327850752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788872938.169786:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1298812928 00000100:00100000:1.0:1788872938.169838:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327850752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872938.169845:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044 00000100:00100000:1.0:1788872938.170895:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872938.178173:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327850624 00000100:00100000:2.0:1788872938.178190:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327850624 00000100:00100000:2.0:1788872938.178311:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327850880 00000100:00100000:2.0:1788872938.178316:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327850880 00000100:00100000:1.0:1788872938.178367:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327850752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872938.182652:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211 00000100:00100000:3.0:1788872938.182683:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327850624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788872938.182727:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872938.184009:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327850624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1339us (14667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872938.184021:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211 00000100:00100000:3.0:1788872938.184053:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212 00000100:00100000:3.0:1788872938.184063:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327850880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872938.184087:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872938.184145:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327850880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (13252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872938.184160:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212 00000100:00100000:3.0:1788872938.184211:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327850880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872938.185655:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327850624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872938.253719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872938.254397:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872938.254596:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311231232 00000100:00100000:1.0:1788872938.254608:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311231232 00000100:00100000:0.0:1788872938.254720:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311231488 00000100:00100000:0.0:1788872938.254740:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311231488 00000100:00100000:0.0:1788872938.254816:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2739 00000100:00100000:0.0:1788872938.254827:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311231488:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872938.254902:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311231488:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 78us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872938.254909:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2739 00000100:00100000:2.0:1788872938.255349:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872938.255381:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872938.255409:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872938.255432:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311231616 00000100:00100000:2.0:1788872938.255437:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311231616 00000100:00100000:1.0:1788872938.256399:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311231360 00000100:00100000:1.0:1788872938.256407:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311231360 00000100:00100000:0.0:1788872938.256502:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311231104 00000100:00100000:0.0:1788872938.256507:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311231104 00000100:00080000:3.0:1788872938.256529:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872938.256536:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872938.256540:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872938.256544:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 83 00000100:00100000:0.0:1788872938.256579:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311231104:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872938.256631:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1460 00000100:00100000:3.0:1788872938.256652:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2406:x1875765311231232:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872938.256652:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311231104:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 71us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872938.256666:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 83 00000100:00100000:3.0:1788872938.256702:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2406:x1875765311231232:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 61us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872938.256709:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1460 00000100:00100000:3.0:1788872938.256730:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1461 00000100:00100000:3.0:1788872938.256738:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2406:x1875765311231360:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872938.256768:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2406:x1875765311231360:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 31us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872938.256793:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1461 00000100:00100000:2.0:1788872938.257609:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2740 00000100:00100000:2.0:1788872938.257620:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311231616:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872938.257669:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311231616:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 51us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872938.257675:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2740 00000100:00080000:3.0:1788872938.274611:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788872938.809252:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872938.925009:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872938.925603:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311231744 00000100:00100000:0.0:1788872938.925614:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311231744 00000100:00100000:0.0:1788872938.925698:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1454 00000100:00100000:0.0:1788872938.925709:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72917:x1875765311231744:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:0.0:1788872938.925750:0:68674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1298812928 00000100:00100000:0.0:1788872938.925847:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+7:72917:x1875765311231744:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 140us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872938.925856:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1454 00000100:00100000:0.0:1788872938.932177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872938.932287:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311231872 00000100:00100000:3.0:1788872938.932301:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311231872 00000100:00100000:3.0:1788872938.932879:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1455 00000100:00100000:3.0:1788872938.932890:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72917:x1875765311231872:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872938.932943:0:83669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1788872938.933025:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:72917:x1875765311231872:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 136us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872938.933033:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1455 00000100:00100000:1.0:1788872938.938791:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872938.938918:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311232000 00000100:00100000:3.0:1788872938.938929:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311232000 00000100:00100000:3.0:1788872938.938989:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2213 00000100:00100000:3.0:1788872938.939000:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+5:72917:x1875765311232000:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872938.939059:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872938.939150:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+5:72917:x1875765311232000:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 152us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872938.939158:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2213 00000100:00100000:2.0:1788872938.944867:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872938.944998:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311232128 00000100:00100000:3.0:1788872938.945009:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311232128 00000100:00100000:3.0:1788872938.945074:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2214 00000100:00100000:3.0:1788872938.945086:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+5:72917:x1875765311232128:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:3.0:1788872938.945129:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872938.945216:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+5:72917:x1875765311232128:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 131us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872938.945240:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2214 00000100:00100000:1.0:1788872938.987875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872938.988040:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311232256 00000100:00100000:3.0:1788872938.988051:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311232256 00000100:00100000:3.0:1788872938.988109:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1456 00000100:00100000:3.0:1788872938.988134:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+7:71811:x1875765311232256:12345-192.168.204.39@tcp:101:bash.0 00010000:00010000:3.0:1788872938.988155:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872938.988176:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b600/0xe4e6e89fb01dba21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb1f9 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988281:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ba00/0xe4e6e89fb01dba28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988295:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ba00/0xe4e6e89fb01dba28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988318:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ba00/0xe4e6e89fb01dba28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988335:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988358:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988364:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988539:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ae00/0xe4e6e89fb01dba36 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988595:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ae00/0xe4e6e89fb01dba36 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988603:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ae00/0xe4e6e89fb01dba36 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872938.988645:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872938.988650:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872938.988685:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ae00/0xe4e6e89fb01dba36 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988698:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ba00/0xe4e6e89fb01dba28 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988705:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ba00/0xe4e6e89fb01dba28 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988711:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ba00/0xe4e6e89fb01dba28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988717:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ba00/0xe4e6e89fb01dba28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988722:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449ba00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872938.988726:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ba00/0xe4e6e89fb01dba28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988733:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ba00/0xe4e6e89fb01dba28 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988923:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:3.0:1788872938.988933:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872938.988939:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ba00/0xe4e6e89fb01dba28 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988946:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ba00/0xe4e6e89fb01dba28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988960:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988966:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988972:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988977:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449b400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872938.988980:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988985:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.988993:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff98a9fa834600) 00010000:00010000:3.0:1788872938.988996:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872938.989000:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.989006:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.989037:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b600/0xe4e6e89fb01dba21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1f9 expref: 9 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.989066:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ae00/0xe4e6e89fb01dba36 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1f9 expref: 8 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872938.989073:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9fa834f00) 00010000:00010000:3.0:1788872938.989075:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872938.989077:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449ae00, rc 0) 00000100:00100000:3.0:1788872938.989262:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71811:x1875765311232256:12345-192.168.204.39@tcp:101:bash.0 Request processed in 1130us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872938.989270:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1456 00000100:00100000:1.0:1788872938.996420:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872938.996619:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311232384 00000100:00100000:0.0:1788872938.996632:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311232384 00000100:00100000:0.0:1788872938.996704:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1457 00000100:00100000:0.0:1788872938.996716:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+8:71811:x1875765311232384:12345-192.168.204.39@tcp:101:bash.0 00010000:00010000:0.0:1788872938.996984:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872938.997010:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae400/0xe4e6e89fb01dba3d lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb200 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.997082:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba44 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.997096:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba44 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.997106:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba44 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.997133:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba4b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.997140:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba4b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.997148:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba4b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872938.997292:0:68674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68674:1875765327851008:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788872938.997409:0:68674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872938.997863:0:68674:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82bad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788872938.998385:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327851008 00000100:00100000:2.0:1788872938.998392:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327851008 00000100:00100000:2.0:1788872938.998454:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045 00000100:00100000:2.0:1788872938.998463:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68674:x1875765327851008:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788872938.998850:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68674:x1875765327851008:12345-0@lo:1000:mdt00_004.0 Request processed in 386us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872938.998859:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045 00000100:00100000:0.0:1788872938.999078:0:68674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68674:1875765327851008:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788872938.999146:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01dba52 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999164:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01dba52 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999190:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01dba52 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872938.999215:0:68674:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01dba52 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999229:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba44 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999235:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba44 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999241:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba44 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999247:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba44 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999252:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872938.999256:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba44 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999263:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba44 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999275:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9fa834f00) 00010000:00010000:0.0:1788872938.999279:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872938.999283:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba44 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999290:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba44 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999313:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba4b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999319:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba4b lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999324:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba4b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999330:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872938.999333:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba4b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999350:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba4b lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999360:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff98a9e1f8f400) 00010000:00010000:0.0:1788872938.999363:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872938.999366:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba4b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999372:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba4b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999410:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae400/0xe4e6e89fb01dba3d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb200 expref: 10 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999424:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af200/0xe4e6e89fb01dba52 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb200 expref: 9 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872938.999453:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9e1f8f500) 00010000:00010000:0.0:1788872938.999455:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788872938.999458:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af200, rc 0) 00000100:00100000:0.0:1788872938.999515:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+9:71811:x1875765311232384:12345-192.168.204.39@tcp:101:bash.0 Request processed in 2801us (3106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872938.999522:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1457 00000100:00100000:2.0:1788872939.017137:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872939.017237:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311232512 00000100:00100000:3.0:1788872939.017248:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311232512 00000100:00100000:3.0:1788872939.017323:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1458 00000100:00100000:3.0:1788872939.017334:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+9:71811:x1875765311232512:12345-192.168.204.39@tcp:101:bash.0 00010000:00010000:3.0:1788872939.017368:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872939.017391:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c449b600/0xe4e6e89fb01dba59 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb207 expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872939.018029:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba60 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872939.018046:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba60 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872939.018060:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba60 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872939.018109:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1788872939.018143:0:83669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788872939.018204:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c449b600/0xe4e6e89fb01dba59 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb207 expref: 11 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872939.018222:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba60 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb207 expref: 10 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872939.018230:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9c1358900) 00010000:00010000:3.0:1788872939.018233:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1788872939.018236:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449b400, rc 0) 00000100:00100000:3.0:1788872939.018300:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+10:71811:x1875765311232512:12345-192.168.204.39@tcp:101:bash.0 Request processed in 968us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872939.018308:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1458 00000100:00100000:1.0:1788872939.025874:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872939.025945:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872939.026207:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311232640 00000100:00100000:2.0:1788872939.026218:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311232640 00000100:00100000:2.0:1788872939.026284:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1459 00000100:00100000:2.0:1788872939.026296:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c273ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+10:71811:x1875765311232640:12345-192.168.204.39@tcp:101:bash.0 00010000:00010000:2.0:1788872939.026318:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872939.026339:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1ae00/0xe4e6e89fb01dba67 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb20e expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026411:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dba6e lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026426:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dba6e lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026437:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dba6e lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026463:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dba75 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026484:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dba75 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026491:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dba75 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026668:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1b400/0xe4e6e89fb01dba7c lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026677:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1b400/0xe4e6e89fb01dba7c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026684:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1b400/0xe4e6e89fb01dba7c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872939.026731:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788872939.026735:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788872939.026766:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1b400/0xe4e6e89fb01dba7c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026779:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1b400/0xe4e6e89fb01dba7c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026788:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dba6e lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026795:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dba6e lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026801:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dba6e lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026818:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dba6e lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026824:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1be00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872939.026828:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dba6e lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026835:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dba6e lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026848:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9c1358900) 00010000:00010000:2.0:1788872939.026851:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872939.026856:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dba6e lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026863:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dba6e lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026875:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dba75 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026881:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dba75 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026886:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dba75 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026890:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1aa00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872939.026902:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dba75 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026919:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dba75 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026927:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff98a9c1358800) 00010000:00010000:2.0:1788872939.026930:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872939.026933:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dba75 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026939:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dba75 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026969:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1ae00/0xe4e6e89fb01dba67 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb20e expref: 12 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026983:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1b400/0xe4e6e89fb01dba7c lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb20e expref: 11 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.026990:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff98a9c1358600) 00010000:00010000:2.0:1788872939.026992:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872939.026994:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9caa1b400, rc 0) 00000100:00100000:2.0:1788872939.027060:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c273ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+11:71811:x1875765311232640:12345-192.168.204.39@tcp:101:bash.0 Request processed in 765us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872939.027068:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1459 00000100:00100000:1.0:1788872939.031427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872939.031574:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311232896 00000100:00100000:3.0:1788872939.031587:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311232896 00000100:00100000:3.0:1788872939.031658:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6009 00000100:00100000:3.0:1788872939.031670:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2406:x1875765311232896:12345-192.168.204.39@tcp:101:bash.0 00010000:00010000:3.0:1788872939.031689:0:9961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872939.031712:0:9961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01dba83 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb215 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872939.031737:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x602:0x0] initial LVB size: 0, mtime: 0x6aa008b4, atime: 0x6aa008b4, ctime: 0x6aa008b4, blocks: 0x0 00010000:00010000:3.0:1788872939.031771:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=3876s v=(0 0) 00010000:00010000:3.0:1788872939.031776:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872939.031784:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01dba83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb215 expref: 6 pid: 9961 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872939.031819:0:9961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a391205/0xe4e6e89fb01dba83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb215 expref: 6 pid: 9961 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872939.031833:0:9961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449b600, rc 0) 00000100:00100000:3.0:1788872939.031910:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2406:x1875765311232896:12345-192.168.204.39@tcp:101:bash.0 Request processed in 243us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872939.031918:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6009 00000100:00100000:2.0:1788872939.041206:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311232768 00000100:00100000:2.0:1788872939.041227:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311232768 00000100:00100000:2.0:1788872939.041633:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 742 00000100:00100000:2.0:1788872939.041647:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2406:x1875765311232768:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788872939.041683:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872939.041710:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dba60 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb207 expref: 11 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.041732:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff98a9c1358900) 00010000:00010000:2.0:1788872939.041737:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872939.041861:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2406:x1875765311232768:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 218us (15915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872939.041870:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 742 00000100:00100000:3.0:1788872939.051821:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872939.052142:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311233024 00000100:00100000:0.0:1788872939.052154:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311233024 00000100:00100000:0.0:1788872939.052214:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1460 00000100:00100000:0.0:1788872939.052225:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+9:71811:x1875765311233024:12345-192.168.204.39@tcp:101:bash.0 00010000:00010000:0.0:1788872939.052246:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872939.052268:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba8a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb21c expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872939.052356:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba91 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872939.052371:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba91 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872939.052381:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba91 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872939.052396:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afc00/0xe4e6e89fb01dba98 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872939.052403:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afc00/0xe4e6e89fb01dba98 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872939.052427:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afc00/0xe4e6e89fb01dba98 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872939.052547:0:66192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66192:1875765327851136:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788872939.052634:0:66192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872939.052682:0:66192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f82bad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788872939.053350:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327851136 00000100:00100000:1.0:1788872939.053359:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327851136 00000100:00100000:1.0:1788872939.053407:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046 00000100:00100000:1.0:1788872939.053416:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66192:x1875765327851136:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788872939.053520:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66192:x1875765327851136:12345-0@lo:1000:mdt00_001.0 Request processed in 105us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872939.053528:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046 00000100:00100000:2.0:1788872939.053915:0:66192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66192:1875765327851136:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788872939.053988:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ae00/0xe4e6e89fb01dba9f lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054002:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ae00/0xe4e6e89fb01dba9f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054015:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ae00/0xe4e6e89fb01dba9f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872939.054043:0:66192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ae00/0xe4e6e89fb01dba9f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054060:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba91 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054067:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba91 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054073:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba91 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054096:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba91 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054102:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872939.054106:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba91 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054124:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba91 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054137:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff98a9fa834f00) 00010000:00010000:2.0:1788872939.054140:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872939.054144:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba91 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054150:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af600/0xe4e6e89fb01dba91 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054163:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afc00/0xe4e6e89fb01dba98 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054169:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afc00/0xe4e6e89fb01dba98 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054173:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afc00/0xe4e6e89fb01dba98 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054178:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52afc00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872939.054180:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afc00/0xe4e6e89fb01dba98 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054198:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afc00/0xe4e6e89fb01dba98 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054206:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff98a9e1f8f400) 00010000:00010000:2.0:1788872939.054208:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872939.054211:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afc00/0xe4e6e89fb01dba98 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054216:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afc00/0xe4e6e89fb01dba98 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054252:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dba8a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb21c expref: 11 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054266:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ae00/0xe4e6e89fb01dba9f lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb21c expref: 10 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.054273:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9c1358800) 00010000:00010000:2.0:1788872939.054275:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788872939.054277:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9caa1ae00, rc 0) 00000100:00100000:2.0:1788872939.054327:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+10:71811:x1875765311233024:12345-192.168.204.39@tcp:101:bash.0 Request processed in 2104us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872939.054334:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1460 00000100:00100000:3.0:1788872939.057922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872939.058059:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311233152 00000100:00100000:0.0:1788872939.058071:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311233152 00000100:00100000:0.0:1788872939.058142:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1461 00000100:00100000:0.0:1788872939.058154:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+10:71811:x1875765311233152:12345-192.168.204.39@tcp:101:bash.0 00010000:00010000:0.0:1788872939.058176:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872939.058200:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbaa6 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb223 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872939.058263:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbaad lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872939.058276:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbaad lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872939.058287:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbaad lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872939.058348:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788872939.058352:0:66190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1788872939.058422:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbaa6 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb223 expref: 12 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872939.058472:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbaad lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb223 expref: 11 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872939.058480:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9c1358100) 00010000:00010000:0.0:1788872939.058483:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1788872939.058486:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af400, rc 0) 00000100:00100000:0.0:1788872939.058577:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+11:71811:x1875765311233152:12345-192.168.204.39@tcp:101:bash.0 Request processed in 425us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872939.058585:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1461 00000100:00100000:0.0:1788872939.087062:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872939.087140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872939.088530:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311233408 00000100:00100000:3.0:1788872939.088545:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311233408 00000100:00100000:3.0:1788872939.088665:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 743 00000100:00100000:3.0:1788872939.088678:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2404:x1875765311233408:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788872939.088695:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872939.088722:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbaad lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb223 expref: 11 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872939.088742:0:26198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9c1358100) 00010000:00010000:3.0:1788872939.088973:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872939.089042:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2404:x1875765311233408:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 367us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872939.089049:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 743 00000100:00100000:2.0:1788872939.090073:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311233280 00000100:00100000:2.0:1788872939.090084:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311233280 00000100:00100000:2.0:1788872939.090153:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1462 00000100:00100000:2.0:1788872939.090163:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+10:71811:x1875765311233280:12345-192.168.204.39@tcp:101:bash.0 00010000:00010000:2.0:1788872939.090198:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872939.090219:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbab4 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb22a expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.090283:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1a800/0xe4e6e89fb01dbabb lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.090299:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1a800/0xe4e6e89fb01dbabb lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.090328:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1a800/0xe4e6e89fb01dbabb lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.090818:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1ac00/0xe4e6e89fb01dbac2 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.090830:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1ac00/0xe4e6e89fb01dbac2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.090839:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1ac00/0xe4e6e89fb01dbac2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091003:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1b200/0xe4e6e89fb01dbac9 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091013:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1b200/0xe4e6e89fb01dbac9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091020:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1b200/0xe4e6e89fb01dbac9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872939.091069:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x5:0x0]: returning size 0 00000004:00200000:2.0:1788872939.091083:0:66193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788872939.091108:0:66193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1b200/0xe4e6e89fb01dbac9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091133:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1b200/0xe4e6e89fb01dbac9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091145:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1a800/0xe4e6e89fb01dbabb lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091152:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1a800/0xe4e6e89fb01dbabb lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091159:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1a800/0xe4e6e89fb01dbabb lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091165:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1a800/0xe4e6e89fb01dbabb lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091171:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1a800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872939.091176:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1a800/0xe4e6e89fb01dbabb lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091184:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1a800/0xe4e6e89fb01dbabb lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091195:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff98a9c1358100) 00010000:00010000:2.0:1788872939.091199:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872939.091203:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1a800/0xe4e6e89fb01dbabb lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091210:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1a800/0xe4e6e89fb01dbabb lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091235:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1ac00/0xe4e6e89fb01dbac2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091241:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1ac00/0xe4e6e89fb01dbac2 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091247:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1ac00/0xe4e6e89fb01dbac2 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091253:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1ac00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872939.091256:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1ac00/0xe4e6e89fb01dbac2 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091262:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1ac00/0xe4e6e89fb01dbac2 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091270:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff98a9c1358e00) 00010000:00010000:2.0:1788872939.091273:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872939.091275:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1ac00/0xe4e6e89fb01dbac2 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.091281:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1ac00/0xe4e6e89fb01dbac2 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.092877:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbab4 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb22a expref: 12 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.093688:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff98a9caa1b200/0xe4e6e89fb01dbac9 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb22a expref: 11 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872939.093721:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff98a9c1358b00) 00010000:00010000:2.0:1788872939.093724:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872939.093727:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9caa1b200, rc 0) 00000100:00100000:0.0:1788872939.094350:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+11:71811:x1875765311233280:12345-192.168.204.39@tcp:101:bash.0 Request processed in 4184us (7293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872939.094360:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1462 00000100:00100000:0.0:1788872939.112242:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872939.112610:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311233536 00000100:00100000:3.0:1788872939.112722:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311233536 00000100:00100000:3.0:1788872939.112869:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6010 00000100:00100000:3.0:1788872939.112878:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2406:x1875765311233536:12345-192.168.204.39@tcp:101:bash.0 00010000:00010000:3.0:1788872939.112963:0:26196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872939.112988:0:26196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01dbad0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb231 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872939.113018:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x603:0x0] initial LVB size: 0, mtime: 0x6aa008b4, atime: 0x6aa008b4, ctime: 0x6aa008b4, blocks: 0x0 00010000:00010000:3.0:1788872939.113039:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x603:0x0].0x0 since=3876s v=(0 0) 00010000:00010000:3.0:1788872939.113044:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x603:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872939.113055:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01dbad0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb231 expref: 7 pid: 26196 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872939.113074:0:26196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048174450/0xe4e6e89fb01dbad0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb231 expref: 7 pid: 26196 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872939.113089:0:26196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449ba00, rc 0) 00000100:00100000:3.0:1788872939.113228:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2406:x1875765311233536:12345-192.168.204.39@tcp:101:bash.0 Request processed in 350us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872939.113235:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6010 00010000:00010000:2.0:1788872939.832814:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872940.857335:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872941.241356:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872941.241386:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327851264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872941.241467:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872941.241523:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327851264 00000100:00100000:3.0:1788872941.241532:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327851264 00000100:00100000:3.0:1788872941.241615:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215 00000100:00100000:3.0:1788872941.241624:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327851264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872941.241677:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872941.241845:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c49f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327851392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872941.241891:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872941.241925:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327851392 00000100:00100000:1.0:1788872941.241928:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327851392 00000100:00100000:1.0:1788872941.241957:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216 00000100:00100000:1.0:1788872941.241965:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327851392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872941.241982:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872941.242018:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327851392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872941.242026:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216 00000100:00100000:1.0:1788872941.242085:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c49f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327851392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872941.242325:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327851264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 701us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872941.242332:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215 00000100:00080000:3.0:1788872941.242353:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872941.242357:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872941.246759:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327851264:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788872941.880665:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872942.776906:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327851776:0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.776985:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872942.777025:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327852288:0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777062:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872942.777081:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327852800:0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777099:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872942.777120:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788872942.777126:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327851904:0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777143:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872942.777168:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327852416:0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777186:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872942.777201:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327852928:0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777218:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872942.777246:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327851776 00000100:00100000:3.0:1788872942.777253:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327851776 00000100:00100000:3.0:1788872942.777300:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327851904 00000100:00100000:3.0:1788872942.777303:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327851904 00000100:00100000:3.0:1788872942.777320:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:3.0:1788872942.777328:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327851776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777417:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327851776:12345-0@lo:400:kworker.0 Request processed in 90us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872942.777434:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:3.0:1788872942.777450:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:3.0:1788872942.777455:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327851904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777479:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327851904:12345-0@lo:400:kworker.0 Request processed in 24us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872942.777484:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:3.0:1788872942.777501:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327852288 00000100:00100000:3.0:1788872942.777504:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327852288 00000100:00100000:3.0:1788872942.777524:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327852800 00000100:00100000:3.0:1788872942.777527:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327852800 00000100:00100000:3.0:1788872942.777545:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327852416 00000100:00100000:3.0:1788872942.777574:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327852416 00000100:00100000:3.0:1788872942.777589:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327852928 00000100:00100000:3.0:1788872942.777591:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327852928 00000100:00100000:3.0:1788872942.777610:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741 00000100:00100000:3.0:1788872942.777616:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327852288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777644:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327852288:12345-0@lo:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872942.777649:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741 00000100:00100000:3.0:1788872942.777658:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742 00000100:00100000:3.0:1788872942.777663:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327852800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777682:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327852800:12345-0@lo:400:kworker.0 Request processed in 19us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872942.777687:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742 00000100:00100000:3.0:1788872942.777694:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743 00000100:00100000:3.0:1788872942.777699:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327852416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777728:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327852416:12345-0@lo:400:kworker.0 Request processed in 29us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872942.777734:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743 00000100:00100000:3.0:1788872942.777742:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744 00000100:00100000:3.0:1788872942.777747:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327852928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777765:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327852928:12345-0@lo:400:kworker.0 Request processed in 19us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872942.777770:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744 00000100:00080000:3.0:1788872942.777792:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872942.777797:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872942.777799:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872942.777801:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872942.777843:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327851904:0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777853:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327852416:0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777861:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327852928:0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777869:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327851776:0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777877:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327852288:0@lo:400:kworker.0 00000100:00100000:3.0:1788872942.777886:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327852800:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778002:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327851520:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778049:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872942.778077:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327852032:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778098:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872942.778113:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327852544:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872942.778142:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327853056:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872942.778172:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788872942.778178:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327851648:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872942.778208:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327852160:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872942.778251:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327852672:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778268:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872942.778301:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327851520 00000100:00100000:1.0:1788872942.778305:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327851520 00000100:00100000:1.0:1788872942.778332:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788872942.778338:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327851520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778367:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327851520:12345-0@lo:400:kworker.0 Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872942.778373:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788872942.778396:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327852032 00000100:00100000:1.0:1788872942.778399:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327852032 00000100:00100000:1.0:1788872942.778421:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327852544 00000100:00100000:1.0:1788872942.778423:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327852544 00000100:00100000:1.0:1788872942.778434:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327853056 00000100:00100000:1.0:1788872942.778436:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327853056 00000100:00100000:1.0:1788872942.778444:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327851648 00000100:00100000:1.0:1788872942.778445:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327851648 00000100:00100000:1.0:1788872942.778456:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:1.0:1788872942.778461:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327852032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778485:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327852032:12345-0@lo:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872942.778490:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00100000:1.0:1788872942.778498:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1788872942.778503:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327852544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778524:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327852544:12345-0@lo:400:kworker.0 Request processed in 20us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872942.778538:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1788872942.778576:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:1.0:1788872942.778582:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327853056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778608:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327853056:12345-0@lo:400:kworker.0 Request processed in 27us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872942.778614:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:1.0:1788872942.778624:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:1.0:1788872942.778629:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327851648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778654:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327851648:12345-0@lo:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872942.778660:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:1.0:1788872942.778680:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327852160 00000100:00100000:1.0:1788872942.778684:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327852160 00000100:00100000:1.0:1788872942.778707:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327852672 00000100:00100000:1.0:1788872942.778710:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327852672 00000100:00100000:1.0:1788872942.778729:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047 00000100:00100000:1.0:1788872942.778734:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327852160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778765:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327852160:12345-0@lo:400:kworker.0 Request processed in 31us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872942.778771:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047 00000100:00100000:1.0:1788872942.778783:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048 00000100:00100000:1.0:1788872942.778788:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327852672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778816:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327852672:12345-0@lo:400:kworker.0 Request processed in 28us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872942.778820:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048 00000100:00080000:1.0:1788872942.778863:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872942.778867:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788872942.778895:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327851648:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778904:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327852160:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778912:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327852672:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778920:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327851520:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778928:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327852032:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778937:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327852544:0@lo:400:kworker.0 00000100:00100000:1.0:1788872942.778947:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327853056:0@lo:400:kworker.0 00000100:00100000:0.0:1788872942.779425:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327853184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872942.779461:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872942.779877:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327853184 00000100:00100000:2.0:1788872942.779882:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327853184 00000100:00100000:2.0:1788872942.779910:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049 00000100:00100000:2.0:1788872942.779916:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327853184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872942.779942:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1788872942.783443:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327853184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3516us (3970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872942.783457:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049 00000100:00100000:0.0:1788872942.798862:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327853184:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788872942.906049:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872943.289094:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327853440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872943.289192:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872943.289243:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872943.289250:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327853312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872943.289277:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872943.289311:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327853440 00000100:00100000:1.0:1788872943.289318:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327853440 00000100:00100000:1.0:1788872943.289360:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327853312 00000100:00100000:1.0:1788872943.289364:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327853312 00000100:00100000:1.0:1788872943.289381:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217 00000100:00100000:1.0:1788872943.289389:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327853440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872943.289417:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872943.289470:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327853440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872943.289478:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217 00000100:00100000:1.0:1788872943.289510:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218 00000100:00100000:1.0:1788872943.289516:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327853312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872943.289532:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872943.289586:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327853312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872943.289592:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218 00000100:00100000:1.0:1788872943.289632:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327853312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872943.289644:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327853440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872943.290336:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327853568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872943.290381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872943.290637:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327853568 00000100:00100000:0.0:1788872943.290644:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327853568 00000100:00100000:0.0:1788872943.290690:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050 00000100:00100000:0.0:1788872943.290698:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327853568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872943.290726:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1298812928 00000100:00100000:0.0:1788872943.290868:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327853568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 171us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872943.290875:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050 00000100:00100000:3.0:1788872943.290976:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327853568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872943.372237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872943.372283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872943.372318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872943.372352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872943.372377:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872943.372459:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311233664 00000100:00100000:0.0:1788872943.372469:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311233664 00000100:00100000:0.0:1788872943.372536:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 85 00000100:00100000:0.0:1788872943.372581:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311233664:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872943.372650:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311233664:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 104us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872943.372658:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 85 00000100:00100000:1.0:1788872943.373339:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311233920 00000100:00100000:1.0:1788872943.373351:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311233920 00000100:00100000:1.0:1788872943.373412:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311233792 00000100:00100000:1.0:1788872943.373416:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311233792 00000100:00100000:1.0:1788872943.373456:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1468 00000100:00100000:1.0:1788872943.373465:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2407:x1875765311233920:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872943.373524:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2407:x1875765311233920:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 49us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872943.373532:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1468 00000100:00100000:1.0:1788872943.373577:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1469 00000100:00100000:1.0:1788872943.373586:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2407:x1875765311233792:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872943.373613:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2407:x1875765311233792:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872943.373619:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1469 00000100:00100000:1.0:1788872943.373644:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311234176 00000100:00100000:1.0:1788872943.373648:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311234176 00000100:00100000:1.0:1788872943.373675:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311234048 00000100:00100000:1.0:1788872943.373691:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311234048 00000100:00100000:1.0:1788872943.373718:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2745 00000100:00100000:1.0:1788872943.373725:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2407:x1875765311234176:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872943.373754:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2407:x1875765311234176:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 29us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872943.373761:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2745 00000100:00100000:1.0:1788872943.373773:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2746 00000100:00100000:1.0:1788872943.373780:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311234048:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872943.373805:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311234048:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 26us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872943.373811:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2746 00000100:00080000:0.0:1788872943.375062:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872943.375069:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872943.375073:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872943.375075:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788872943.932780:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872944.957434:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872945.976761:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872946.364232:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788872946.364269:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327853696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872946.364353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872946.364407:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327853696 00000100:00100000:3.0:1788872946.364415:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327853696 00000100:00100000:3.0:1788872946.364491:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219 00000100:00100000:3.0:1788872946.364502:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327853696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872946.364538:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872946.364610:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327853696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872946.364618:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219 00000100:00080000:3.0:1788872946.364644:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872946.364683:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327853696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872946.365990:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f67a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327853824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872946.366044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872946.366158:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327853824 00000100:00100000:3.0:1788872946.366165:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327853824 00000100:00100000:3.0:1788872946.366222:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00100000:3.0:1788872946.366229:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327853824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872946.366261:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872946.366305:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327853824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872946.366311:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00080000:2.0:1788872946.366948:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872946.367081:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f67a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327853824:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788872947.004910:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872947.897158:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788872947.897227:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327853952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872947.897300:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872947.897355:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327853952 00000100:00100000:3.0:1788872947.897363:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327853952 00000100:00100000:3.0:1788872947.897414:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051 00000100:00100000:3.0:1788872947.897421:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327853952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788872947.897504:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1788872947.897586:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327853952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 164us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872947.897593:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051 00000100:00100000:3.0:1788872947.897639:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327853952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872947.898110:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327854464:0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.898143:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872947.898166:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327854976:0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.898189:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872947.898224:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327855488:0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.898245:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872947.898265:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788872947.898271:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327854336:0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.898291:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872947.898307:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327854848:0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.898324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872947.898337:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327855360:0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.898368:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872947.898394:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327854464 00000100:00100000:0.0:1788872947.898398:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327854464 00000100:00100000:0.0:1788872947.898450:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327855488 00000100:00100000:0.0:1788872947.898454:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327855488 00000100:00100000:0.0:1788872947.898469:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327854336 00000100:00100000:0.0:1788872947.898472:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327854336 00000100:00100000:0.0:1788872947.898490:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1788872947.898497:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327854464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.898570:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327854464:12345-0@lo:400:kworker.0 Request processed in 51us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872947.898577:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1788872947.898593:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1788872947.898599:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327855488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.898627:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327855488:12345-0@lo:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872947.898633:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1788872947.898645:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:0.0:1788872947.898651:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327854336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.898677:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327854336:12345-0@lo:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872947.898682:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:0.0:1788872947.898701:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327854976 00000100:00100000:0.0:1788872947.898704:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327854976 00000100:00100000:2.0:1788872947.898931:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327854208:0@lo:400:kworker.0 00000100:00100000:2.0:1788872947.898992:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872947.899013:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327854720:0@lo:400:kworker.0 00000100:00100000:2.0:1788872947.899062:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872947.899081:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327855232:0@lo:400:kworker.0 00000100:00100000:2.0:1788872947.899114:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872947.899133:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788872947.899140:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327854080:0@lo:400:kworker.0 00000100:00100000:2.0:1788872947.899167:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872947.899191:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327854592:0@lo:400:kworker.0 00000100:00100000:2.0:1788872947.899211:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872947.899220:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327855104:0@lo:400:kworker.0 00000100:00100000:2.0:1788872947.899240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872947.899263:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327854720 00000100:00100000:2.0:1788872947.899267:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327854720 00000100:00100000:2.0:1788872947.899296:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4052 00000100:00100000:2.0:1788872947.899303:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327854720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872947.899339:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327854720:12345-0@lo:400:kworker.0 Request processed in 36us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872947.899345:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4052 00000100:00100000:2.0:1788872947.899377:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327854720:0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.899477:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327854848 00000100:00100000:0.0:1788872947.899482:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327854848 00000100:00100000:0.0:1788872947.899499:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327855360 00000100:00100000:0.0:1788872947.899502:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327855360 00000100:00100000:0.0:1788872947.899529:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327855232 00000100:00100000:0.0:1788872947.899676:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327855232 00000100:00100000:0.0:1788872947.899703:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747 00000100:00100000:0.0:1788872947.899709:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327854976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.900211:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327854976:12345-0@lo:400:kworker.0 Request processed in 500us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872947.900218:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747 00000100:00100000:0.0:1788872947.900236:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748 00000100:00100000:0.0:1788872947.900242:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327854848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.900271:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327854848:12345-0@lo:400:kworker.0 Request processed in 29us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872947.900277:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748 00000100:00100000:0.0:1788872947.900288:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749 00000100:00100000:0.0:1788872947.900294:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327855360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.900320:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327855360:12345-0@lo:400:kworker.0 Request processed in 27us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872947.900326:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749 00000100:00100000:0.0:1788872947.900336:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:0.0:1788872947.900342:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327855232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.900379:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327855232:12345-0@lo:400:kworker.0 Request processed in 36us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872947.900385:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00000100:00100000:0.0:1788872947.900406:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327854208 00000100:00100000:0.0:1788872947.900409:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327854208 00000100:00100000:0.0:1788872947.901840:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327854592 00000100:00100000:0.0:1788872947.901851:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327854592 00000100:00100000:0.0:1788872947.901881:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327855104 00000100:00100000:0.0:1788872947.901891:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327855104 00000100:00100000:0.0:1788872947.901912:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1788872947.901920:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327854208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.902017:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327854208:12345-0@lo:400:kworker.0 Request processed in 97us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872947.902023:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1788872947.902040:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:0.0:1788872947.902046:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327854592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.902077:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327854592:12345-0@lo:400:kworker.0 Request processed in 31us (2865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872947.902083:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:0.0:1788872947.902095:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:0.0:1788872947.902100:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327855104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.902128:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327855104:12345-0@lo:400:kworker.0 Request processed in 28us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872947.902134:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00080000:0.0:1788872947.902169:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872947.902173:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872947.902177:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872947.902179:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872947.902207:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327854080 00000100:00100000:0.0:1788872947.902212:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327854080 00000100:00100000:0.0:1788872947.903075:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788872947.903089:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327854080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872947.903137:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327854080:12345-0@lo:400:kworker.0 Request processed in 52us (3969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872947.903143:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788872947.910912:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327854336:0@lo:400:kworker.0 00000100:00100000:3.0:1788872947.910933:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327854848:0@lo:400:kworker.0 00000100:00100000:3.0:1788872947.910957:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327855360:0@lo:400:kworker.0 00000100:00100000:3.0:1788872947.910969:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327854464:0@lo:400:kworker.0 00000100:00100000:3.0:1788872947.910981:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327854976:0@lo:400:kworker.0 00000100:00100000:3.0:1788872947.910992:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327855488:0@lo:400:kworker.0 00000100:00100000:3.0:1788872947.914617:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327854080:0@lo:400:kworker.0 00000100:00100000:3.0:1788872947.914647:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327854592:0@lo:400:kworker.0 00000100:00100000:3.0:1788872947.914663:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327855104:0@lo:400:kworker.0 00000100:00100000:3.0:1788872947.914676:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327854208:0@lo:400:kworker.0 00000100:00100000:3.0:1788872947.914689:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327855232:0@lo:400:kworker.0 00010000:00010000:2.0:1788872948.029814:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872948.408695:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327855616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872948.408779:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872948.409354:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327855616 00000100:00100000:0.0:1788872948.409361:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327855616 00000100:00100000:2.0:1788872948.409723:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327855744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872948.409767:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872948.409863:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327855744 00000100:00100000:1.0:1788872948.409869:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327855744 00000100:00100000:1.0:1788872948.409913:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221 00000100:00100000:1.0:1788872948.409924:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327855744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788872948.409965:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788872948.410017:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327855744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872948.410024:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221 00000100:00100000:1.0:1788872948.410070:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327855744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788872948.411539:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053 00000100:00100000:0.0:1788872948.411572:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327855616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872948.411608:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1298812928 00000100:00100000:0.0:1788872948.411686:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327855616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (2906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872948.411692:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053 00000100:00100000:2.0:1788872948.411962:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327855616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872948.412020:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327855872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872948.412060:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872948.412160:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327855872 00000100:00100000:1.0:1788872948.412167:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327855872 00000100:00100000:1.0:1788872948.412210:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222 00000100:00100000:1.0:1788872948.412217:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327855872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872948.412246:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872948.412288:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327855872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872948.412295:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222 00000100:00100000:1.0:1788872948.412325:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327855872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872948.495465:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872948.495513:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872948.495575:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872948.495603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872948.495631:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872948.495658:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311234816 00000100:00100000:2.0:1788872948.495667:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311234816 00000100:00100000:2.0:1788872948.495738:0:26186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311234688 00000100:00100000:2.0:1788872948.495742:0:26186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311234688 00000100:00100000:2.0:1788872948.495766:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2751 00000100:00100000:2.0:1788872948.495776:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311234816:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872948.495861:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311234816:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872948.495870:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2751 00000100:00100000:2.0:1788872948.495889:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2752 00000100:00100000:2.0:1788872948.496085:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311234688:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872948.496114:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311234688:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 33us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872948.496121:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2752 00000100:00100000:2.0:1788872948.496142:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311234560 00000100:00100000:2.0:1788872948.496146:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311234560 00000100:00100000:2.0:1788872948.496177:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311234432 00000100:00100000:2.0:1788872948.496180:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311234432 00000100:00100000:2.0:1788872948.496203:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1476 00000100:00100000:2.0:1788872948.496223:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2405:x1875765311234560:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872948.496253:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2405:x1875765311234560:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 31us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872948.496259:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1476 00000100:00100000:2.0:1788872948.496271:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1477 00000100:00100000:2.0:1788872948.496278:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2405:x1875765311234432:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872948.496300:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2405:x1875765311234432:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 23us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872948.496306:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1477 00000100:00080000:2.0:1788872948.496326:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788872948.496330:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872948.496332:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788872948.496334:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872948.496623:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311234304 00000100:00100000:1.0:1788872948.496629:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311234304 00000100:00100000:1.0:1788872948.496663:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 87 00000100:00100000:1.0:1788872948.496671:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311234304:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872948.496702:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311234304:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 33us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872948.496720:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 87 00000020:00000080:2.0:1788872949.026429:0:95294:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe919b4e70 20000000:00000080:2.0:1788872949.026448:0:95294:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff98a9f09d9400 uarg=0000000000000000 00000040:00100000:2.0:1788872949.027080:0:95294:0:(llog.c:1072:llog_reverse_process()) index 57 : idx 49 20000000:01000000:2.0:1788872949.027089:0:95294:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:2.0:1788872949.027107:0:95294:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1788872949.033587:0:95295:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 55 marker 44 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1788872949.033678:0:95295:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 57 marker 44 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1788872949.033692:0:95295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:0.0:1788872949.034709:0:95294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:0.0:1788872949.034733:0:95294:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1788872949.034752:0:95294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:0.0:1788872949.034771:0:95294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:0.0:1788872949.040859:0:95294:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1788872949.043988:0:95296:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 45 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1788872949.044065:0:95296:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 45 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1788872949.044080:0:95296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:2.0:1788872949.044337:0:95294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:2.0:1788872949.044353:0:95294:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1788872949.044369:0:95294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:2.0:1788872949.044386:0:95294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:2.0:1788872949.044402:0:95294:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1788872949.045763:0:95297:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 46 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1788872949.045819:0:95297:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 46 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1788872949.045832:0:95297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:2.0:1788872949.046860:0:95294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:2.0:1788872949.046876:0:95294:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1788872949.047085:0:95294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:2.0:1788872949.047107:0:95294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:2.0:1788872949.047137:0:95294:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788872949.047159:0:95294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047182:0:95294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c4f9da00/0xe4e6e89fb01db607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1d6 expref: 9 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047190:0:95294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01db615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1e4 expref: 9 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047198:0:95294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9efac4800/0xe4e6e89fb01db63f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db638 expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047205:0:95294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9fa899c00/0xe4e6e89fb01db718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db711 expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047211:0:95294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db742 expref: 23 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047219:0:95294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01db765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db75e expref: 23 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047227:0:95294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db78f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db788 expref: 23 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047234:0:95294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9fa898a00/0xe4e6e89fb01db79d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db796 expref: 23 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047240:0:95294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9efac4a00/0xe4e6e89fb01db7b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7b2 expref: 23 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047247:0:95294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7c0 expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047261:0:95294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01db7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7ea expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047269:0:95294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047314:0:95294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01db7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db7ea expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047334:0:95294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01db7f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db7ea expref: 23 pid: 94375 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.047351:0:95294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327856000:0@lo:104: 00000100:00100000:2.0:1788872949.047444:0:95294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788872949.047544:0:95294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db7c0 expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.047588:0:95294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db7c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db7c0 expref: 23 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.047600:0:95294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327856128:0@lo:104: 00000100:00100000:2.0:1788872949.047626:0:95294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788872949.048073:0:95294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9efac4a00/0xe4e6e89fb01db7b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db7b2 expref: 23 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.048083:0:95294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9efac4a00/0xe4e6e89fb01db7b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db7b2 expref: 23 pid: 94382 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.048092:0:95294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327856256:0@lo:104: 00000100:00100000:2.0:1788872949.048120:0:95294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872949.050056:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327856000 00000100:00100000:3.0:1788872949.050069:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327856000 00000100:00100000:3.0:1788872949.050189:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327856128 00000100:00100000:3.0:1788872949.050193:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327856128 00010000:00010000:2.0:1788872949.050471:0:95294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9fa898a00/0xe4e6e89fb01db79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db796 expref: 23 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.050487:0:95294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9fa898a00/0xe4e6e89fb01db79d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db796 expref: 23 pid: 94381 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.050499:0:95294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327856384:0@lo:104: 00000100:00100000:2.0:1788872949.050561:0:95294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872949.051188:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327856256 00000100:00100000:1.0:1788872949.051195:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327856256 00000100:00100000:1.0:1788872949.051233:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788872949.051244:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:95294:x1875765327856000:12345-0@lo:104: 00010000:00010000:1.0:1788872949.051261:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db7f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051341:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788872949.051347:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:95294:x1875765327856000:12345-0@lo:104: Request processed in 106us (3903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872949.051353:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788872949.051384:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788872949.051389:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:95294:x1875765327856128:12345-0@lo:104: 00010000:00010000:1.0:1788872949.051397:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db7c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051453:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788872949.051457:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:95294:x1875765327856128:12345-0@lo:104: Request processed in 69us (3832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872949.051463:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788872949.051476:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788872949.051480:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:95294:x1875765327856256:12345-0@lo:104: 00010000:00010000:1.0:1788872949.051487:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db7b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051517:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788872949.051521:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:95294:x1875765327856256:12345-0@lo:104: Request processed in 41us (3402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872949.051526:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00010000:00010000:1.0:1788872949.051596:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872949.051603:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db7f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051610:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872949.051614:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db7f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051622:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db7f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872949.051638:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db7f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872949.051643:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788872949.051674:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db7f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051680:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872949.051710:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db7f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051717:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa898400/0xe4e6e89fb01db7ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db7f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051732:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872949.051735:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db7c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051740:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872949.051742:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db7c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051749:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db7c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872949.051755:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db7c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872949.051759:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788872949.051780:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db7c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051785:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872949.051801:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db7c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051807:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9d600/0xe4e6e89fb01db7c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db7c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051817:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872949.051820:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db7b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051825:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ce00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872949.051828:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db7b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051834:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db7b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872949.051850:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db7b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872949.051855:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788872949.051867:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db7b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.051874:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872949.051879:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db7b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.052222:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9ce00/0xe4e6e89fb01db7b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db7b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.052233:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872949.052235:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872949.052236:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872949.052244:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872949.052249:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872949.052255:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872949.052277:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327856512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872949.052369:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872949.052446:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327856640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872949.052470:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872949.052490:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788872949.052495:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327856768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872949.052515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872949.052542:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327856512 00000100:00100000:1.0:1788872949.052567:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327856512 00010000:00010000:1.0:1788872949.052592:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01db7f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db7ea expref: 24 pid: 94375 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872949.052616:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327856640 00000100:00100000:1.0:1788872949.052618:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327856640 00010000:00010000:1.0:1788872949.052629:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db7c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db7c0 expref: 25 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872949.052647:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327856768 00000100:00100000:1.0:1788872949.052649:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327856768 00010000:00010000:1.0:1788872949.052668:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9efac4a00/0xe4e6e89fb01db7b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db7b2 expref: 26 pid: 94382 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872949.052688:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:1.0:1788872949.052694:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f8208450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+26:3645:x1875765327856512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872949.052813:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872949.052819:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01db7f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db7ea expref: 26 pid: 94375 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.052830:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01db7f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db7ea expref: 26 pid: 94375 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.052857:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872949.053031:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f8208450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+26:3645:x1875765327856512:12345-0@lo:103:ldlm_bl.0 Request processed in 336us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872949.053039:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:1.0:1788872949.053094:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1788872949.053100:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3646:x1875765327856640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872949.053107:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872949.053112:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db7c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db7c0 expref: 25 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.053120:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db7c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db7c0 expref: 25 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.053170:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872949.053205:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3646:x1875765327856640:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872949.053212:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1788872949.053235:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:1.0:1788872949.053241:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327856768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872949.053249:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872949.053254:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9efac4a00/0xe4e6e89fb01db7b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db7b2 expref: 24 pid: 94382 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.053263:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9efac4a00/0xe4e6e89fb01db7b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db7b2 expref: 24 pid: 94382 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.053272:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872949.053295:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327856768:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872949.053301:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:1.0:1788872949.053349:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327856768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872949.053358:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327856640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872949.053382:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327856512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872949.054208:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327856384 00000100:00100000:0.0:1788872949.054215:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327856384 00000100:00100000:1.0:1788872949.054304:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788872949.054313:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:95294:x1875765327856384:12345-0@lo:104: 00010000:00010000:1.0:1788872949.054327:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db79d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.054383:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788872949.054388:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:95294:x1875765327856384:12345-0@lo:104: Request processed in 78us (3842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872949.054398:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00010000:0.0:1788872949.054411:0:14981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872949.054419:0:14981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db79d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872949.054507:0:14981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898e00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872949.054512:0:14981:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db79d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872949.054757:0:14981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db79d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872949.054765:0:14981:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db79d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872949.054772:0:14981:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872949.054820:0:95294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db788 expref: 23 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.054833:0:95294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db78f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db788 expref: 23 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.054939:0:14981:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db79d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.054948:0:14981:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788872949.054995:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327857024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872949.055023:0:95294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327856896:0@lo:104: 00000100:00100000:0.0:1788872949.055040:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872949.055060:0:95294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872949.055115:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327857024 00000100:00100000:1.0:1788872949.055125:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327857024 00010000:00010000:1.0:1788872949.055143:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9fa898a00/0xe4e6e89fb01db79d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db796 expref: 24 pid: 94381 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.055166:0:95294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01db765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db75e expref: 24 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872949.055167:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1788872949.055177:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327857024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872949.055181:0:95294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01db765 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db75e expref: 24 pid: 94382 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.055187:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788872949.055194:0:95294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327857152:0@lo:104: 00010000:00010000:1.0:1788872949.055195:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9fa898a00/0xe4e6e89fb01db79d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db796 expref: 24 pid: 94381 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.055211:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9fa898a00/0xe4e6e89fb01db79d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db796 expref: 24 pid: 94381 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.055227:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872949.055233:0:95294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788872949.055264:0:95294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db742 expref: 24 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.055273:0:95294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db749 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db742 expref: 24 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.055279:0:14981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db79d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.055295:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa898e00/0xe4e6e89fb01db796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db79d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.055305:0:95294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327857280:0@lo:104: 00010000:00010000:3.0:1788872949.055322:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872949.055326:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872949.055328:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872949.055342:0:95294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9fa899c00/0xe4e6e89fb01db718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db711 expref: 24 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.055350:0:95294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9fa899c00/0xe4e6e89fb01db718 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db711 expref: 24 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.055360:0:95294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327857408:0@lo:104: 00010000:00010000:2.0:1788872949.055384:0:95294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9efac4800/0xe4e6e89fb01db63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db638 expref: 24 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.055392:0:95294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9efac4800/0xe4e6e89fb01db63f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db638 expref: 24 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.055399:0:95294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327857536:0@lo:104: 00010000:00010000:2.0:1788872949.055801:0:95294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01db615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1e4 expref: 9 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.055812:0:95294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01db615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1e4 expref: 9 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.055822:0:95294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327857664:192.168.204.39@tcp:104: 00000100:00100000:0.0:1788872949.055967:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9c77b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327857024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872949.056019:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327857024:12345-0@lo:103:ldlm_bl.0 Request processed in 842us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872949.056027:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00010000:00010000:2.0:1788872949.056038:0:95294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c4f9da00/0xe4e6e89fb01db607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1d6 expref: 9 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872949.056048:0:95294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c4f9da00/0xe4e6e89fb01db607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1d6 expref: 9 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.056067:0:95294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327857792:192.168.204.39@tcp:104: 00000100:00100000:2.0:1788872949.056088:0:95294:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7119e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788872949.056101:0:95294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac4000/0xe4e6e89fb01db7f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db7ea expref: 23 pid: 94375 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.056111:0:95294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327856000:0@lo:104: 00010000:00010000:2.0:1788872949.056121:0:95294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac4600/0xe4e6e89fb01db7c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db7c0 expref: 22 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.056129:0:95294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327856128:0@lo:104: 00010000:00010000:2.0:1788872949.056139:0:95294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac4a00/0xe4e6e89fb01db7b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db7b2 expref: 21 pid: 94382 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.056148:0:95294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327856256:0@lo:104: 00010000:00010000:2.0:1788872949.056159:0:95294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa898a00/0xe4e6e89fb01db79d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db796 expref: 20 pid: 94381 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.056170:0:95294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327856384:0@lo:104: 00000100:00100000:1.0:1788872949.056260:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788872949.056278:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872949.056332:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872949.056514:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872949.056534:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327856896 00000100:00100000:3.0:1788872949.056540:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327856896 00000100:00100000:0.0:1788872949.056667:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327857152 00000100:00100000:0.0:1788872949.056671:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327857152 00000100:00100000:3.0:1788872949.056703:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327857280 00000100:00100000:3.0:1788872949.056706:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327857280 00000100:00100000:1.0:1788872949.056751:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327857408 00000100:00100000:1.0:1788872949.056754:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327857408 00000100:00100000:0.0:1788872949.056786:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327857536 00000100:00100000:0.0:1788872949.056789:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327857536 00000100:00100000:0.0:1788872949.056802:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788872949.056808:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:95294:x1875765327856896:12345-0@lo:104: 00010000:00010000:0.0:1788872949.056819:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872949.056949:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788872949.056955:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:95294:x1875765327856896:12345-0@lo:104: Request processed in 148us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872949.056961:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788872949.056974:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788872949.056980:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c371d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:95294:x1875765327857152:12345-0@lo:104: 00010000:00010000:0.0:1788872949.056990:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872949.057046:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788872949.057142:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c371d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:95294:x1875765327857152:12345-0@lo:104: Request processed in 161us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872949.057150:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788872949.057190:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788872949.057197:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:95294:x1875765327857536:12345-0@lo:104: 00010000:00010000:0.0:1788872949.057207:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db63f expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872949.057247:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788872949.057253:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:95294:x1875765327857536:12345-0@lo:104: Request processed in 57us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872949.057258:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788872949.057324:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788872949.057333:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:95294:x1875765327857280:12345-0@lo:104: 00010000:00010000:3.0:1788872949.057343:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db749 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.057397:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788872949.057402:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:95294:x1875765327857280:12345-0@lo:104: Request processed in 72us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872949.057408:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788872949.057513:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00010000:00010000:1.0:1788872949.057644:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788872949.057651:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.057660:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872949.057664:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.057686:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872949.057698:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872949.057704:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788872949.057733:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:95294:x1875765327857408:12345-0@lo:104: 00010000:00010000:1.0:1788872949.057738:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.057752:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872949.057755:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db718 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.057788:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788872949.057793:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:95294:x1875765327857408:12345-0@lo:104: Request processed in 274us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872949.057799:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00010000:00010000:1.0:1788872949.057846:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.057855:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa898800/0xe4e6e89fb01db788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.057872:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788872949.057875:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.057881:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872949.057884:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.057891:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872949.057897:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872949.057908:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788872949.057935:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872949.057936:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327857920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872949.057946:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872949.057963:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.057969:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c400/0xe4e6e89fb01db75e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872949.057978:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788872949.057982:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788872949.057986:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db63f expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.057991:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872949.057995:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db63f expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058001:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db63f expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872949.058008:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db63f expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872949.058012:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788872949.058027:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db63f expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058032:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788872949.058036:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327857920 00000100:00100000:3.0:1788872949.058042:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327857920 00010000:00010000:1.0:1788872949.058046:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db63f expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058053:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9efac5600/0xe4e6e89fb01db638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db63f expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058062:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788872949.058064:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db749 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058069:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872949.058072:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db749 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058078:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db749 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872949.058083:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db749 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872949.058087:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788872949.058099:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db749 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058104:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872949.058112:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db749 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058118:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9efac5200/0xe4e6e89fb01db742 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db749 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058125:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788872949.058135:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db718 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058141:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1788872949.058144:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db718 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.058147:0:26197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db78f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db788 expref: 20 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058155:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db718 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788872949.058162:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db718 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872949.058167:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788872949.058181:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db718 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058187:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788872949.058193:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db718 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058198:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa899400/0xe4e6e89fb01db711 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db718 expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058285:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872949.058288:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872949.058289:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872949.058305:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327858176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872949.058341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872949.058344:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:3.0:1788872949.058352:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3645:x1875765327857920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872949.058365:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872949.058371:0:26197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db78f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db788 expref: 20 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.058384:0:26197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db78f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db788 expref: 20 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.058403:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872949.058511:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3645:x1875765327857920:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872949.058518:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:3.0:1788872949.058529:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327858176 00000100:00100000:3.0:1788872949.058537:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327858176 00010000:00010000:3.0:1788872949.058566:0:26197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9efac4800/0xe4e6e89fb01db63f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db638 expref: 20 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872949.058595:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872949.058604:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327858048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872949.058633:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872949.058644:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327858048 00000100:00100000:3.0:1788872949.058648:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327858048 00010000:00010000:3.0:1788872949.058662:0:26197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01db765 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db75e expref: 21 pid: 94382 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872949.058670:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:1.0:1788872949.058680:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3647:x1875765327858176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872949.058689:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788872949.058690:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00010000:00010000:1.0:1788872949.058697:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9efac4800/0xe4e6e89fb01db63f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db638 expref: 21 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872949.058703:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3647:x1875765327858048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872949.058715:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9efac4800/0xe4e6e89fb01db63f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db638 expref: 21 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.058717:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872949.058726:0:26197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01db765 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db75e expref: 21 pid: 94382 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.058729:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872949.058739:0:26197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01db765 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db75e expref: 21 pid: 94382 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.058751:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872949.058760:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3647:x1875765327858176:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872949.058782:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3647:x1875765327858048:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872949.058789:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00010000:00010000:2.0:1788872949.058815:0:95294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52afa00/0xe4e6e89fb01db78f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db788 expref: 20 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872949.058826:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327858432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872949.058829:0:95294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327856896:0@lo:104: 00000100:00100000:3.0:1788872949.058915:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872949.058951:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327857920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872949.058968:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872949.058974:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327858304:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872949.058986:0:95294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac4c00/0xe4e6e89fb01db765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db75e expref: 19 pid: 94382 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.058998:0:95294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327857152:0@lo:104: 00000100:00100000:3.0:1788872949.059003:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872949.059023:0:95294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327857280:0@lo:104: 00000100:00100000:2.0:1788872949.059039:0:95294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327857408:0@lo:104: 00010000:00010000:2.0:1788872949.059051:0:95294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac4800/0xe4e6e89fb01db63f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db638 expref: 18 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872949.059060:0:95294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327857536:0@lo:104: 00000100:00100000:3.0:1788872949.059115:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327858432 00000100:00100000:3.0:1788872949.059120:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327858432 00010000:00010000:3.0:1788872949.059135:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9fa899c00/0xe4e6e89fb01db718 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db711 expref: 18 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872949.059161:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327858304 00000100:00100000:3.0:1788872949.059164:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327858304 00010000:00010000:3.0:1788872949.059174:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db749 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db742 expref: 19 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872949.059192:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:3.0:1788872949.059198:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:3645:x1875765327858432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872949.059248:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872949.059252:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9fa899c00/0xe4e6e89fb01db718 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db711 expref: 19 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.059260:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9fa899c00/0xe4e6e89fb01db718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db711 expref: 19 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.059269:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa899c00/0xe4e6e89fb01db718 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db711 expref: 19 pid: 94376 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.059278:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872949.059305:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:3645:x1875765327858432:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872949.059347:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:1.0:1788872949.059370:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1788872949.059378:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:3645:x1875765327858304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872949.059385:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872949.059390:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db749 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db742 expref: 17 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.059399:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db742 expref: 17 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.059409:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa898000/0xe4e6e89fb01db749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db742 expref: 17 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.059418:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872949.059438:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:3645:x1875765327858304:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872949.059458:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00010000:00010000:1.0:1788872949.059478:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872949.059484:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872949.059530:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327858048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872949.059539:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327858176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872949.059845:0:95294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327857664:192.168.204.39@tcp:104: 00000100:00100000:1.0:1788872949.059854:0:95294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95294:1875765327857792:192.168.204.39@tcp:104: 00010000:00010000:1.0:1788872949.059889:0:95294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872949.060036:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00010000:00010000:3.0:1788872949.060156:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872949.060175:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327858304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872949.060184:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327858432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872949.061521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872949.061797:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311234944 00000100:00100000:3.0:1788872949.061808:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311234944 00010000:00010000:3.0:1788872949.061844:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c4f9da00/0xe4e6e89fb01db607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1d6 expref: 10 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872949.061964:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2602 00000100:00100000:3.0:1788872949.061974:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311234944:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788872949.061988:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872949.061993:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c4f9da00/0xe4e6e89fb01db607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1d6 expref: 10 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.062006:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c4f9da00/0xe4e6e89fb01db607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1d6 expref: 10 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.062023:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9da00/0xe4e6e89fb01db607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1d6 expref: 10 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.062038:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872949.063271:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67645b7-2296-4087-92b1-886500c47477+9:2404:x1875765311234944:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 1291us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872949.063282:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2602 00000100:00100000:0.0:1788872949.069116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872949.069418:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311235072 00000100:00100000:1.0:1788872949.069438:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311235072 00010000:00010000:1.0:1788872949.069485:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01db615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1e4 expref: 9 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872949.069534:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2603 00000100:00100000:1.0:1788872949.069544:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c67645b7-2296-4087-92b1-886500c47477+9:2404:x1875765311235072:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788872949.069595:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872949.069602:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01db615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1e4 expref: 9 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.069615:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01db615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1e4 expref: 9 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.069635:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c4f9dc00/0xe4e6e89fb01db615 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1e4 expref: 9 pid: 94377 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.069671:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.069680:0:19657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.069696:0:19657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.069703:0:19657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.069710:0:19657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.069718:0:19657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.069725:0:19657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1ac00 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:1.0:1788872949.069729:0:19657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.069737:0:19657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.069751:0:19657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872949.069762:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872949.069826:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c67645b7-2296-4087-92b1-886500c47477+8:2404:x1875765311235072:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 282us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872949.069840:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2603 00010000:00010000:3.0:1788872949.070347:0:95294:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.070368:0:95294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872949.070376:0:95294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9caa1ac00/0xe4e6e89fb01dbad7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.073435:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788872950.584694:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788872950.584704:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9fa734000 from 58 10000000:01000000:1.0:1788872950.584710:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788872950.584772:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.584784:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.584797:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872950.584825:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327858560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.584916:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872950.584964:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788872950.585576:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327858560 00000100:00100000:2.0:1788872950.585585:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327858560 00000100:00100000:2.0:1788872950.585691:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788872950.585701:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327858560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872950.585714:0:94376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872950.585730:0:94376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9caa1be00/0xe4e6e89fb01dbae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbade expref: -99 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.585768:0:94376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9caa1be00/0xe4e6e89fb01dbae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbade expref: 16 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.585780:0:94376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9caa1be00/0xe4e6e89fb01dbae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbade expref: 16 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.585789:0:94376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9caa1be00, rc 0) 00000100:00100000:2.0:1788872950.585849:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327858560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872950.585856:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788872950.586084:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327858560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872950.586102:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.586112:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872950.586188:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327858688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.586217:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.586250:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872950.586313:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327858688 00000100:00100000:0.0:1788872950.586329:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327858688 00000100:00100000:0.0:1788872950.586364:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788872950.586372:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327858688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872950.586529:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327858688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872950.586537:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788872950.586642:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327858688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.586670:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327858816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.586728:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.586752:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872950.587259:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327858816 00000100:00100000:0.0:1788872950.587264:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327858816 00000100:00100000:0.0:1788872950.587301:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788872950.587308:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327858816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872950.587403:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327858816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872950.587415:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788872950.588162:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327858816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.590409:0:95298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95298:1875765327858944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872950.590493:0:95298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872950.590540:0:95298:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788872950.591060:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327858944 00000100:00100000:2.0:1788872950.591068:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327858944 00000100:00100000:2.0:1788872950.591119:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788872950.591135:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:95298:x1875765327858944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872950.591263:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:95298:x1875765327858944:12345-0@lo:502:llog_process_th.0 Request processed in 128us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872950.591271:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788872950.591658:0:95298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95298:1875765327858944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872950.591713:0:95298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95298:1875765327859072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872950.591753:0:95298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872950.591786:0:95298:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872950.592059:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327859072 00000100:00100000:0.0:1788872950.592064:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327859072 00000100:00100000:0.0:1788872950.592103:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788872950.592111:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:95298:x1875765327859072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872950.592208:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:95298:x1875765327859072:12345-0@lo:502:llog_process_th.0 Request processed in 97us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872950.592215:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788872950.592665:0:95298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95298:1875765327859072:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788872950.592691:0:95298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1788872950.593097:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1788872950.593121:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788872950.593131:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.593143:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872950.593153:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788872950.593156:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:3.0:1788872950.593166:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788872950.593197:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.593206:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.593215:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872950.593234:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327859200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.593329:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.593368:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872950.593578:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327859200 00000100:00100000:2.0:1788872950.593592:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327859200 00000100:00100000:2.0:1788872950.593633:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788872950.593641:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327859200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872950.593652:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872950.593665:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9caa1a000/0xe4e6e89fb01dbaf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbaec expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.593689:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9caa1a000/0xe4e6e89fb01dbaf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbaec expref: 17 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.593700:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9caa1a000/0xe4e6e89fb01dbaf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbaec expref: 17 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.593709:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9caa1a000, rc 0) 00000100:00100000:2.0:1788872950.593748:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327859200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872950.593755:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788872950.594334:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327859200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872950.594352:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbaf3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.594362:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbaf3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872950.594421:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327859328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.594454:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.594488:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872950.595204:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327859328 00000100:00100000:0.0:1788872950.595211:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327859328 00000100:00100000:0.0:1788872950.595251:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788872950.595258:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327859328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872950.595388:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327859328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872950.595396:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788872950.595789:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327859328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.596070:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327859456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.596121:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.596155:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872950.597189:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327859456 00000100:00100000:2.0:1788872950.597198:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327859456 00000100:00100000:2.0:1788872950.597248:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788872950.597257:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327859456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.597378:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327859456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872950.597391:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788872950.597817:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327859456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.598339:0:95299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95299:1875765327859584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872950.598403:0:95299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872950.598438:0:95299:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872950.598484:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327859584 00000100:00100000:3.0:1788872950.598489:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327859584 00000100:00100000:3.0:1788872950.599396:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788872950.599408:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:95299:x1875765327859584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872950.599590:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:95299:x1875765327859584:12345-0@lo:502:llog_process_th.0 Request processed in 185us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872950.599598:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788872950.599700:0:95299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95299:1875765327859584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872950.599733:0:95299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788872950.599744:0:95299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872950.599746:0:95299:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1788872950.599752:0:95299:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1788872950.599769:0:95299:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:1.0:1788872950.604309:0:95299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95299:1875765327859712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872950.604412:0:95299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788872950.604522:0:95300:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9fa734000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788872950.604528:0:95300:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9fa734000 4 00000100:00100000:1.0:1788872950.608036:0:95299:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872950.611779:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327859712 00000100:00100000:0.0:1788872950.611795:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327859712 00000100:00100000:0.0:1788872950.614122:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788872950.614141:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:95299:x1875765327859712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872950.614364:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:95299:x1875765327859712:12345-0@lo:502:llog_process_th.0 Request processed in 225us (9949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872950.615667:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788872950.616420:0:95299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95299:1875765327859712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872950.616469:0:95299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872950.616479:0:95299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872950.616481:0:95299:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1788872950.616488:0:95299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:3.0:1788872950.617278:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:3.0:1788872950.617301:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788872950.617312:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbaf3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.617323:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbaf3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872950.617333:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788872950.617335:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9d0cfb000 from 58 10000000:01000000:3.0:1788872950.617338:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788872950.617372:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.617380:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.617395:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872950.617418:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327859840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.617487:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.617530:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872950.617714:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327859840 00000100:00100000:0.0:1788872950.617721:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327859840 00000100:00100000:0.0:1788872950.617756:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788872950.617763:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327859840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872950.617782:0:94382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872950.617796:0:94382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbb01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbafa expref: -99 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872950.617832:0:94382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbafa expref: 18 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872950.617843:0:94382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbafa expref: 18 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872950.617852:0:94382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52afe00, rc 0) 00000100:00100000:0.0:1788872950.617913:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327859840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872950.617920:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788872950.618367:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327859840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872950.618381:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb01 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.618392:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb01 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872950.618452:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327859968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.618479:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.618511:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872950.618819:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327859968 00000100:00100000:1.0:1788872950.618823:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327859968 00000100:00100000:1.0:1788872950.618861:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788872950.618869:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327859968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.619272:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327859968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.619281:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788872950.619361:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327859968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.619394:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327860096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.619437:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.619469:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872950.619538:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327860096 00000100:00100000:0.0:1788872950.619543:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327860096 00000100:00100000:0.0:1788872950.619606:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788872950.619614:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327860096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872950.619700:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327860096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872950.619707:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788872950.620139:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327860096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.620546:0:95301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95301:1875765327860224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872950.620620:0:95301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872950.620645:0:95301:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872950.620753:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327860224 00000100:00100000:1.0:1788872950.620758:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327860224 00000100:00100000:1.0:1788872950.620794:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788872950.620819:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:95301:x1875765327860224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872950.620946:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:95301:x1875765327860224:12345-0@lo:502:llog_process_th.0 Request processed in 130us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.620954:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788872950.621155:0:95301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95301:1875765327860224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872950.621195:0:95301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95301:1875765327860352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872950.621228:0:95301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.621246:0:95301:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788872950.621427:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327860352 00000100:00100000:0.0:1788872950.621432:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327860352 00000100:00100000:0.0:1788872950.621463:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788872950.621470:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:95301:x1875765327860352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872950.621576:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:95301:x1875765327860352:12345-0@lo:502:llog_process_th.0 Request processed in 106us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872950.621592:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788872950.622337:0:95301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95301:1875765327860352:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788872950.622370:0:95301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1788872950.622530:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1788872950.622583:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788872950.622594:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb01 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.622619:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb01 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872950.622629:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788872950.622631:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:3.0:1788872950.622634:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788872950.622663:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.622671:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.622680:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872950.622697:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327860480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.622745:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.622775:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788872950.623534:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327860480 00000100:00100000:1.0:1788872950.623544:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327860480 00000100:00100000:1.0:1788872950.623621:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788872950.623629:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327860480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872950.623642:0:94382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872950.623659:0:94382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa002a4400/0xe4e6e89fb01dbb0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbb08 expref: -99 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.623684:0:94382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa002a4400/0xe4e6e89fb01dbb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb08 expref: 19 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.623694:0:94382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa002a4400/0xe4e6e89fb01dbb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb08 expref: 19 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.623701:0:94382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa002a4400, rc 0) 00000100:00100000:1.0:1788872950.623747:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327860480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.623753:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788872950.624405:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327860480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872950.624424:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.624434:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872950.624515:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327860608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.624585:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.624634:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788872950.624779:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327860608 00000100:00100000:0.0:1788872950.624784:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327860608 00000100:00100000:0.0:1788872950.624832:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788872950.624841:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327860608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.625148:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327860608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.625180:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327860736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872950.625231:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327860608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 391us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872950.625239:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788872950.628345:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872950.628449:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872950.628493:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327860736 00000100:00100000:1.0:1788872950.628502:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327860736 00000100:00100000:0.0:1788872950.628794:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788872950.628809:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327860736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872950.633202:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327860736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4387us (4855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872950.633228:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788872950.633398:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327860736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872950.637296:0:95302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95302:1875765327860864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872950.637395:0:95302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872950.637441:0:95302:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788872950.637462:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327860864 00000100:00100000:2.0:1788872950.637471:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327860864 00000100:00100000:2.0:1788872950.637518:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788872950.637527:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:95302:x1875765327860864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872950.639847:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:95302:x1875765327860864:12345-0@lo:502:llog_process_th.0 Request processed in 2311us (2442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872950.639862:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788872950.645472:0:95302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95302:1875765327860864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788872950.648251:0:95302:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872950.648273:0:95302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872950.648276:0:95302:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1788872950.648287:0:95302:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1788872950.648354:0:95302:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:3.0:1788872950.648409:0:95302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95302:1875765327860992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872950.648520:0:95302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.648608:0:95302:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788872950.649698:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327860992 00000100:00100000:1.0:1788872950.649710:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327860992 00000100:00100000:1.0:1788872950.649792:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788872950.649802:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:95302:x1875765327860992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872950.649974:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:95302:x1875765327860992:12345-0@lo:502:llog_process_th.0 Request processed in 174us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.649983:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788872950.651008:0:95302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95302:1875765327860992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788872950.651048:0:95302:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872950.651057:0:95302:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872950.651059:0:95302:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1788872950.651064:0:95302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:0.0:1788872950.651344:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:0.0:1788872950.651369:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788872950.651380:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872950.651391:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872950.651416:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788872950.651419:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff5b1000 from 58 10000000:01000000:0.0:1788872950.651421:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788872950.651457:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872950.651465:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872950.651474:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872950.651495:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327861120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872950.651544:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872950.651622:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73a1600 going to sleep for 11 seconds 00000100:00100000:1.0:1788872950.652052:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327861120 00000100:00100000:1.0:1788872950.652061:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327861120 00000100:00100000:1.0:1788872950.652106:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788872950.652114:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327861120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872950.652127:0:94382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872950.652140:0:94382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa002a5c00/0xe4e6e89fb01dbb1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbb16 expref: -99 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.652173:0:94382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa002a5c00/0xe4e6e89fb01dbb1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb16 expref: 20 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.652183:0:94382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa002a5c00/0xe4e6e89fb01dbb1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb16 expref: 20 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.652191:0:94382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa002a5c00, rc 0) 00000100:00100000:1.0:1788872950.652232:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327861120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.652241:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788872950.652414:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327861120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872950.652428:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872950.652438:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872950.652497:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327861248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872950.652524:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872950.652583:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73a1600 going to sleep for 11 seconds 00000100:00100000:1.0:1788872950.652730:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327861248 00000100:00100000:1.0:1788872950.652736:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327861248 00000100:00100000:1.0:1788872950.652761:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788872950.652766:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327861248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.652905:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327861248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.652923:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788872950.653107:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327861248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.653137:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327861376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.653189:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.653212:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788872950.653321:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327861376 00000100:00100000:1.0:1788872950.653325:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327861376 00000100:00100000:1.0:1788872950.653357:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788872950.653364:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327861376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.653435:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327861376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.653442:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788872950.653513:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327861376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.657795:0:95303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95303:1875765327861504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872950.660327:0:95303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.660403:0:95303:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872950.660440:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327861504 00000100:00100000:1.0:1788872950.660450:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327861504 00000100:00100000:1.0:1788872950.660536:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788872950.660546:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:95303:x1875765327861504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872950.661195:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:95303:x1875765327861504:12345-0@lo:502:llog_process_th.0 Request processed in 650us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.661203:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788872950.661285:0:95303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95303:1875765327861504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872950.661348:0:95303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95303:1875765327861632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872950.661383:0:95303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.661486:0:95303:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788872950.661575:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327861632 00000100:00100000:2.0:1788872950.661581:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327861632 00000100:00100000:2.0:1788872950.661627:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788872950.661635:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:95303:x1875765327861632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872950.661706:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:95303:x1875765327861632:12345-0@lo:502:llog_process_th.0 Request processed in 72us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872950.661722:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788872950.661992:0:95303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95303:1875765327861632:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788872950.662016:0:95303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1788872950.662316:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1788872950.662342:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788872950.662351:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.662362:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872950.662371:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788872950.662374:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788872950.662377:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788872950.662406:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.662414:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.662422:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872950.662438:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327861760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.662473:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872950.662506:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788872950.662591:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327861760 00000100:00100000:3.0:1788872950.662596:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327861760 00000100:00100000:3.0:1788872950.662622:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788872950.662627:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327861760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872950.662638:0:94376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872950.662652:0:94376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c449bc00/0xe4e6e89fb01dbb2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbb24 expref: -99 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.662677:0:94376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c449bc00/0xe4e6e89fb01dbb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb24 expref: 21 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.662689:0:94376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c449bc00/0xe4e6e89fb01dbb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb24 expref: 21 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.662697:0:94376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449bc00, rc 0) 00000100:00100000:3.0:1788872950.662727:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327861760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872950.662733:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788872950.663316:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327861760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872950.663335:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.663361:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872950.663425:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327861888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.663458:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872950.663489:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788872950.663541:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327861888 00000100:00100000:3.0:1788872950.663546:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327861888 00000100:00100000:3.0:1788872950.663742:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788872950.663750:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327861888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.664104:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327861888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 354us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872950.664112:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788872950.664266:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327861888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.664297:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327862016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.664335:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872950.664363:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788872950.664412:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327862016 00000100:00100000:1.0:1788872950.664417:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327862016 00000100:00100000:1.0:1788872950.664450:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788872950.664457:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327862016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.664773:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327862016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 316us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.664780:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788872950.665103:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327862016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872950.666486:0:95304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788872950.667045:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788872950.667071:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788872950.667083:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.667095:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872950.667106:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788872950.667109:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ef97c000 from 58 10000000:01000000:2.0:1788872950.667112:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788872950.667149:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.667158:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.667187:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872950.667212:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327862144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.667271:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872950.667350:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872950.667397:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327862144 00000100:00100000:3.0:1788872950.667404:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327862144 00000100:00100000:3.0:1788872950.667496:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788872950.667505:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327862144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872950.667518:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872950.667530:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c449a600/0xe4e6e89fb01dbb39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbb32 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.667745:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c449a600/0xe4e6e89fb01dbb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb32 expref: 22 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.667758:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c449a600/0xe4e6e89fb01dbb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb32 expref: 22 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.667767:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449a600, rc 0) 00000100:00100000:3.0:1788872950.667866:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327862144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 362us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872950.667872:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788872950.668189:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327862144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872950.668205:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.668215:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872950.668271:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327862272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.668298:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872950.668357:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c304ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872950.668395:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327862272 00000100:00100000:1.0:1788872950.668400:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327862272 00000100:00100000:1.0:1788872950.668475:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788872950.668483:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327862272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.668643:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327862272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.668650:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788872950.668722:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327862272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.668754:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327862400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.668795:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.669268:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788872950.669347:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327862400 00000100:00100000:2.0:1788872950.669352:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327862400 00000100:00100000:2.0:1788872950.669388:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788872950.669395:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327862400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.669481:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327862400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872950.669488:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788872950.669612:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327862400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.670210:0:95305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95305:1875765327862528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872950.670255:0:95305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.670287:0:95305:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7436d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788872950.670333:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327862528 00000100:00100000:2.0:1788872950.670338:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327862528 00000100:00100000:2.0:1788872950.670370:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788872950.670382:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:95305:x1875765327862528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872950.670461:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:95305:x1875765327862528:12345-0@lo:502:llog_process_th.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872950.670468:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788872950.670542:0:95305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95305:1875765327862528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872950.670623:0:95305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95305:1875765327862656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872950.670660:0:95305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872950.670676:0:95305:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c492d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788872950.670803:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327862656 00000100:00100000:2.0:1788872950.671005:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327862656 00000100:00100000:2.0:1788872950.671040:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788872950.671047:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:95305:x1875765327862656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872950.671116:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:95305:x1875765327862656:12345-0@lo:502:llog_process_th.0 Request processed in 68us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872950.671123:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788872950.671311:0:95305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95305:1875765327862656:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788872950.671334:0:95305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1788872950.671494:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1788872950.671517:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788872950.671527:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.671539:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872950.671688:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788872950.671692:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788872950.671696:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788872950.671723:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.671733:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872950.671742:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872950.671767:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327862784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.671800:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872950.672042:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9fa5acf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788872950.672148:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327862784 00000100:00100000:3.0:1788872950.672155:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327862784 00000100:00100000:3.0:1788872950.672194:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788872950.672202:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327862784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872950.672214:0:94376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872950.672228:0:94376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c449b000/0xe4e6e89fb01dbb47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbb40 expref: -99 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.672250:0:94376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c449b000/0xe4e6e89fb01dbb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb40 expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.672261:0:94376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c449b000/0xe4e6e89fb01dbb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb40 expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.672270:0:94376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449b000, rc 0) 00000100:00100000:3.0:1788872950.672305:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327862784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872950.672311:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788872950.672412:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327862784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872950.672425:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.672434:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872950.672489:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327862912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.672517:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872950.672545:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788872950.672724:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327862912 00000100:00100000:2.0:1788872950.672728:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327862912 00000100:00100000:2.0:1788872950.672762:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788872950.672769:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327862912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.673096:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327862912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872950.673104:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788872950.673184:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327862912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.673213:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327863040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.673251:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872950.673280:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788872950.673329:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327863040 00000100:00100000:2.0:1788872950.673333:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327863040 00000100:00100000:2.0:1788872950.673363:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788872950.673370:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327863040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872950.673441:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327863040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872950.673448:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788872950.673765:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327863040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788872950.675405:0:95306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788872950.676035:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788872950.676062:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788872950.676073:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.676086:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872950.676111:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788872950.676113:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98a9e9b999c0 from 1 10000000:01000000:1.0:1788872950.676116:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788872950.676153:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.676162:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.676172:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872950.676198:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327863168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.676259:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872950.676298:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788872950.676368:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327863168 00000100:00100000:3.0:1788872950.676376:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327863168 00000100:00100000:3.0:1788872950.676428:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788872950.676438:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327863168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872950.676450:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872950.676463:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c449a400/0xe4e6e89fb01dbb55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbb4e expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.676488:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c449a400/0xe4e6e89fb01dbb55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb4e expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.676498:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c449a400/0xe4e6e89fb01dbb55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb4e expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.676507:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449a400, rc 0) 00000100:00100000:3.0:1788872950.676577:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327863168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872950.676643:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788872950.676782:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327863168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872950.676798:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.676818:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872950.677087:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327863296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.677115:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872950.677146:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788872950.677197:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327863296 00000100:00100000:3.0:1788872950.677202:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327863296 00000100:00100000:3.0:1788872950.677234:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788872950.677241:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327863296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.677315:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327863296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (198us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788872950.677321:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788872950.677438:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6527100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327863296:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788872950.677468:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788872950.677485:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.677494:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872950.922225:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872950.922361:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311235200 00000100:00100000:3.0:1788872950.922372:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311235200 00000100:00100000:3.0:1788872950.922432:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 126 00000100:00100000:3.0:1788872950.922442:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+8:71021:x1875765311235200:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872950.922465:0:94381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872950.922486:0:94381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c449b200/0xe4e6e89fb01dbb5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb238 expref: -99 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.922523:0:94381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c449b200/0xe4e6e89fb01dbb5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb238 expref: 9 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.922536:0:94381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c449b200/0xe4e6e89fb01dbb5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb238 expref: 9 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872950.922545:0:94381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449b200, rc 0) 00000100:00100000:3.0:1788872950.922643:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311235200:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 202us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872950.922649:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 126 00000100:00100000:0.0:1788872950.927718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872950.927931:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311235328 00000100:00100000:3.0:1788872950.927941:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311235328 00000100:00100000:3.0:1788872950.928002:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 127 00000100:00100000:3.0:1788872950.928011:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311235328:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872950.928194:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311235328:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 183us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872950.928400:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 127 00000100:00100000:2.0:1788872950.932783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872950.937899:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311235456 00000100:00100000:1.0:1788872950.937914:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311235456 00000100:00100000:1.0:1788872950.938134:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 128 00000100:00100000:1.0:1788872950.938145:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311235456:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872950.940042:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311235456:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 1888us (7260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.940055:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 128 00000100:00100000:0.0:1788872950.962915:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872950.963170:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311235584 00000100:00100000:3.0:1788872950.963181:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311235584 00000100:00100000:3.0:1788872950.963249:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 129 00000100:00100000:3.0:1788872950.963259:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:73401:x1875765311235584:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788872950.963428:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:73401:x1875765311235584:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 169us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872950.963441:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 129 00000100:00100000:0.0:1788872950.971897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872950.972003:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311235712 00000100:00100000:1.0:1788872950.972014:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311235712 00000100:00100000:1.0:1788872950.972070:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 130 00000100:00100000:1.0:1788872950.972080:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+9:73401:x1875765311235712:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788872950.972240:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+9:73401:x1875765311235712:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 161us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.972247:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 130 00000100:00100000:2.0:1788872950.975321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872950.975694:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311235840 00000100:00100000:1.0:1788872950.975704:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311235840 00000100:00100000:1.0:1788872950.975753:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 131 00000100:00100000:1.0:1788872950.975763:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311235840:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872950.975779:0:94377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872950.975796:0:94377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa002a4200/0xe4e6e89fb01dbb63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb23f expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.975839:0:94377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa002a4200/0xe4e6e89fb01dbb63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb23f expref: 10 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.975850:0:94377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa002a4200/0xe4e6e89fb01dbb63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb23f expref: 10 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872950.975859:0:94377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa002a4200, rc 0) 00000100:00100000:1.0:1788872950.975924:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311235840:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 162us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872950.975931:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 131 00000100:00100000:2.0:1788872950.980141:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872950.980341:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311235968 00000100:00100000:0.0:1788872950.980353:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311235968 00000100:00100000:0.0:1788872950.980413:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 132 00000100:00100000:0.0:1788872950.980424:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311235968:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872950.980545:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311235968:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 123us (414us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788872950.980581:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 132 00010000:00010000:3.0:1788872951.100295:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872951.481677:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327863424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872951.481773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872951.481895:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327863424 00000100:00100000:3.0:1788872951.481905:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327863424 00000100:00100000:3.0:1788872951.481973:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223 00000100:00100000:3.0:1788872951.481982:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327863424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872951.482027:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788872951.482080:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327863424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872951.482087:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223 00000100:00100000:3.0:1788872951.482134:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327863424:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788872951.482362:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872951.483958:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788872951.483978:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327863552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872951.484050:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872951.484269:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327863552 00000100:00100000:1.0:1788872951.484277:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327863552 00000100:00100000:1.0:1788872951.484331:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224 00000100:00100000:1.0:1788872951.484341:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327863552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788872951.484368:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872951.484413:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327863552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872951.484419:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224 00000100:00080000:0.0:1788872951.485311:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788872951.485362:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327863552:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788872952.120787:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872953.017530:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788872953.022887:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327863680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872953.023017:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.026910:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327863680 00000100:00100000:2.0:1788872953.026924:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327863680 00000100:00100000:2.0:1788872953.027020:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4054 00000100:00100000:2.0:1788872953.027030:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327863680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872953.027064:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1788872953.027162:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327863680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (4144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.027170:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4054 00000100:00100000:2.0:1788872953.027295:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327863680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872953.029193:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327863936:0@lo:400:kworker.0 00000100:00100000:1.0:1788872953.029252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872953.029280:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327864448:0@lo:400:kworker.0 00000100:00100000:1.0:1788872953.029318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872953.029351:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327864960:0@lo:400:kworker.0 00000100:00100000:1.0:1788872953.029404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872953.029430:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788872953.029435:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327864064:0@lo:400:kworker.0 00000100:00100000:1.0:1788872953.029587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872953.029607:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327864576:0@lo:400:kworker.0 00000100:00100000:1.0:1788872953.029698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872953.029735:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327865088:0@lo:400:kworker.0 00000100:00100000:1.0:1788872953.029758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872953.029805:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327863936 00000100:00100000:1.0:1788872953.029811:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327863936 00000100:00100000:1.0:1788872953.029876:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327864064 00000100:00100000:1.0:1788872953.029880:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327864064 00000100:00100000:1.0:1788872953.029902:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:1.0:1788872953.029911:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327863936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872953.029955:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327863936:12345-0@lo:400:kworker.0 Request processed in 46us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872953.029961:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:1.0:1788872953.029976:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:1.0:1788872953.029983:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327864064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872953.030006:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875765327864064:12345-0@lo:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872953.030011:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:1.0:1788872953.030027:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327864448 00000100:00100000:1.0:1788872953.030031:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327864448 00000100:00100000:1.0:1788872953.030063:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4055 00000100:00100000:1.0:1788872953.030068:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327864448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872953.030097:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327864448:12345-0@lo:400:kworker.0 Request processed in 29us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872953.030102:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4055 00000100:00100000:1.0:1788872953.030120:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327864960 00000100:00100000:1.0:1788872953.030123:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327864960 00000100:00100000:1.0:1788872953.030145:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327864576 00000100:00100000:1.0:1788872953.030148:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327864576 00000100:00100000:1.0:1788872953.030160:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327865088 00000100:00100000:1.0:1788872953.030162:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327865088 00000100:00100000:1.0:1788872953.030178:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753 00000100:00100000:1.0:1788872953.030183:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327864960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872953.030209:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327864960:12345-0@lo:400:kworker.0 Request processed in 26us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872953.030214:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753 00000100:00100000:1.0:1788872953.030223:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754 00000100:00100000:1.0:1788872953.030228:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327864576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872953.030247:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327864576:12345-0@lo:400:kworker.0 Request processed in 20us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872953.030252:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754 00000100:00100000:1.0:1788872953.030260:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755 00000100:00100000:1.0:1788872953.030265:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327865088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872953.030284:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327865088:12345-0@lo:400:kworker.0 Request processed in 19us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872953.030289:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755 00000100:00080000:1.0:1788872953.030313:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872953.030323:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788872953.031600:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327863808:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.031669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.031707:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327864320:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.031732:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.031749:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327864832:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.031771:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.031793:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788872953.031800:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327864192:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.031821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.031852:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327864704:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.031876:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.031894:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327865216:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.031914:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.031941:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327863808 00000100:00100000:2.0:1788872953.031947:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327863808 00000100:00100000:2.0:1788872953.031987:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788872953.031995:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327863808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.032039:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327863808:12345-0@lo:400:kworker.0 Request processed in 45us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.032046:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788872953.032075:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327864320 00000100:00100000:2.0:1788872953.032085:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327864320 00000100:00100000:2.0:1788872953.032108:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327864832 00000100:00100000:2.0:1788872953.032111:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327864832 00000100:00100000:2.0:1788872953.032122:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327864192 00000100:00100000:2.0:1788872953.032124:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327864192 00000100:00100000:2.0:1788872953.032136:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:2.0:1788872953.032142:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327864320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.032171:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327864320:12345-0@lo:400:kworker.0 Request processed in 29us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.032177:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00100000:2.0:1788872953.032187:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327865216 00000100:00100000:2.0:1788872953.032190:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327865216 00000100:00100000:2.0:1788872953.032204:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1788872953.032209:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327864832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.032234:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327864832:12345-0@lo:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.032240:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1788872953.032251:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1788872953.032257:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327864192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.032281:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327864192:12345-0@lo:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.032287:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1788872953.032297:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1788872953.032303:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327865216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.032338:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327865216:12345-0@lo:400:kworker.0 Request processed in 22us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.032346:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1788872953.032375:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327864704 00000100:00100000:2.0:1788872953.032379:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327864704 00000100:00100000:2.0:1788872953.032404:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756 00000100:00100000:2.0:1788872953.032409:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327864704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.032440:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327864704:12345-0@lo:400:kworker.0 Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.032447:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756 00000100:00100000:2.0:1788872953.032507:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327864192:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.032517:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327864704:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.032526:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327865216:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.032533:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c6524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327863808:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.032542:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327864320:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.032571:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327864832:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.033381:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1875765327864064:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.033394:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327864576:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.033407:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327865088:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.033419:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327863936:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.033430:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327864448:0@lo:400:kworker.0 00000100:00100000:2.0:1788872953.033441:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327864960:0@lo:400:kworker.0 00000100:00080000:1.0:1788872953.033789:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788872953.033793:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872953.033796:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788872953.146274:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788872953.325483:0:95405:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd6a120aa0 20000000:00000080:1.0:1788872953.325500:0:95405:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff98a8c3a35000 uarg=0000000000000000 00000040:00100000:1.0:1788872953.330815:0:95405:0:(llog.c:1072:llog_reverse_process()) index 60 : idx 49 20000000:01000000:1.0:1788872953.330827:0:95405:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:1.0:1788872953.330863:0:95405:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:1.0:1788872953.333026:0:95406:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 41 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:1.0:1788872953.333079:0:95406:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 54 marker 41 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:1.0:1788872953.333095:0:95406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:3.0:1788872953.333320:0:95405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:3.0:1788872953.333335:0:95405:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1788872953.333348:0:95405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:3.0:1788872953.333365:0:95405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:3.0:1788872953.333381:0:95405:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:1.0:1788872953.333979:0:95407:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 42 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:1.0:1788872953.334015:0:95407:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 42 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:1.0:1788872953.334032:0:95407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:3.0:1788872953.334256:0:95405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:3.0:1788872953.334266:0:95405:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1788872953.334280:0:95405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:3.0:1788872953.334294:0:95405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:3.0:1788872953.334306:0:95405:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:1.0:1788872953.335419:0:95408:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 43 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:1.0:1788872953.335465:0:95408:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 43 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:1.0:1788872953.335482:0:95408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:3.0:1788872953.356825:0:95405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:3.0:1788872953.356864:0:95405:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1788872953.356882:0:95405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:3.0:1788872953.356900:0:95405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:3.0:1788872953.356912:0:95405:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788872953.356932:0:95405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.356963:0:95405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9caa1be00/0xe4e6e89fb01dbae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbade expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.356970:0:95405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9caa1a000/0xe4e6e89fb01dbaf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbaec expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.356977:0:95405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbb01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbafa expref: 23 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.356983:0:95405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa002a4400/0xe4e6e89fb01dbb0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb08 expref: 23 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.356989:0:95405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa002a5c00/0xe4e6e89fb01dbb1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb16 expref: 23 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.356995:0:95405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c449bc00/0xe4e6e89fb01dbb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb24 expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.357001:0:95405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c449a600/0xe4e6e89fb01dbb39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb32 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.357007:0:95405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c449b000/0xe4e6e89fb01dbb47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb40 expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.357014:0:95405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c449a400/0xe4e6e89fb01dbb55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb4e expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.357024:0:95405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a8c449b200/0xe4e6e89fb01dbb5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb238 expref: 9 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.357043:0:95405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98aa002a4200/0xe4e6e89fb01dbb63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb23f expref: 9 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.357050:0:95405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.357093:0:95405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa002a4200/0xe4e6e89fb01dbb63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb23f expref: 9 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.357109:0:95405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa002a4200/0xe4e6e89fb01dbb63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb23f expref: 9 pid: 94377 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872953.357124:0:95405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327865344:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788872953.357229:0:95405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c449b200/0xe4e6e89fb01dbb5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb238 expref: 9 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.357237:0:95405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c449b200/0xe4e6e89fb01dbb5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb238 expref: 9 pid: 94381 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872953.357246:0:95405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327865472:192.168.204.39@tcp:104: 00010000:00010000:3.0:1788872953.357276:0:95405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c449a400/0xe4e6e89fb01dbb55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dbb4e expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.357285:0:95405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c449a400/0xe4e6e89fb01dbb55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb4e expref: 23 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872953.357294:0:95405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327865600:0@lo:104: 00000100:00100000:3.0:1788872953.357337:0:95405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788872953.357393:0:95405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c449b000/0xe4e6e89fb01dbb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dbb40 expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.357971:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327865600 00000100:00100000:2.0:1788872953.357979:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327865600 00000100:00100000:2.0:1788872953.358053:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788872953.358062:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:95405:x1875765327865600:12345-0@lo:104: 00010000:00010000:2.0:1788872953.358076:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.358131:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788872953.358137:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:95405:x1875765327865600:12345-0@lo:104: Request processed in 77us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.358143:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00010000:2.0:1788872953.358165:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872953.358170:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.358177:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5a00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872953.358181:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dbb55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.358189:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dbb55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872953.358195:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dbb55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872953.358201:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872953.358235:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.358241:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872953.358261:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.358278:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98aa002a5a00/0xe4e6e89fb01dbb4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.358292:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872953.358294:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872953.358296:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872953.358360:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327865856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872953.358390:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.358445:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327865856 00000100:00100000:2.0:1788872953.358449:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327865856 00010000:00010000:2.0:1788872953.358466:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c449a400/0xe4e6e89fb01dbb55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb4e expref: 24 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.358484:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1788872953.358490:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3645:x1875765327865856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872953.358501:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872953.358505:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c449a400/0xe4e6e89fb01dbb55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb4e expref: 24 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.358789:0:95405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c449b000/0xe4e6e89fb01dbb47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb40 expref: 23 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872953.358804:0:95405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327865728:0@lo:104: 00000100:00100000:3.0:1788872953.358858:0:95405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872953.358934:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327865728 00000100:00100000:0.0:1788872953.358938:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327865728 00000100:00100000:0.0:1788872953.358966:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788872953.358973:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:95405:x1875765327865728:12345-0@lo:104: 00010000:00010000:0.0:1788872953.358983:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.359033:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788872953.359045:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:95405:x1875765327865728:12345-0@lo:104: Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872953.359051:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00010000:00010000:0.0:1788872953.359069:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788872953.359074:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.359081:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1ba00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1788872953.359084:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dbb47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.359091:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dbb47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788872953.359098:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dbb47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872953.359104:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788872953.359126:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.359133:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788872953.359149:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.359156:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ba00/0xe4e6e89fb01dbb40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.359165:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872953.359167:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872953.359169:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872953.359191:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327865984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872953.359219:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872953.359257:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327865984 00000100:00100000:0.0:1788872953.359261:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327865984 00010000:00010000:0.0:1788872953.359275:0:26197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c449b000/0xe4e6e89fb01dbb47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb40 expref: 25 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872953.359296:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:0.0:1788872953.359302:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3646:x1875765327865984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872953.359309:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872953.359314:0:26197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c449b000/0xe4e6e89fb01dbb47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb40 expref: 25 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.369112:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c449a400/0xe4e6e89fb01dbb55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb4e expref: 25 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.369148:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788872953.369362:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3645:x1875765327865856:12345-0@lo:103:ldlm_bl.0 Request processed in 10870us (10969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.369373:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:3.0:1788872953.370770:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872953.370865:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872953.370893:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311236096 00000100:00100000:3.0:1788872953.370902:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311236096 00010000:00010000:3.0:1788872953.370935:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa002a4200/0xe4e6e89fb01dbb63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb23f expref: 10 pid: 94377 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872953.370960:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311236224 00000100:00100000:3.0:1788872953.370963:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311236224 00010000:00010000:3.0:1788872953.370973:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c449b200/0xe4e6e89fb01dbb5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb238 expref: 11 pid: 94381 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872953.370992:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2606 00000100:00100000:3.0:1788872953.370999:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67645b7-2296-4087-92b1-886500c47477+11:2404:x1875765311236096:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788872953.371012:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872953.371017:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa002a4200/0xe4e6e89fb01dbb63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb23f expref: 11 pid: 94377 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.371029:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa002a4200/0xe4e6e89fb01dbb63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb23f expref: 11 pid: 94377 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.371045:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872953.371098:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67645b7-2296-4087-92b1-886500c47477+11:2404:x1875765311236096:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 99us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872953.371106:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2606 00000100:00100000:3.0:1788872953.371122:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2607 00000100:00100000:3.0:1788872953.371127:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311236224:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788872953.371135:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872953.371139:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c449b200/0xe4e6e89fb01dbb5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb238 expref: 10 pid: 94381 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.371148:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c449b200/0xe4e6e89fb01dbb5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb238 expref: 10 pid: 94381 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.371158:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872953.371172:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311236224:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 45us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872953.371178:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2607 00010000:00010000:2.0:1788872953.371805:0:95405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c449a600/0xe4e6e89fb01dbb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dbb32 expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.371823:0:95405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c449a600/0xe4e6e89fb01dbb39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb32 expref: 24 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.371850:0:95405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866112:0@lo:104: 00000100:00100000:2.0:1788872953.371902:0:95405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788872953.371953:0:95405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c449bc00/0xe4e6e89fb01dbb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dbb24 expref: 24 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.371962:0:95405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c449bc00/0xe4e6e89fb01dbb2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb24 expref: 24 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.371969:0:95405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866240:0@lo:104: 00000100:00100000:2.0:1788872953.371993:0:95405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788872953.372019:0:95405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa002a5c00/0xe4e6e89fb01dbb1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dbb16 expref: 24 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.372027:0:95405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa002a5c00/0xe4e6e89fb01dbb1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb16 expref: 24 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.372036:0:95405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866368:0@lo:104: 00010000:00010000:2.0:1788872953.372062:0:95405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98aa002a4400/0xe4e6e89fb01dbb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dbb08 expref: 24 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.372069:0:95405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98aa002a4400/0xe4e6e89fb01dbb0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb08 expref: 24 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.372076:0:95405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866496:0@lo:104: 00010000:00010000:2.0:1788872953.372097:0:95405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dbafa expref: 24 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.372113:0:95405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbb01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbafa expref: 24 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.372120:0:95405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866624:0@lo:104: 00010000:00010000:2.0:1788872953.372147:0:95405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9caa1a000/0xe4e6e89fb01dbaf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dbaec expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.372154:0:95405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9caa1a000/0xe4e6e89fb01dbaf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbaec expref: 24 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.372160:0:95405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866752:0@lo:104: 00010000:00010000:2.0:1788872953.372179:0:95405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9caa1be00/0xe4e6e89fb01dbae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01dbade expref: 24 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.372186:0:95405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9caa1be00/0xe4e6e89fb01dbae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbade expref: 24 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.372194:0:95405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866880:0@lo:104: 00000100:00100000:2.0:1788872953.372211:0:95405:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c56e2d80 going to sleep for 11 seconds 00010000:00010000:2.0:1788872953.372236:0:95405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa002a4200/0xe4e6e89fb01dbb63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb23f expref: 9 pid: 94377 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.372252:0:95405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327865344:192.168.204.39@tcp:104: 00010000:00010000:2.0:1788872953.372264:0:95405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c449b200/0xe4e6e89fb01dbb5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb238 expref: 8 pid: 94381 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.372272:0:95405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327865472:192.168.204.39@tcp:104: 00010000:00010000:2.0:1788872953.372291:0:95405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c449a400/0xe4e6e89fb01dbb55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb4e expref: 24 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.372308:0:95405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327865600:0@lo:104: 00000100:00100000:2.0:1788872953.372317:0:95405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327865728:0@lo:104: 00000100:00100000:2.0:1788872953.372380:0:13343:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788872953.372398:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.373111:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.373123:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.373132:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.373141:0:13343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.373149:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327866112 00000100:00100000:2.0:1788872953.373156:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327866112 00000100:00100000:2.0:1788872953.373192:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327866240 00000100:00100000:2.0:1788872953.373194:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327866240 00000100:00100000:2.0:1788872953.373203:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327866368 00000100:00100000:2.0:1788872953.373206:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327866368 00000100:00100000:2.0:1788872953.373214:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327866496 00000100:00100000:2.0:1788872953.373216:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327866496 00000100:00100000:2.0:1788872953.373224:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327866624 00000100:00100000:2.0:1788872953.373226:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327866624 00000100:00100000:2.0:1788872953.373235:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327866752 00000100:00100000:2.0:1788872953.373237:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327866752 00000100:00100000:2.0:1788872953.373244:0:13343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327866880 00000100:00100000:2.0:1788872953.373246:0:13343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327866880 00000100:00100000:2.0:1788872953.373257:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788872953.373265:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:95405:x1875765327866112:12345-0@lo:104: 00010000:00010000:2.0:1788872953.373279:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.373351:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788872953.373368:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+9:95405:x1875765327866112:12345-0@lo:104: Request processed in 103us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.373375:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788872953.373394:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788872953.373399:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a36850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:95405:x1875765327866240:12345-0@lo:104: 00010000:00010000:2.0:1788872953.373478:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.373665:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788872953.373671:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a36850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+8:95405:x1875765327866240:12345-0@lo:104: Request processed in 271us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.373678:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788872953.373714:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788872953.373720:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:95405:x1875765327866368:12345-0@lo:104: 00010000:00010000:2.0:1788872953.373729:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.373763:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788872953.373768:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+7:95405:x1875765327866368:12345-0@lo:104: Request processed in 49us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.373775:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788872953.373786:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788872953.373791:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:95405:x1875765327866496:12345-0@lo:104: 00010000:00010000:2.0:1788872953.373798:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.373826:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788872953.373850:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+6:95405:x1875765327866496:12345-0@lo:104: Request processed in 58us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.373866:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788872953.373879:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788872953.373884:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:95405:x1875765327866624:12345-0@lo:104: 00010000:00010000:2.0:1788872953.373893:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb01 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.373921:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788872953.373926:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+5:95405:x1875765327866624:12345-0@lo:104: Request processed in 42us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.373932:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788872953.373944:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788872953.373949:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:95405:x1875765327866752:12345-0@lo:104: 00010000:00010000:2.0:1788872953.373956:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbaf3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.373981:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788872953.373985:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:95405:x1875765327866752:12345-0@lo:104: Request processed in 37us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.373991:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788872953.374003:0:13343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788872953.374009:0:13343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:95405:x1875765327866880:12345-0@lo:104: 00010000:00010000:2.0:1788872953.374016:0:13343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.374040:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788872953.374050:0:13343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:95405:x1875765327866880:12345-0@lo:104: Request processed in 42us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.374056:0:13343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00010000:00010000:2.0:1788872953.374236:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788872953.374244:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.374252:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1b800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872953.374257:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dbb39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.374267:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dbb39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872953.374276:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dbb39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872953.374283:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872953.374323:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.374330:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872953.374349:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.374357:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9caa1b800/0xe4e6e89fb01dbb32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.374370:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788872953.374374:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.374390:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1aa00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872953.374393:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dbb2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.379123:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dbb2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872953.379151:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dbb2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872953.379158:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872953.379207:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.379215:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872953.379234:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.379241:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9caa1aa00/0xe4e6e89fb01dbb24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.379258:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788872953.379262:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.379268:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872953.379271:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dbb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.379300:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dbb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872953.379306:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dbb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872953.379311:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872953.379325:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872953.382365:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327867136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872953.382458:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872953.382542:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327867136 00000100:00100000:3.0:1788872953.382577:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327867136 00010000:00010000:3.0:1788872953.382625:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c449bc00/0xe4e6e89fb01dbb2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb24 expref: 24 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872953.382659:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:3.0:1788872953.382668:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327867136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872953.382682:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872953.382687:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c449bc00/0xe4e6e89fb01dbb2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb24 expref: 24 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.382714:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c449bc00/0xe4e6e89fb01dbb2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb24 expref: 24 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.382736:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872953.382770:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327867136:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872953.382777:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:3.0:1788872953.382816:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327867136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872953.383242:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872953.383263:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383271:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae600/0xe4e6e89fb01dbb16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383286:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788872953.383291:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383297:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449a000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872953.383300:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dbb0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383307:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dbb0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872953.383313:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dbb0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872953.383328:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872953.383774:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383781:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872953.383789:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383795:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c449a000/0xe4e6e89fb01dbb08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383805:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788872953.383809:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbb01 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383814:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449a200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872953.383817:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dbb01 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383824:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dbb01 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872953.383840:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dbb01 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872953.383846:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872953.383859:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb01 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383864:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872953.383876:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb01 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383881:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c449a200/0xe4e6e89fb01dbafa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbb01 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383890:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788872953.383893:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbaf3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383898:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449a800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872953.383900:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dbaf3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383906:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dbaf3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872953.383912:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dbaf3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872953.383916:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872953.383929:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbaf3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383934:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872953.383939:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbaf3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383946:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c449a800/0xe4e6e89fb01dbaec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbaf3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383954:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872953.383963:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01dbae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383968:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4a00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872953.383971:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01dbae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.383978:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01dbae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872953.383984:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01dbae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872953.383989:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788872953.384002:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.384008:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872953.384013:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.384019:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98aa002a4a00/0xe4e6e89fb01dbade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01dbae5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.384032:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872953.384033:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872953.384035:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872953.384074:0:95405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866112:0@lo:104: 00010000:00010000:2.0:1788872953.384085:0:95405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c449bc00/0xe4e6e89fb01dbb2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb24 expref: 23 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.384105:0:95405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866240:0@lo:104: 00000100:00100000:2.0:1788872953.384117:0:95405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866368:0@lo:104: 00000100:00100000:2.0:1788872953.384125:0:95405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866496:0@lo:104: 00000100:00100000:2.0:1788872953.384132:0:95405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866624:0@lo:104: 00000100:00100000:2.0:1788872953.384139:0:95405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866752:0@lo:104: 00000100:00100000:2.0:1788872953.384150:0:95405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95405:1875765327866880:0@lo:104: 00010000:00010000:2.0:1788872953.384192:0:95405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.384253:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327867392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872953.384350:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327865856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872953.384382:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872953.384696:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327867008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872953.384754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872953.384798:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327867520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872953.384819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872953.384913:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327867008 00000100:00100000:1.0:1788872953.384920:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327867008 00010000:00010000:1.0:1788872953.384945:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c449a600/0xe4e6e89fb01dbb39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb32 expref: 23 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872953.384982:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327867520 00000100:00100000:1.0:1788872953.384985:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327867520 00010000:00010000:1.0:1788872953.384998:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbb01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbafa expref: 24 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872953.385017:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:1.0:1788872953.385025:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327867008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872953.385038:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872953.385043:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c449a600/0xe4e6e89fb01dbb39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb32 expref: 24 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872953.385052:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c449a600/0xe4e6e89fb01dbb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb32 expref: 24 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872953.385066:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c449a600/0xe4e6e89fb01dbb39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb32 expref: 24 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872953.385079:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872953.385110:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3647:x1875765327867008:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872953.385117:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:1.0:1788872953.385131:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:1.0:1788872953.385137:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3647:x1875765327867520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872953.385145:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872953.385148:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbb01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbafa expref: 22 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872953.385156:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbafa expref: 22 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872953.385175:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbb01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dbafa expref: 22 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872953.385184:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872953.385297:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3647:x1875765327867520:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872953.385304:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:1.0:1788872953.385462:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327867008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788872953.385477:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327867520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872953.385591:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327867648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872953.385623:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872953.386035:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327867648 00000100:00100000:1.0:1788872953.386041:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327867648 00010000:00010000:1.0:1788872953.386061:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9caa1a000/0xe4e6e89fb01dbaf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbaec expref: 21 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872953.386083:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:1.0:1788872953.386090:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3644:x1875765327867648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872953.386100:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872953.386104:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9caa1a000/0xe4e6e89fb01dbaf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbaec expref: 21 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872953.386114:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9caa1a000/0xe4e6e89fb01dbaf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbaec expref: 21 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872953.386125:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9caa1a000/0xe4e6e89fb01dbaf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dbaec expref: 21 pid: 94375 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872953.386137:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872953.386178:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3644:x1875765327867648:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872953.386185:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00000100:00100000:3.0:1788872953.387180:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327867648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872953.387300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788872953.387355:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872953.387361:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872953.387371:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c7831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327867264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872953.387397:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.387522:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327867776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872953.387546:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872953.387702:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327867392 00000100:00100000:3.0:1788872953.387709:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327867392 00010000:00010000:3.0:1788872953.387735:0:26198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa002a4400/0xe4e6e89fb01dbb0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb08 expref: 20 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872953.387765:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327867264 00000100:00100000:3.0:1788872953.387769:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327867264 00010000:00010000:3.0:1788872953.387779:0:26198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98aa002a5c00/0xe4e6e89fb01dbb1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb16 expref: 21 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872953.387795:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327867776 00000100:00100000:3.0:1788872953.387799:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327867776 00010000:00010000:3.0:1788872953.387808:0:26198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9caa1be00/0xe4e6e89fb01dbae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbade expref: 22 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872953.387825:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:3.0:1788872953.387843:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3646:x1875765327867392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872953.387866:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872953.387873:0:26198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa002a4400/0xe4e6e89fb01dbb0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb08 expref: 22 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.387882:0:26198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa002a4400/0xe4e6e89fb01dbb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb08 expref: 22 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.387896:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa002a4400/0xe4e6e89fb01dbb0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb08 expref: 22 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.387910:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872953.387946:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3646:x1875765327867392:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872953.387952:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:3.0:1788872953.387965:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:3.0:1788872953.387971:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:3645:x1875765327867264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872953.387978:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872953.387982:0:26198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98aa002a5c00/0xe4e6e89fb01dbb1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb16 expref: 20 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.387990:0:26198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98aa002a5c00/0xe4e6e89fb01dbb1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb16 expref: 20 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.387999:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98aa002a5c00/0xe4e6e89fb01dbb1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb16 expref: 20 pid: 94382 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.388007:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872953.388032:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:3645:x1875765327867264:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872953.388047:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:3.0:1788872953.388061:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:3.0:1788872953.388066:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:3645:x1875765327867776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788872953.388074:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872953.388079:0:26198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9caa1be00/0xe4e6e89fb01dbae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbade expref: 18 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.388087:0:26198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9caa1be00/0xe4e6e89fb01dbae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbade expref: 18 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.388098:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9caa1be00/0xe4e6e89fb01dbae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dbade expref: 18 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872953.388107:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788872953.388129:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:3645:x1875765327867776:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872953.388135:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:3.0:1788872953.388184:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327867392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872953.388209:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c7831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327867264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872953.388217:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3645:1875765327867776:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788872953.388304:0:26197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a8c449b000/0xe4e6e89fb01dbb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb40 expref: 16 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.388318:0:26197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c449b000/0xe4e6e89fb01dbb47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01dbb40 expref: 16 pid: 94376 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.388342:0:26197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.388352:0:26197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.388369:0:26197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.388377:0:26197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.388396:0:26197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.388413:0:26197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.388419:0:26197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449b400 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872953.388424:0:26197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.388431:0:26197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.388443:0:26197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872953.388454:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872953.388496:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:3646:x1875765327865984:12345-0@lo:103:ldlm_bl.0 Request processed in 29194us (29275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872953.388504:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00100000:0.0:1788872953.388543:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327865984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872953.389190:0:95405:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.389200:0:95405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872953.389207:0:95405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c449b400/0xe4e6e89fb01dbb6a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872953.531078:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327868032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872953.531184:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.531222:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872953.531228:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327867904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872953.531248:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872953.531274:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327868032 00000100:00100000:2.0:1788872953.531281:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327868032 00000100:00100000:2.0:1788872953.531316:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327867904 00000100:00100000:2.0:1788872953.531318:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327867904 00000100:00100000:2.0:1788872953.531334:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225 00000100:00100000:2.0:1788872953.531341:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327868032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872953.531368:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872953.531402:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327868032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.531408:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225 00000100:00100000:2.0:1788872953.531421:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2226 00000100:00100000:2.0:1788872953.531426:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327867904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872953.531438:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872953.531457:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327867904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.531462:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2226 00000100:00100000:2.0:1788872953.531500:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327867904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872953.531509:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327868032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872953.532907:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872953.532928:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327868160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872953.532987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872953.534709:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327868160 00000100:00100000:1.0:1788872953.534722:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327868160 00000100:00100000:1.0:1788872953.534786:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056 00000100:00100000:1.0:1788872953.534796:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327868160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788872953.534845:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1298812928 00000100:00100000:1.0:1788872953.534912:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327868160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872953.534919:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056 00000100:00100000:3.0:1788872953.535736:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327868160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872953.616394:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872953.616462:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872953.616496:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872953.616580:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872953.616612:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311236736 00000100:00100000:2.0:1788872953.616621:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311236736 00000100:00100000:2.0:1788872953.616673:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311236608 00000100:00100000:2.0:1788872953.616677:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311236608 00000100:00100000:2.0:1788872953.616700:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2757 00000100:00100000:2.0:1788872953.616711:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2407:x1875765311236736:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872953.616784:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2407:x1875765311236736:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 74us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.616792:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2757 00000100:00100000:2.0:1788872953.616809:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2758 00000100:00100000:2.0:1788872953.616816:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311236608:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872953.616857:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2407:x1875765311236608:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 41us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872953.616863:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2758 00000100:00100000:0.0:1788872953.617116:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311236480 00000100:00100000:0.0:1788872953.617120:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311236480 00000100:00100000:0.0:1788872953.617158:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311236352 00000100:00100000:0.0:1788872953.617161:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311236352 00000100:00100000:0.0:1788872953.617182:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1484 00000100:00100000:0.0:1788872953.617188:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2407:x1875765311236480:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872953.617222:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2407:x1875765311236480:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 34us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872953.617234:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1484 00000100:00100000:0.0:1788872953.617248:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1485 00000100:00100000:0.0:1788872953.617254:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2407:x1875765311236352:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872953.617280:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2407:x1875765311236352:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 26us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872953.617286:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1485 00000100:00080000:1.0:1788872953.617429:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788872953.617434:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788872953.617437:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872953.617439:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788872954.171475:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788872954.426019:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788872954.426028:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9fa734000 from 61 10000000:01000000:1.0:1788872954.426034:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788872954.426088:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98aa002a5e00/0xe4e6e89fb01dbb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.426100:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98aa002a5e00/0xe4e6e89fb01dbb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.426112:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98aa002a5e00/0xe4e6e89fb01dbb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872954.426140:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327868288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.426213:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.426261:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef209840 going to sleep for 11 seconds 00000100:00100000:2.0:1788872954.426384:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327868288 00000100:00100000:2.0:1788872954.426391:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327868288 00000100:00100000:2.0:1788872954.426449:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788872954.426459:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+15:6517:x1875765327868288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872954.426473:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872954.426487:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9caa1b600/0xe4e6e89fb01dbb78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbb71 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.426508:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9caa1b600/0xe4e6e89fb01dbb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb71 expref: 16 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.426529:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9caa1b600/0xe4e6e89fb01dbb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb71 expref: 16 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.426539:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9caa1b600, rc 0) 00000100:00100000:2.0:1788872954.426769:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327868288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 311us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872954.426775:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788872954.426887:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327868288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872954.426904:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98aa002a5e00/0xe4e6e89fb01dbb71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.426912:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98aa002a5e00/0xe4e6e89fb01dbb71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872954.426974:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327868416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.427004:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.427048:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef209840 going to sleep for 11 seconds 00000100:00100000:3.0:1788872954.427155:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327868416 00000100:00100000:3.0:1788872954.427167:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327868416 00000100:00100000:3.0:1788872954.427203:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788872954.427210:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327868416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.427339:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327868416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872954.427347:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788872954.427430:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327868416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.427460:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327868544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.427501:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872954.427543:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9efa6ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872954.427734:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327868544 00000100:00100000:3.0:1788872954.427738:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327868544 00000100:00100000:3.0:1788872954.427765:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788872954.427772:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327868544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.427868:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327868544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872954.427873:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788872954.428254:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327868544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.429216:0:95409:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95409:1875765327868672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872954.429259:0:95409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.429291:0:95409:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef209300 going to sleep for 11 seconds 00000100:00100000:3.0:1788872954.429338:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327868672 00000100:00100000:3.0:1788872954.429343:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327868672 00000100:00100000:3.0:1788872954.429414:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788872954.429423:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:95409:x1875765327868672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872954.429525:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:95409:x1875765327868672:12345-0@lo:502:llog_process_th.0 Request processed in 104us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872954.429533:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788872954.429638:0:95409:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95409:1875765327868672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872954.429680:0:95409:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95409:1875765327868800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872954.429713:0:95409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.443457:0:95409:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef209300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872954.450988:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327868800 00000100:00100000:2.0:1788872954.451005:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327868800 00000100:00100000:2.0:1788872954.456825:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788872954.456840:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:95409:x1875765327868800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872954.457033:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:95409:x1875765327868800:12345-0@lo:502:llog_process_th.0 Request processed in 196us (27319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872954.457042:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788872954.457370:0:95409:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95409:1875765327868800:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788872954.457411:0:95409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1788872954.458174:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1788872954.458197:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788872954.458207:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98aa002a5e00/0xe4e6e89fb01dbb71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.458219:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98aa002a5e00/0xe4e6e89fb01dbb71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872954.458228:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788872954.458230:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:2.0:1788872954.458233:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788872954.458270:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a400/0xe4e6e89fb01dbb7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.458277:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a400/0xe4e6e89fb01dbb7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.458286:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a400/0xe4e6e89fb01dbb7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872954.458307:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327868928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872954.458349:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872954.458385:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9efa6ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872954.458438:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327868928 00000100:00100000:1.0:1788872954.458445:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327868928 00000100:00100000:1.0:1788872954.458484:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788872954.458492:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+16:6517:x1875765327868928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872954.458502:0:94377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872954.458515:0:94377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa002a5400/0xe4e6e89fb01dbb86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbb7f expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.458544:0:94377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa002a5400/0xe4e6e89fb01dbb86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb7f expref: 17 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.458587:0:94377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa002a5400/0xe4e6e89fb01dbb86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb7f expref: 17 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.458607:0:94377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa002a5400, rc 0) 00000100:00100000:1.0:1788872954.458640:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327868928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872954.458647:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788872954.458789:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327868928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872954.458803:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a400/0xe4e6e89fb01dbb7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872954.458824:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a400/0xe4e6e89fb01dbb7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872954.458897:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327869056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.458926:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872954.458956:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788872954.459052:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327869056 00000100:00100000:1.0:1788872954.459058:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327869056 00000100:00100000:1.0:1788872954.459094:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788872954.459101:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327869056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.459210:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327869056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872954.459216:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788872954.459245:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327869056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.459271:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327869184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.459309:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.459324:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9ef209b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872954.459335:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327869184 00000100:00100000:1.0:1788872954.459338:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327869184 00000100:00100000:1.0:1788872954.459360:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788872954.459366:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327869184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.459444:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327869184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872954.459450:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788872954.459491:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327869184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.459748:0:95410:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95410:1875765327869312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872954.459901:0:95410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.459927:0:95410:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872954.459982:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327869312 00000100:00100000:0.0:1788872954.459986:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327869312 00000100:00100000:0.0:1788872954.460015:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788872954.460022:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:95410:x1875765327869312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872954.460114:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:95410:x1875765327869312:12345-0@lo:502:llog_process_th.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872954.460121:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788872954.460233:0:95410:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95410:1875765327869312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872954.460254:0:95410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788872954.460265:0:95410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872954.460267:0:95410:0:(obd_config.c:1561:class_process_config()) marker 49 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:1.0:1788872954.460272:0:95410:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1788872954.487519:0:95410:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95410:1875765327869440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872954.487724:0:95410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.489278:0:95410:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e84000 going to sleep for 11 seconds 00000100:00100000:3.0:1788872954.489370:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327869440 00000100:00100000:3.0:1788872954.489381:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327869440 00000100:00100000:3.0:1788872954.489443:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788872954.489452:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:95410:x1875765327869440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872954.489630:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:95410:x1875765327869440:12345-0@lo:502:llog_process_th.0 Request processed in 178us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872954.489639:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788872954.490371:0:95410:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95410:1875765327869440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872954.490411:0:95410:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872954.490419:0:95410:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872954.490421:0:95410:0:(obd_config.c:1561:class_process_config()) marker 49 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:1.0:1788872954.490438:0:95410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:2.0:1788872954.494385:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:2.0:1788872954.494437:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788872954.494450:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a400/0xe4e6e89fb01dbb7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.494463:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a400/0xe4e6e89fb01dbb7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872954.494475:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788872954.494477:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9d0cfb000 from 61 10000000:01000000:2.0:1788872954.494481:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788872954.494520:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a600/0xe4e6e89fb01dbb8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.494528:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a600/0xe4e6e89fb01dbb8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.494538:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a600/0xe4e6e89fb01dbb8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872954.494607:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327869568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872954.494673:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872954.494720:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9efa6ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872954.495056:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327869568 00000100:00100000:3.0:1788872954.495065:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327869568 00000100:00100000:3.0:1788872954.495122:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788872954.495131:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+17:6517:x1875765327869568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872954.495145:0:94377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872954.495158:0:94377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c449aa00/0xe4e6e89fb01dbb94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbb8d expref: -99 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872954.495180:0:94377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c449aa00/0xe4e6e89fb01dbb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb8d expref: 18 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872954.495191:0:94377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c449aa00/0xe4e6e89fb01dbb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb8d expref: 18 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872954.495199:0:94377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449aa00, rc 0) 00000100:00100000:3.0:1788872954.495247:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327869568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872954.495260:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788872954.496818:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327869568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872954.496840:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a600/0xe4e6e89fb01dbb8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb94 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.496851:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a600/0xe4e6e89fb01dbb8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb94 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872954.496925:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327869696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872954.496965:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872954.497006:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9efa6ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788872954.497296:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327869696 00000100:00100000:3.0:1788872954.497302:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327869696 00000100:00100000:3.0:1788872954.497342:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788872954.497350:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327869696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.497491:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327869696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872954.497498:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788872954.498505:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327869696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872954.498545:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327869824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872954.498888:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872954.498918:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9efa6ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788872954.498968:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327869824 00000100:00100000:0.0:1788872954.498973:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327869824 00000100:00100000:0.0:1788872954.499016:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788872954.499023:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327869824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.499129:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327869824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872954.499135:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788872954.499269:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327869824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.499653:0:95411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95411:1875765327869952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872954.499691:0:95411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872954.499719:0:95411:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618540 going to sleep for 11 seconds 00000100:00100000:1.0:1788872954.499881:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327869952 00000100:00100000:1.0:1788872954.499886:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327869952 00000100:00100000:1.0:1788872954.499918:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788872954.499924:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:95411:x1875765327869952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872954.500024:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:95411:x1875765327869952:12345-0@lo:502:llog_process_th.0 Request processed in 99us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872954.500038:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788872954.500890:0:95411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95411:1875765327869952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872954.500940:0:95411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95411:1875765327870080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872954.500980:0:95411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872954.501088:0:95411:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618540 going to sleep for 11 seconds 00000100:00100000:1.0:1788872954.501146:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327870080 00000100:00100000:1.0:1788872954.501151:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327870080 00000100:00100000:1.0:1788872954.501186:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788872954.501193:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:95411:x1875765327870080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872954.501285:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:95411:x1875765327870080:12345-0@lo:502:llog_process_th.0 Request processed in 91us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872954.501292:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788872954.501362:0:95411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95411:1875765327870080:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788872954.501383:0:95411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1788872954.502715:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1788872954.502745:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788872954.502754:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a600/0xe4e6e89fb01dbb8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb94 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.502765:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a600/0xe4e6e89fb01dbb8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbb94 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872954.502846:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788872954.502849:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:1.0:1788872954.502853:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788872954.502887:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98aa002a5000/0xe4e6e89fb01dbb9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.502895:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98aa002a5000/0xe4e6e89fb01dbb9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.502903:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98aa002a5000/0xe4e6e89fb01dbb9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872954.502920:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327870208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.502976:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.503004:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e84900 going to sleep for 11 seconds 00000100:00100000:0.0:1788872954.503143:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327870208 00000100:00100000:0.0:1788872954.503149:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327870208 00000100:00100000:0.0:1788872954.503183:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788872954.503190:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+18:6517:x1875765327870208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872954.503202:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872954.503214:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01dbba2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbb9b expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.503237:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01dbba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb9b expref: 19 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.503246:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01dbba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb9b expref: 19 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.503253:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52afc00, rc 0) 00000100:00100000:0.0:1788872954.503300:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327870208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872954.503306:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788872954.503703:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327870208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872954.503718:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98aa002a5000/0xe4e6e89fb01dbb9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbba2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.503728:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98aa002a5000/0xe4e6e89fb01dbb9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbba2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872954.504697:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327870336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.504742:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872954.504978:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327870336 00000100:00100000:3.0:1788872954.504984:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327870336 00000100:00100000:0.0:1788872954.516440:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788872954.516467:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327870336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.516889:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327870336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 435us (12143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872954.516897:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788872954.525714:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e84900 going to sleep for 11 seconds 00000100:00100000:0.0:1788872954.525767:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327870336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.525857:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327870464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.525941:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872954.526003:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872954.526136:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327870464 00000100:00100000:3.0:1788872954.526143:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327870464 00000100:00100000:3.0:1788872954.526190:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788872954.526199:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327870464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.526312:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327870464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872954.526331:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788872954.528352:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327870464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.532600:0:95412:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95412:1875765327870592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872954.532691:0:95412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872954.532732:0:95412:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872954.532888:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327870592 00000100:00100000:2.0:1788872954.532896:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327870592 00000100:00100000:2.0:1788872954.532942:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788872954.532949:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:95412:x1875765327870592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872954.533091:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:95412:x1875765327870592:12345-0@lo:502:llog_process_th.0 Request processed in 141us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872954.533098:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788872954.535865:0:95412:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95412:1875765327870592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788872954.535914:0:95412:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872954.535926:0:95412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872954.535929:0:95412:0:(obd_config.c:1561:class_process_config()) marker 50 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:3.0:1788872954.535937:0:95412:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1788872954.536101:0:95412:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95412:1875765327870720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872954.536218:0:95412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872954.536260:0:95412:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788872954.536387:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327870720 00000100:00100000:0.0:1788872954.536394:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327870720 00000100:00100000:0.0:1788872954.536439:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788872954.536447:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:95412:x1875765327870720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788872954.536618:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:95412:x1875765327870720:12345-0@lo:502:llog_process_th.0 Request processed in 171us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872954.536625:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788872954.536943:0:95412:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95412:1875765327870720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788872954.536964:0:95412:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872954.536969:0:95412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872954.536970:0:95412:0:(obd_config.c:1561:class_process_config()) marker 50 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:1.0:1788872954.536975:0:95412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:0.0:1788872954.537706:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:0.0:1788872954.537732:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788872954.537742:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98aa002a5000/0xe4e6e89fb01dbb9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbba2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.537753:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98aa002a5000/0xe4e6e89fb01dbb9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbba2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872954.537762:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788872954.537783:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ff5b1000 from 61 10000000:01000000:0.0:1788872954.537787:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788872954.537822:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01dbba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.537830:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01dbba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.537840:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01dbba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872954.537857:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327870848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.537891:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872954.537932:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618540 going to sleep for 11 seconds 00000100:00100000:2.0:1788872954.538081:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327870848 00000100:00100000:2.0:1788872954.538087:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327870848 00000100:00100000:2.0:1788872954.538126:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788872954.538133:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+19:6517:x1875765327870848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872954.538143:0:94376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872954.538156:0:94376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9caa1bc00/0xe4e6e89fb01dbbb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbba9 expref: -99 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.538176:0:94376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9caa1bc00/0xe4e6e89fb01dbbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbba9 expref: 20 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.538185:0:94376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9caa1bc00/0xe4e6e89fb01dbbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbba9 expref: 20 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.538193:0:94376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9caa1bc00, rc 0) 00000100:00100000:2.0:1788872954.538229:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327870848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872954.538235:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788872954.538322:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327870848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872954.538336:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01dbba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbb0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.538346:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01dbba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbb0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872954.538400:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327870976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.538428:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.538457:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e84300 going to sleep for 11 seconds 00000100:00100000:2.0:1788872954.538718:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327870976 00000100:00100000:2.0:1788872954.538722:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327870976 00000100:00100000:2.0:1788872954.538749:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788872954.538756:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327870976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872954.538956:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327870976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872954.538973:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788872954.539070:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327870976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.539101:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327871104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.539136:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.539163:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e84300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872954.539583:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327871104 00000100:00100000:0.0:1788872954.539588:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327871104 00000100:00100000:0.0:1788872954.539687:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788872954.539694:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327871104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.539882:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327871104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872954.539890:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788872954.540163:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327871104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.549337:0:95413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95413:1875765327871232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872954.549433:0:95413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872954.549483:0:95413:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7119840 going to sleep for 11 seconds 00000100:00100000:2.0:1788872954.549724:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327871232 00000100:00100000:2.0:1788872954.549732:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327871232 00000100:00100000:2.0:1788872954.549787:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788872954.549797:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:95413:x1875765327871232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872954.549943:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:95413:x1875765327871232:12345-0@lo:502:llog_process_th.0 Request processed in 147us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872954.549952:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788872954.550045:0:95413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95413:1875765327871232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872954.550093:0:95413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95413:1875765327871360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872954.550127:0:95413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872954.550140:0:95413:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7119840 going to sleep for 11 seconds 00000100:00100000:1.0:1788872954.550412:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327871360 00000100:00100000:1.0:1788872954.550418:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327871360 00000100:00100000:1.0:1788872954.550451:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788872954.550458:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:95413:x1875765327871360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872954.550535:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:95413:x1875765327871360:12345-0@lo:502:llog_process_th.0 Request processed in 78us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872954.550543:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788872954.550787:0:95413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95413:1875765327871360:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788872954.550819:0:95413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1788872954.551335:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1788872954.551363:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788872954.551374:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01dbba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbb0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.551384:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01dbba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbb0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788872954.551394:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788872954.551397:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788872954.551400:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788872954.551424:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98aa002a4e00/0xe4e6e89fb01dbbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.551432:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98aa002a4e00/0xe4e6e89fb01dbbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.551453:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98aa002a4e00/0xe4e6e89fb01dbbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872954.551468:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327871488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.551501:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.551538:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e84b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788872954.551630:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327871488 00000100:00100000:2.0:1788872954.551635:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327871488 00000100:00100000:2.0:1788872954.551669:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788872954.551676:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+20:6517:x1875765327871488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872954.551687:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872954.551699:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9caa1b000/0xe4e6e89fb01dbbbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbbb7 expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.551722:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9caa1b000/0xe4e6e89fb01dbbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbb7 expref: 21 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.551733:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9caa1b000/0xe4e6e89fb01dbbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbb7 expref: 21 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.551742:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9caa1b000, rc 0) 00000100:00100000:2.0:1788872954.551786:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327871488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872954.551793:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788872954.551960:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327871488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872954.551973:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98aa002a4e00/0xe4e6e89fb01dbbb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbbe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.551982:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98aa002a4e00/0xe4e6e89fb01dbbb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbbe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872954.552030:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327871616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.552055:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.552080:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e84b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872954.552094:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327871616 00000100:00100000:1.0:1788872954.552097:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327871616 00000100:00100000:1.0:1788872954.552120:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788872954.552126:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327871616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.552229:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327871616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872954.552236:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788872954.554465:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327871616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.554526:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327871744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.555132:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872954.555184:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3618540 going to sleep for 11 seconds 00000100:00100000:1.0:1788872954.555933:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327871744 00000100:00100000:1.0:1788872954.555941:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327871744 00000100:00100000:1.0:1788872954.555988:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788872954.556006:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327871744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.556136:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327871744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872954.556144:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788872954.556704:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327871744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872954.562035:0:95414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788872954.562282:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788872954.562335:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788872954.562347:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98aa002a4e00/0xe4e6e89fb01dbbb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbbe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.562360:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98aa002a4e00/0xe4e6e89fb01dbbb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbbe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872954.562370:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788872954.562373:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9ef97c000 from 61 10000000:01000000:0.0:1788872954.562376:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788872954.562416:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.562425:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.562436:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872954.562462:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327871872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.562529:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872954.562640:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c1370900 going to sleep for 11 seconds 00000100:00100000:2.0:1788872954.562820:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327871872 00000100:00100000:2.0:1788872954.562834:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327871872 00000100:00100000:2.0:1788872954.562883:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788872954.562892:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:6517:x1875765327871872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872954.562905:0:94382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872954.562917:0:94382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9caa1a800/0xe4e6e89fb01dbbcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbbc5 expref: -99 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.562940:0:94382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9caa1a800/0xe4e6e89fb01dbbcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbc5 expref: 22 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.562951:0:94382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9caa1a800/0xe4e6e89fb01dbbcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbc5 expref: 22 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.562959:0:94382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9caa1a800, rc 0) 00000100:00100000:2.0:1788872954.563004:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327871872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872954.563010:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788872954.564739:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327871872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872954.564763:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872954.564788:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872954.564879:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327872000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.564923:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872954.564960:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c71199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872954.565181:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327872000 00000100:00100000:1.0:1788872954.565187:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327872000 00000100:00100000:1.0:1788872954.565235:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788872954.565245:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327872000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.565518:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327872000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872954.565525:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788872954.566097:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327872000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.566148:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327872128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.566191:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872954.566270:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c71199c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872954.574456:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327872128 00000100:00100000:2.0:1788872954.574473:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327872128 00000100:00100000:2.0:1788872954.574713:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788872954.574725:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327872128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872954.574910:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327872128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (8717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872954.574919:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788872954.575026:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327872128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.575565:0:95415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95415:1875765327872256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872954.575625:0:95415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872954.578946:0:95415:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7119e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872954.579910:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327872256 00000100:00100000:1.0:1788872954.579924:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327872256 00000100:00100000:1.0:1788872954.581457:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788872954.581470:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:95415:x1875765327872256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788872954.581881:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:95415:x1875765327872256:12345-0@lo:502:llog_process_th.0 Request processed in 413us (6254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872954.581889:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788872954.581993:0:95415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95415:1875765327872256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872954.582072:0:95415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95415:1875765327872384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788872954.582117:0:95415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872954.582153:0:95415:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c7119e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788872954.582308:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327872384 00000100:00100000:2.0:1788872954.582322:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327872384 00000100:00100000:2.0:1788872954.582358:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788872954.582366:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:95415:x1875765327872384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788872954.582448:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:95415:x1875765327872384:12345-0@lo:502:llog_process_th.0 Request processed in 82us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872954.582454:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788872954.582624:0:95415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f2e885a0-f180-4b85-9f87-6a01e20afd1a:95415:1875765327872384:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788872954.582645:0:95415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1788872954.585461:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1788872954.585496:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788872954.585507:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.585520:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872954.585531:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788872954.585534:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788872954.585537:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788872954.585627:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.585636:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872954.585646:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872954.585671:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327872512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788872954.585727:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872954.585769:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c73a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872954.586000:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327872512 00000100:00100000:3.0:1788872954.586007:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327872512 00000100:00100000:3.0:1788872954.586050:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788872954.586059:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327872512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788872954.586073:0:94382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872954.586085:0:94382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c449be00/0xe4e6e89fb01dbbda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbbd3 expref: -99 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872954.586108:0:94382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c449be00/0xe4e6e89fb01dbbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbd3 expref: 23 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872954.586119:0:94382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c449be00/0xe4e6e89fb01dbbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbd3 expref: 23 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872954.586140:0:94382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449be00, rc 0) 00000100:00100000:3.0:1788872954.586192:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327872512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872954.586199:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788872954.586278:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327872512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872954.586293:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.586302:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872954.586376:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327872640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.586408:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.586435:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788872954.586604:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327872640 00000100:00100000:3.0:1788872954.586608:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327872640 00000100:00100000:3.0:1788872954.586635:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788872954.586641:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327872640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.586743:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327872640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872954.586750:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788872954.587010:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327872640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.587042:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327872768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788872954.587104:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872954.587131:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c460f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788872954.587171:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327872768 00000100:00100000:3.0:1788872954.587176:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327872768 00000100:00100000:3.0:1788872954.587207:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788872954.587213:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327872768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.587300:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327872768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872954.587467:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788872954.587708:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327872768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788872954.589043:0:95416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788872954.594751:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788872954.594791:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788872954.594805:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.594828:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872954.597437:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788872954.597444:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98a9e9b999c0 from 1 10000000:01000000:0.0:1788872954.597448:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788872954.597504:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01dbbe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.597516:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01dbbe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.597546:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01dbbe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872954.598052:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327872896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.598122:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872954.598189:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c1370480 going to sleep for 11 seconds 00000100:00100000:1.0:1788872954.599584:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327872896 00000100:00100000:1.0:1788872954.599605:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327872896 00000100:00100000:1.0:1788872954.599660:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788872954.599670:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327872896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872954.599684:0:94376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872954.599702:0:94376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa002a4600/0xe4e6e89fb01dbbe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dbbe1 expref: -99 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.599729:0:94376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa002a4600/0xe4e6e89fb01dbbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbe1 expref: 24 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.599741:0:94376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa002a4600/0xe4e6e89fb01dbbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbe1 expref: 24 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872954.599765:0:94376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa002a4600, rc 0) 00000100:00100000:1.0:1788872954.599836:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327872896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872954.599844:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788872954.600633:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327872896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872954.600653:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01dbbe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbe8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.600664:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01dbbe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbe8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872954.600736:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327873024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.600771:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872954.600831:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c1370480 going to sleep for 11 seconds 00000100:00100000:2.0:1788872954.600940:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327873024 00000100:00100000:2.0:1788872954.600946:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327873024 00000100:00100000:2.0:1788872954.600984:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788872954.601001:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327873024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788872954.601088:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327873024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (316us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788872954.601094:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788872954.601605:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327873024:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788872954.601640:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788872954.601647:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01dbbe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbe8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.601655:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01dbbe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbe8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872954.761649:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872954.761887:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311236864 00000100:00100000:0.0:1788872954.761897:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311236864 00000100:00100000:0.0:1788872954.761965:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 172 00000100:00100000:0.0:1788872954.761974:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+8:71021:x1875765311236864:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872954.761990:0:94381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872954.762007:0:94381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52ae600/0xe4e6e89fb01dbbef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb246 expref: -99 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.762034:0:94381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52ae600/0xe4e6e89fb01dbbef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb246 expref: 9 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.762045:0:94381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52ae600/0xe4e6e89fb01dbbef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb246 expref: 9 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.762056:0:94381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52ae600, rc 0) 00000100:00100000:0.0:1788872954.762109:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311236864:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 136us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872954.762116:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 172 00000100:00100000:2.0:1788872954.766227:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872954.766437:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311236992 00000100:00100000:0.0:1788872954.766449:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311236992 00000100:00100000:0.0:1788872954.766723:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 173 00000100:00100000:0.0:1788872954.766737:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311236992:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788872954.766913:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311236992:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 178us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872954.771711:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 173 00000100:00100000:2.0:1788872954.772463:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872954.777918:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311237120 00000100:00100000:3.0:1788872954.777933:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311237120 00000100:00100000:2.0:1788872954.778085:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 174 00000100:00100000:2.0:1788872954.778096:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311237120:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788872954.778300:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311237120:12345-192.168.204.39@tcp:503:ll_cfg_requeue.0 Request processed in 197us (5829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872954.778315:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 174 00000100:00100000:0.0:1788872954.784046:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872954.785598:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311237248 00000100:00100000:1.0:1788872954.785611:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311237248 00000100:00100000:1.0:1788872954.785696:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 175 00000100:00100000:1.0:1788872954.785707:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+9:73419:x1875765311237248:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788872954.785872:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+9:73419:x1875765311237248:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 166us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872954.785880:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 175 00000100:00100000:2.0:1788872954.796028:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872954.796124:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311237376 00000100:00100000:0.0:1788872954.796134:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311237376 00000100:00100000:0.0:1788872954.796190:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 176 00000100:00100000:0.0:1788872954.796228:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:73419:x1875765311237376:12345-192.168.204.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788872954.796840:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+9:73419:x1875765311237376:12345-192.168.204.39@tcp:502:llog_process_th.0 Request processed in 613us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872954.796848:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 176 00000100:00100000:2.0:1788872954.801449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872954.801721:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311237504 00000100:00100000:0.0:1788872954.801733:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311237504 00000100:00100000:0.0:1788872954.801813:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 177 00000100:00100000:0.0:1788872954.801826:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311237504:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788872954.801845:0:94381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872954.801867:0:94381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbbf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb24d expref: -99 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.801898:0:94381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbbf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb24d expref: 10 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.801909:0:94381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbbf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb24d expref: 10 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872954.801920:0:94381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52afe00, rc 0) 00000100:00100000:0.0:1788872954.801978:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311237504:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 154us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872954.801985:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 177 00000100:00100000:1.0:1788872954.807479:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872954.807575:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311237632 00000100:00100000:3.0:1788872954.807979:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311237632 00000100:00100000:3.0:1788872954.808110:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 178 00000100:00100000:3.0:1788872954.808121:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311237632:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788872954.808943:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311237632:12345-192.168.204.39@tcp:501:ll_cfg_requeue.0 Request processed in 821us (1471us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788872954.808953:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 178 00010000:00010000:1.0:1788872955.193264:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872956.220359:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872956.601187:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872956.601219:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327873152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788872956.601318:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872956.601378:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327873152 00000100:00100000:2.0:1788872956.601388:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327873152 00000100:00100000:2.0:1788872956.601460:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227 00000100:00100000:2.0:1788872956.601473:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327873152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872956.601520:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788872956.601688:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872956.606060:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327873152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4574us (4726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872956.606086:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227 00000100:00100000:3.0:1788872956.606267:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327873152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872956.606326:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327873280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872956.606386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872956.606441:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327873280 00000100:00100000:3.0:1788872956.606450:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327873280 00000100:00100000:3.0:1788872956.606519:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2228 00000100:00100000:3.0:1788872956.606530:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327873280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872956.606657:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872956.606709:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327873280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 180us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872956.606716:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2228 00000100:00080000:3.0:1788872956.606734:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872956.606759:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327873280:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788872957.241641:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872958.139335:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327873792:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.139410:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.139455:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327874304:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.139499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.139522:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327874816:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.139542:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.139600:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788872958.139607:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327873408:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.139638:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.139670:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327873920:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.139695:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.139712:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327874432:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.139733:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.139767:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327874944:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.139789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.139825:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327874304 00000100:00100000:0.0:1788872958.139832:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327874304 00000100:00100000:0.0:1788872958.139881:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327874816 00000100:00100000:0.0:1788872958.139884:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327874816 00000100:00100000:0.0:1788872958.139906:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759 00000100:00100000:0.0:1788872958.139915:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327874304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.139968:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327874304:12345-0@lo:400:kworker.0 Request processed in 53us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872958.139976:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759 00000100:00100000:0.0:1788872958.139993:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760 00000100:00100000:0.0:1788872958.139999:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327874816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140027:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327874816:12345-0@lo:400:kworker.0 Request processed in 29us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872958.140043:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760 00000100:00100000:0.0:1788872958.140065:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327873792 00000100:00100000:0.0:1788872958.140069:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327873792 00000100:00100000:0.0:1788872958.140090:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327873920 00000100:00100000:0.0:1788872958.140093:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327873920 00000100:00100000:0.0:1788872958.140107:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327874432 00000100:00100000:0.0:1788872958.140109:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327874432 00000100:00100000:0.0:1788872958.140119:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327874944 00000100:00100000:0.0:1788872958.140121:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327874944 00000100:00100000:0.0:1788872958.140131:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1788872958.140137:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327873792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140171:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327873792:12345-0@lo:400:kworker.0 Request processed in 34us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872958.140177:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1788872958.140188:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:0.0:1788872958.140194:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327873920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140220:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327873920:12345-0@lo:400:kworker.0 Request processed in 27us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872958.140226:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:0.0:1788872958.140235:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:0.0:1788872958.140241:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c56ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327874432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140266:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c56ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327874432:12345-0@lo:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872958.140271:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:0.0:1788872958.140282:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1788872958.140288:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c56fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327874944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140324:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c56fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327874944:12345-0@lo:400:kworker.0 Request processed in 37us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872958.140330:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1788872958.140370:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327873920:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140381:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327874432:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140389:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327874944:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140397:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327873792:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140406:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327874304:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140415:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327874816:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140467:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327873664:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140492:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.140513:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f09d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327874176:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.140569:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327874688:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140591:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.140613:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788872958.140619:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327873536:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.140657:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327874048:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.140698:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327874560:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140716:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872958.140767:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327873664 00000100:00100000:0.0:1788872958.140772:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327873664 00000100:00100000:0.0:1788872958.140792:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327873536 00000100:00100000:0.0:1788872958.140796:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327873536 00000100:00100000:0.0:1788872958.140809:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:0.0:1788872958.140814:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327873664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140853:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327873664:12345-0@lo:400:kworker.0 Request processed in 38us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872958.140859:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:0.0:1788872958.140871:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1788872958.140877:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327873536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140906:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875765327873536:12345-0@lo:400:kworker.0 Request processed in 29us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872958.140911:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1788872958.140937:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1875765327873536:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140947:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327873664:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.140974:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327874048 00000100:00100000:0.0:1788872958.140977:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327874048 00000100:00100000:0.0:1788872958.141001:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327874560 00000100:00100000:0.0:1788872958.141004:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327874560 00000100:00100000:0.0:1788872958.141021:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4057 00000100:00100000:0.0:1788872958.141026:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327874048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.141063:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327874048:12345-0@lo:400:kworker.0 Request processed in 36us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872958.141069:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4057 00000100:00100000:0.0:1788872958.141081:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4058 00000100:00100000:0.0:1788872958.141087:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327874560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.141126:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327874560:12345-0@lo:400:kworker.0 Request processed in 39us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872958.141132:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4058 00000100:00100000:0.0:1788872958.141160:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327874048:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.141169:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327874560:0@lo:400:kworker.0 00000100:00080000:0.0:1788872958.141204:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872958.141208:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872958.141211:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872958.143238:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327874176 00000100:00100000:1.0:1788872958.143267:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327874176 00000100:00100000:1.0:1788872958.143345:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327874688 00000100:00100000:1.0:1788872958.143351:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327874688 00000100:00100000:1.0:1788872958.143385:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761 00000100:00100000:1.0:1788872958.143398:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327874176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872958.145506:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327874176:12345-0@lo:400:kworker.0 Request processed in 2090us (4949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872958.145521:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761 00000100:00100000:1.0:1788872958.145571:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762 00000100:00100000:1.0:1788872958.145588:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327874688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872958.145700:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327874688:12345-0@lo:400:kworker.0 Request processed in 119us (5105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872958.145708:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762 00000100:00080000:1.0:1788872958.145751:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872958.146683:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f09d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327874176:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.146700:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327874688:0@lo:400:kworker.0 00000100:00100000:2.0:1788872958.147620:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327873408 00000100:00100000:2.0:1788872958.147628:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327873408 00000100:00100000:2.0:1788872958.147689:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788872958.147699:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327873408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872958.150537:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327873408:12345-0@lo:400:kworker.0 Request processed in 2827us (10885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872958.150581:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788872958.150622:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8ca109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327873408:0@lo:400:kworker.0 00000100:00100000:0.0:1788872958.157866:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327875072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872958.157958:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872958.158361:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327875072 00000100:00100000:1.0:1788872958.158370:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327875072 00000100:00100000:1.0:1788872958.158423:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059 00000100:00100000:1.0:1788872958.158431:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327875072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872958.158464:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1788872958.166210:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327875072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7769us (8242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872958.166225:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059 00000100:00100000:0.0:1788872958.167225:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327875072:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788872958.265330:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872958.650961:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327875200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872958.651043:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872958.651224:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327875328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872958.651258:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872958.651296:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327875328 00000100:00100000:2.0:1788872958.651303:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327875328 00000100:00100000:2.0:1788872958.651353:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2229 00000100:00100000:3.0:1788872958.651358:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327875200 00000100:00100000:2.0:1788872958.651364:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327875328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872958.651365:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327875200 00002000:00000024:2.0:1788872958.651396:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872958.651404:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4060 00000100:00100000:3.0:1788872958.651414:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327875200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872958.651440:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1788872958.651513:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327875200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872958.651521:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4060 00000100:00100000:3.0:1788872958.651599:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f85c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327875200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872958.651744:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f663c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327875456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788872958.651775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872958.651829:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327875328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 466us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872958.651838:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2229 00000100:00100000:3.0:1788872958.651842:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327875328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872958.651854:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327875456 00000100:00100000:2.0:1788872958.651858:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327875456 00000100:00100000:2.0:1788872958.651882:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2230 00000100:00100000:2.0:1788872958.651889:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327875456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872958.651906:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872958.651949:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327875456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872958.651955:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2230 00000100:00100000:3.0:1788872958.652769:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f663c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327875456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872958.732033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872958.732080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872958.732110:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872958.732139:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872958.732164:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872958.732190:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311238272 00000100:00100000:2.0:1788872958.732206:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311238272 00000100:00100000:0.0:1788872958.732256:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311238016 00000100:00100000:0.0:1788872958.732263:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311238016 00000100:00100000:2.0:1788872958.732281:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311238144 00000100:00100000:2.0:1788872958.732286:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311238144 00000100:00100000:2.0:1788872958.732317:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2763 00000100:00100000:2.0:1788872958.732326:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2406:x1875765311238272:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872958.732404:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2406:x1875765311238272:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872958.732412:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2763 00000100:00100000:2.0:1788872958.732429:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6011 00000100:00100000:2.0:1788872958.732435:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2403:x1875765311238144:12345-192.168.204.39@tcp:9:kworker.0 00000020:00000080:2.0:1788872958.732454:0:26182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dba13 00000100:00080000:2.0:1788872958.732463:0:26182:0:(import.c:65:import_set_state_nolock()) ffff98a9e98d5000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788872958.732469:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311237888 00000100:00100000:0.0:1788872958.732474:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311237888 00000100:00100000:0.0:1788872958.732515:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1492 00000100:00100000:0.0:1788872958.732524:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2406:x1875765311238016:12345-192.168.204.39@tcp:400:kworker.0 00000001:00000004:2.0:1788872958.732526:0:26182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969456 00000100:00100000:0.0:1788872958.732600:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2406:x1875765311238016:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 77us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872958.732608:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1492 00000100:00100000:0.0:1788872958.732624:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1493 00000100:00100000:0.0:1788872958.732633:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2406:x1875765311237888:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872958.732678:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2406:x1875765311237888:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 46us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872958.732686:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1493 00000100:00100000:2.0:1788872958.732708:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+2:2403:x1875765311238144:12345-192.168.204.39@tcp:9:kworker.0 Request processed in 271us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872958.732717:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6011 00000100:00080000:0.0:1788872958.732759:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872958.732765:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788872958.732767:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872958.732770:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872958.732833:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311237760 00000100:00100000:1.0:1788872958.732839:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311237760 00000100:00100000:1.0:1788872958.732874:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 180 00000100:00100000:1.0:1788872958.732882:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311237760:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872958.732909:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311237760:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 28us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872958.732916:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 180 00010000:00010000:2.0:1788872958.734858:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872959.307523:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788872959.903421:0:95514:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 09:09:18 (1788872958) 00000100:00100000:1.0:1788872960.089297:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.089686:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311238528 00000100:00100000:3.0:1788872960.089697:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311238528 00000100:00100000:3.0:1788872960.089776:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1463 00000100:00100000:3.0:1788872960.089786:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+10:73595:x1875765311238528:12345-192.168.204.39@tcp:36:mkdir.0 00010000:00010000:3.0:1788872960.089847:0:68674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872960.089875:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aec00/0xe4e6e89fb01dba0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1f2 expref: 10 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.089892:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:3.0:1788872960.089896:0:68674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872960.089961:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbbfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.089975:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbbfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.089985:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbbfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.090029:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b800/0xe4e6e89fb01dbc04 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.090037:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b800/0xe4e6e89fb01dbc04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.090044:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b800/0xe4e6e89fb01dbc04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788872960.090534:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788872960.104759:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a200/0xe4e6e89fb01dbc0b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.104784:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a200/0xe4e6e89fb01dbc0b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.104797:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a200/0xe4e6e89fb01dbc0b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872960.105105:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b3b2e864 reply state 00000000a3be881a transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a200/0xe4e6e89fb01dbc0b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.105130:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a200/0xe4e6e89fb01dbc0b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.105139:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872960.105142:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872960.105146:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788872960.105152:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1788872960.105163:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbbfd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.105170:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbbfd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.105176:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbbfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.105297:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbbfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.105306:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449ac00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872960.105319:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbbfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.105327:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbbfd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.105339:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:2.0:1788872960.105342:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872960.105354:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbbfd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.105361:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbbfd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872960.105377:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b3b2e864 reply state 00000000a3be881a transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b800/0xe4e6e89fb01dbc04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.105386:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b800/0xe4e6e89fb01dbc04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.105393:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff98a9c5d04800) 00010000:00010000:2.0:1788872960.105395:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872960.105397:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788872960.105586:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+11:73595:x1875765311238528:12345-192.168.204.39@tcp:36:mkdir.0 Request processed in 15797us (16292us total) trans 124554051585 rc 0/0 00000100:00100000:2.0:1788872960.105596:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1463 00000100:00100000:3.0:1788872960.185778:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.185955:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311238656 00000100:00100000:0.0:1788872960.185966:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311238656 00000100:00100000:0.0:1788872960.186049:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1464 00000100:00100000:0.0:1788872960.186059:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:73598:x1875765311238656:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:0.0:1788872960.186084:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872960.186107:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbc12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb254 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.186177:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.186192:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.186203:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872960.186256:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788872960.186260:0:66192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788872960.186279:0:66192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.186335:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbc12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb254 expref: 13 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.186353:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb254 expref: 12 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.186362:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:0.0:1788872960.186365:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788872960.186368:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52ae800, rc 0) 00000100:00100000:0.0:1788872960.186422:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+12:73598:x1875765311238656:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 364us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872960.186429:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1464 00000100:00100000:0.0:1788872960.193269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.193410:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311238912 00000100:00100000:1.0:1788872960.193436:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311238912 00000100:00100000:1.0:1788872960.193500:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1465 00000100:00100000:1.0:1788872960.193510:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+12:73598:x1875765311238912:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:1.0:1788872960.193532:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872960.193535:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788872960.193589:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb254 expref: 12 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193609:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:1.0:1788872960.193614:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872960.193629:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc20 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb25b expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193775:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbc27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193788:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbc27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193798:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbc27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193808:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbc2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193825:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbc2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193832:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbc2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193905:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbc35 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193914:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbc35 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193921:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbc35 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872960.193931:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1788872960.193944:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbc35 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193950:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbc35 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193956:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbc35 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193961:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872960.193965:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbc35 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193972:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbc35 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.193979:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872960.193982:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872960.193985:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbc35 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194154:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbc35 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194172:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbc27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194178:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbc27 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194184:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbc27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194189:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872960.194193:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbc27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194199:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbc27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194208:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:1.0:1788872960.194210:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872960.194213:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbc27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194219:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbc27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194228:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbc2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194234:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbc2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194246:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbc2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194250:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872960.194253:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbc2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194259:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbc2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194266:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff98a9c5d04800) 00010000:00010000:1.0:1788872960.194268:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872960.194271:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbc2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194276:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbc2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194300:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc20 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb25b expref: 12 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194309:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:1.0:1788872960.194902:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872960.194909:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc20 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb25b expref: 12 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.194921:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa002a4000, rc 0) 00000100:00100000:1.0:1788872960.194987:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+11:73598:x1875765311238912:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 1478us (1727us total) trans 0 rc 301/301 00000100:00100000:1.0:1788872960.196446:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1465 00000100:00100000:2.0:1788872960.205960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.206107:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311239040 00000100:00100000:3.0:1788872960.206117:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311239040 00000100:00100000:3.0:1788872960.206173:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1466 00000100:00100000:3.0:1788872960.206183:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+11:73598:x1875765311239040:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:3.0:1788872960.206203:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872960.206225:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbc3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb262 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.206671:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dbc43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.206689:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dbc43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.206712:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dbc43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872960.206757:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788872960.206761:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788872960.206799:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dbc43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.212008:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbc3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb262 expref: 13 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.212044:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dbc43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb262 expref: 12 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.212053:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:3.0:1788872960.212056:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788872960.212059:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449b400, rc 0) 00000100:00100000:3.0:1788872960.212140:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+12:73598:x1875765311239040:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 5957us (6189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872960.212160:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1466 00000100:00100000:3.0:1788872960.241900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.241977:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311239296 00000100:00100000:0.0:1788872960.241988:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311239296 00000100:00100000:0.0:1788872960.242061:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1467 00000100:00100000:0.0:1788872960.242072:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+12:73598:x1875765311239296:12345-192.168.204.39@tcp:101:lfs.0 00010000:00010000:0.0:1788872960.242097:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872960.242126:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbc4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb269 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242211:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242226:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242253:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242266:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242273:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242279:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872960.242393:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1788872960.242491:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc51 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242500:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc51 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242506:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242512:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242517:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872960.242521:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242529:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc51 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242580:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:0.0:1788872960.242584:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872960.242589:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc51 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242596:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242613:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242619:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242624:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242629:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872960.242632:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242637:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242645:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff98a9c5d04800) 00010000:00010000:0.0:1788872960.242647:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872960.242650:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242655:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242708:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbc4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb269 expref: 14 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242719:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:0.0:1788872960.242722:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788872960.242726:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbc4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb269 expref: 14 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.242735:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af400, rc 0) 00000100:00100000:0.0:1788872960.242812:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+13:73598:x1875765311239296:12345-192.168.204.39@tcp:101:lfs.0 Request processed in 741us (923us total) trans 124554051586 rc 301/301 00000100:00100000:0.0:1788872960.242820:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1467 00000100:00100000:3.0:1788872960.262856:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.263077:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311239552 00000100:00100000:1.0:1788872960.263087:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311239552 00000100:00100000:1.0:1788872960.263153:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1468 00000100:00100000:1.0:1788872960.263164:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+13:73598:x1875765311239552:12345-192.168.204.39@tcp:36:lfs.0 00010000:00010000:1.0:1788872960.263247:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc66 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.263265:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc66 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.263278:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc66 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872960.263450:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a627df9 reply state 00000000e5d248ae transno 124554051587 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc66 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.263463:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc66 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.263470:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872960.263473:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1788872960.263486:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788872960.263495:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000100:00100000:1.0:1788872960.263604:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+15:73598:x1875765311239552:12345-192.168.204.39@tcp:36:lfs.0 Request processed in 441us (756us total) trans 124554051587 rc 0/0 00000100:00100000:1.0:1788872960.263612:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1468 00000100:00100000:3.0:1788872960.318850:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872960.319461:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311239808 00000100:00100000:2.0:1788872960.319472:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311239808 00000100:00100000:2.0:1788872960.319516:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 244 00000100:00100000:2.0:1788872960.319526:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+15:73598:x1875765311239808:12345-192.168.204.39@tcp:35:lfs.0 00000100:00100000:2.0:1788872960.319784:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+16:73598:x1875765311239808:12345-192.168.204.39@tcp:35:lfs.0 Request processed in 258us (943us total) trans 124554051588 rc 0/0 00000100:00100000:2.0:1788872960.319791:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 244 00010000:00010000:0.0:1788872960.338824:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872960.343717:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.344042:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311239936 00000100:00100000:1.0:1788872960.344053:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311239936 00000100:00100000:0.0:1788872960.344227:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1469 00000100:00100000:0.0:1788872960.344238:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+16:73602:x1875765311239936:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872960.344263:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872960.344284:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbc6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb270 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344351:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344365:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344376:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344399:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344407:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344414:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344502:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aec00/0xe4e6e89fb01dbc82 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344510:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aec00/0xe4e6e89fb01dbc82 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344525:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aec00/0xe4e6e89fb01dbc82 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872960.344578:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1788872960.344582:0:68674:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788872960.344617:0:68674:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aec00/0xe4e6e89fb01dbc82 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344631:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc74 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344638:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc74 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344645:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344662:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344668:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872960.344672:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344680:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc74 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344691:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:0.0:1788872960.344694:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872960.344708:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc74 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344714:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbc74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344727:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344733:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344738:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344742:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872960.344745:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344761:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344769:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff98a9c5d04800) 00010000:00010000:0.0:1788872960.344771:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872960.344774:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344779:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbc7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.344802:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbc6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb270 expref: 18 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.345125:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52aec00/0xe4e6e89fb01dbc82 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb270 expref: 17 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.345133:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872960.345136:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788872960.345138:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52aec00, rc 0) 00000100:00100000:0.0:1788872960.345205:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+17:73602:x1875765311239936:12345-192.168.204.39@tcp:101:touch.0 Request processed in 969us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872960.345213:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1469 00000100:00100000:3.0:1788872960.350143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.350226:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311240192 00000100:00100000:0.0:1788872960.350236:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311240192 00000100:00100000:0.0:1788872960.350301:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1470 00000100:00100000:0.0:1788872960.350311:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+17:73602:x1875765311240192:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872960.350349:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872960.350373:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dbc89 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb277 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.350502:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbc90 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.350528:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbc90 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.350540:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbc90 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.350573:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dbc97 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.350582:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dbc97 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.350589:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dbc97 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788872960.351006:0:66192:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x324:0x0], count =94 00000004:00080000:0.0:1788872960.351013:0:66192:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x324:0x0]+94 in llog 00000004:00080000:0.0:1788872960.351033:0:66192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x382:0x0], index 0: 0 00010000:00010000:0.0:1788872960.351348:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbc9e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351359:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbc9e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351367:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbc9e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351423:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbc90 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351431:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbc90 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351438:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbc90 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351445:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbc90 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351452:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52afa00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872960.351457:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbc90 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351795:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbc90 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351808:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872960.351875:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872960.351881:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbc90 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351888:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbc90 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872960.351902:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000018f4e0bb reply state 000000007a6ee5ee transno 124554051589 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dbc97 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351913:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dbc97 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351927:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff98a9e1f8fe00) 00010000:00010000:0.0:1788872960.351930:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872960.351932:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788872960.351967:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dbc89 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb277 expref: 20 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.351984:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbc9e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb277 expref: 19 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.352002:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:0.0:1788872960.352005:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872960.352007:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58aee00, rc 0) 00000100:00100000:0.0:1788872960.352080:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+20:73602:x1875765311240192:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1770us (1946us total) trans 124554051589 rc 0/0 00000100:00100000:0.0:1788872960.352088:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1470 00000100:00100000:0.0:1788872960.363979:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.364783:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311240448 00000100:00100000:1.0:1788872960.364794:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311240448 00000100:00100000:1.0:1788872960.364984:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1471 00000100:00100000:1.0:1788872960.364995:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+20:73602:x1875765311240448:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:1.0:1788872960.365050:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872960.365077:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbc9e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb277 expref: 20 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.365093:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:1.0:1788872960.365103:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872960.365157:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbcac lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.365170:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbcac lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.365180:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbcac lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872960.365296:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d748e257 reply state 00000000f5602e22 transno 124554051590 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbcac lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.365308:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbcac lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.365315:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff98a9f016a800) 00010000:00010000:1.0:1788872960.365318:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872960.365320:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872960.365427:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+21:73602:x1875765311240448:12345-192.168.204.39@tcp:36:touch.0 Request processed in 433us (1456us total) trans 124554051590 rc 0/0 00000100:00100000:1.0:1788872960.365435:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1471 00000100:00100000:1.0:1788872960.384289:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.385258:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311240576 00000100:00100000:3.0:1788872960.385270:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311240576 00000100:00100000:3.0:1788872960.385340:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1472 00000100:00100000:3.0:1788872960.385351:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+21:73602:x1875765311240576:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:3.0:1788872960.385375:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872960.385398:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449bc00/0xe4e6e89fb01dbcb3 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb27e expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.385490:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449bc00/0xe4e6e89fb01dbcb3 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb27e expref: 22 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.385506:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449bc00/0xe4e6e89fb01dbcb3 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb27e expref: 22 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.385526:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff98a9f016a800) 00010000:00010000:3.0:1788872960.385529:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788872960.385533:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449bc00, rc 0) 00000100:00100000:3.0:1788872960.385610:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+22:73602:x1875765311240576:12345-192.168.204.39@tcp:101:touch.0 Request processed in 261us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872960.385617:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1472 00000100:00100000:2.0:1788872960.389676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.391272:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311240704 00000100:00100000:0.0:1788872960.391286:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311240704 00000100:00100000:0.0:1788872960.391338:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6012 00000100:00100000:0.0:1788872960.391347:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875765311240704:12345-192.168.204.39@tcp:8:touch.0 00010000:00080000:0.0:1788872960.391382:0:8437:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp t0 exp 0000000000000000 cur 3897 last 0 00000020:00000080:0.0:1788872960.391424:0:8437:0:(genops.c:1406:class_connect()) connect: client 0804304d-5904-48ad-87f2-bcbc7642a62a, cookie 0xe4e6e89fb01dbcba 00002000:00100000:0.0:1788872960.391436:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0804304d-5904-48ad-87f2-bcbc7642a62a/ffff98a8c2794800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788872960.391454:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788872960.391516:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788872960.391581:0:8437:0:(import.c:65:import_set_state_nolock()) ffff98a9c5f16800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788872960.391656:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311240704:12345-192.168.204.39@tcp:8:touch.0 Request processed in 308us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872960.391663:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6012 00000100:00100000:2.0:1788872960.395676:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.396270:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311240832 00000100:00100000:3.0:1788872960.396282:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311240832 00000100:00100000:3.0:1788872960.396355:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6013 00000100:00100000:3.0:1788872960.396366:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+6:0:x1875765311240832:12345-192.168.204.39@tcp:2:touch.0 00000100:00080000:2.0:1788872960.397261:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788872960.400798:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969457 is committed 00000001:00100000:2.0:1788872960.400813:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000001:00100000:2.0:1788872960.400826:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0804304d-5904-48ad-87f2-bcbc7642a62a 00000020:00000080:2.0:1788872960.400830:0:8430:0:(genops.c:906:class_export_put()) final put ffff98a9e98d6000/0804304d-5904-48ad-87f2-bcbc7642a62a 00000100:00100000:2.0:1788872960.401022:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+5:0:x1875765311240832:12345-192.168.204.39@tcp:2:touch.0 Request processed in 4652us (5352us total) trans 4294969457 rc 0/0 00000100:00100000:2.0:1788872960.401033:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6013 00000020:00000080:1.0:1788872960.401164:0:82775:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e98d6000/0804304d-5904-48ad-87f2-bcbc7642a62a for lustre-OST0000 00000020:00000080:1.0:1788872960.401742:0:82775:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e98d5000 for lustre-OST0000 00000100:00100000:2.0:1788872960.431271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.431445:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311241088 00000100:00100000:3.0:1788872960.431456:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311241088 00000100:00100000:3.0:1788872960.431519:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 245 00000100:00100000:3.0:1788872960.431528:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfc00850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+22:73602:x1875765311241088:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872960.432441:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfc00850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+23:73602:x1875765311241088:12345-192.168.204.39@tcp:35:touch.0 Request processed in 910us (1178us total) trans 124554051591 rc 0/0 00000100:00100000:3.0:1788872960.432452:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 245 00000100:00100000:2.0:1788872960.465674:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.465760:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311241344 00000100:00100000:1.0:1788872960.465770:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311241344 00000100:00100000:1.0:1788872960.465828:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1473 00000100:00100000:1.0:1788872960.465839:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+23:73602:x1875765311241344:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:1.0:1788872960.465867:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872960.465890:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbcc1 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb285 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.466001:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbcc8 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.466015:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbcc8 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.466026:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbcc8 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.466041:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5a00/0xe4e6e89fb01dbccf lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.466048:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5a00/0xe4e6e89fb01dbccf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.466054:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5a00/0xe4e6e89fb01dbccf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788872960.466477:0:66192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x383:0x0], index 0: 0 00010000:00010000:1.0:1788872960.466970:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbcd6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.466990:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbcd6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.466999:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbcd6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.467031:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbcc8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.467038:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbcc8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.467050:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbcc8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.467057:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbcc8 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.467063:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872960.467067:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbcc8 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.467074:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbcc8 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.467085:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872960.467088:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872960.467093:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbcc8 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.467098:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbcc8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872960.467116:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000072bffe32 reply state 0000000072a80ddf transno 124554051592 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5a00/0xe4e6e89fb01dbccf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.467127:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5a00/0xe4e6e89fb01dbccf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.467134:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff98a9f016a500) 00010000:00010000:1.0:1788872960.467136:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872960.467139:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788872960.467169:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbcc1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb285 expref: 26 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.467182:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbcd6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb285 expref: 25 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.467190:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff98a9f016a300) 00010000:00010000:1.0:1788872960.467192:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872960.467195:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa002a4400, rc 0) 00000100:00100000:1.0:1788872960.467274:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+26:73602:x1875765311241344:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1436us (1607us total) trans 124554051592 rc 0/0 00000100:00100000:1.0:1788872960.467282:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1473 00000100:00100000:2.0:1788872960.487644:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.487716:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311241600 00000100:00100000:1.0:1788872960.487727:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311241600 00000100:00100000:1.0:1788872960.487788:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1474 00000100:00100000:1.0:1788872960.487798:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+26:73602:x1875765311241600:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:1.0:1788872960.487854:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872960.487879:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbcd6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb285 expref: 26 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.487902:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff98a9f016a300) 00010000:00010000:1.0:1788872960.487913:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872960.487964:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbce4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.487976:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbce4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.487986:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbce4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872960.488091:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000406a2dd7 reply state 00000000df9e66d3 transno 124554051593 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbce4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.488103:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbce4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.488109:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff98a9f016a700) 00010000:00010000:1.0:1788872960.488112:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872960.488115:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872960.488206:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+27:73602:x1875765311241600:12345-192.168.204.39@tcp:36:touch.0 Request processed in 409us (571us total) trans 124554051593 rc 0/0 00000100:00100000:1.0:1788872960.488213:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1474 00000100:00100000:3.0:1788872960.497796:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.497938:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311241728 00000100:00100000:0.0:1788872960.497948:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311241728 00000100:00100000:0.0:1788872960.497999:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1475 00000100:00100000:0.0:1788872960.498009:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+27:73602:x1875765311241728:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872960.498033:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872960.498055:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afe00/0xe4e6e89fb01dbceb lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb28c expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.498117:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afe00/0xe4e6e89fb01dbceb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb28c expref: 28 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.498130:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afe00/0xe4e6e89fb01dbceb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb28c expref: 28 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.498150:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff98a9f016a700) 00010000:00010000:0.0:1788872960.498153:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788872960.498156:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58afe00, rc 0) 00000100:00100000:0.0:1788872960.498220:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+28:73602:x1875765311241728:12345-192.168.204.39@tcp:101:touch.0 Request processed in 212us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872960.498227:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1475 00000100:00100000:3.0:1788872960.501320:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872960.505462:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311241856 00000100:00100000:2.0:1788872960.505479:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311241856 00000100:00100000:2.0:1788872960.505580:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6014 00000100:00100000:2.0:1788872960.505592:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2404:x1875765311241856:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:2.0:1788872960.505821:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2404:x1875765311241856:12345-192.168.204.39@tcp:2:touch.0 Request processed in 232us (4518us total) trans 4294969458 rc 0/0 00000100:00100000:2.0:1788872960.505829:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6014 00000100:00100000:3.0:1788872960.510903:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872960.510976:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311242112 00000100:00100000:2.0:1788872960.510986:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311242112 00000100:00100000:2.0:1788872960.511038:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 246 00000100:00100000:2.0:1788872960.511049:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+28:73602:x1875765311242112:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:2.0:1788872960.511678:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+29:73602:x1875765311242112:12345-192.168.204.39@tcp:35:touch.0 Request processed in 629us (781us total) trans 124554051594 rc 0/0 00000100:00100000:2.0:1788872960.511687:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 246 00000100:00100000:2.0:1788872960.516326:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.516455:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311242368 00000100:00100000:3.0:1788872960.516465:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311242368 00000100:00100000:3.0:1788872960.516536:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1476 00000100:00100000:3.0:1788872960.516763:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+29:73602:x1875765311242368:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:3.0:1788872960.516791:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872960.516822:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbcf2 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb293 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.516932:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbcf9 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.516948:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbcf9 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.516960:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbcf9 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.516974:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a200/0xe4e6e89fb01dbd00 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.516981:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a200/0xe4e6e89fb01dbd00 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.516988:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a200/0xe4e6e89fb01dbd00 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788872960.517327:0:66193:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x384:0x0], index 0: 0 00010000:00010000:3.0:1788872960.517461:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a000/0xe4e6e89fb01dbd07 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517500:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a000/0xe4e6e89fb01dbd07 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517509:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a000/0xe4e6e89fb01dbd07 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517576:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbcf9 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517583:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbcf9 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517589:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbcf9 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517595:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbcf9 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517601:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449a800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872960.517605:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbcf9 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517612:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbcf9 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517623:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:3.0:1788872960.517626:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872960.517630:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbcf9 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517636:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbcf9 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872960.517659:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a17e5d7 reply state 00000000dc97a679 transno 124554051595 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a200/0xe4e6e89fb01dbd00 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517671:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a200/0xe4e6e89fb01dbd00 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517677:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff98a9c5d04a00) 00010000:00010000:3.0:1788872960.517679:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872960.517682:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788872960.517723:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbcf2 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb293 expref: 32 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517739:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a000/0xe4e6e89fb01dbd07 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb293 expref: 31 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.517746:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff98a9c5d04700) 00010000:00010000:3.0:1788872960.517748:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788872960.517751:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449a000, rc 0) 00000100:00100000:3.0:1788872960.517812:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+32:73602:x1875765311242368:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1054us (1504us total) trans 124554051595 rc 0/0 00000100:00100000:3.0:1788872960.520060:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1476 00000100:00100000:2.0:1788872960.523421:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.523991:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311242624 00000100:00100000:1.0:1788872960.524002:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311242624 00000100:00100000:1.0:1788872960.524071:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1477 00000100:00100000:1.0:1788872960.524082:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+32:73602:x1875765311242624:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:1.0:1788872960.524152:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872960.524193:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a000/0xe4e6e89fb01dbd07 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb293 expref: 32 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.524212:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff98a9c5d04700) 00010000:00010000:1.0:1788872960.524222:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872960.524271:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbd15 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.524285:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbd15 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.524294:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbd15 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872960.524782:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004ef8caed reply state 00000000f66232f5 transno 124554051596 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbd15 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.524796:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbd15 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.524802:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff98a9f016a300) 00010000:00010000:1.0:1788872960.524805:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872960.524866:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872960.524967:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+33:73602:x1875765311242624:12345-192.168.204.39@tcp:36:touch.0 Request processed in 887us (1563us total) trans 124554051596 rc 0/0 00000100:00100000:1.0:1788872960.524975:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1477 00000100:00100000:2.0:1788872960.531465:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.531727:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311242752 00000100:00100000:0.0:1788872960.531738:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311242752 00000100:00100000:0.0:1788872960.531803:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1478 00000100:00100000:0.0:1788872960.531823:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+33:73602:x1875765311242752:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872960.531864:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872960.531887:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01dbd1c lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb29a expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.531950:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01dbd1c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb29a expref: 34 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.531965:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af000/0xe4e6e89fb01dbd1c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb29a expref: 34 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.531983:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff98a9f016a300) 00010000:00010000:0.0:1788872960.531986:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788872960.531991:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58af000, rc 0) 00000100:00100000:0.0:1788872960.532065:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+34:73602:x1875765311242752:12345-192.168.204.39@tcp:101:touch.0 Request processed in 245us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872960.532073:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1478 00000100:00100000:2.0:1788872960.541727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.542082:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311242880 00000100:00100000:0.0:1788872960.542092:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311242880 00000100:00100000:0.0:1788872960.542156:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6015 00000100:00100000:0.0:1788872960.542166:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2405:x1875765311242880:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:0.0:1788872960.542789:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311242880:12345-192.168.204.39@tcp:2:touch.0 Request processed in 623us (1070us total) trans 4294969459 rc 0/0 00000100:00100000:0.0:1788872960.542798:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6015 00000100:00100000:2.0:1788872960.545342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.545626:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311243136 00000100:00100000:3.0:1788872960.545636:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311243136 00000100:00100000:3.0:1788872960.545681:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 247 00000100:00100000:3.0:1788872960.545690:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+34:73602:x1875765311243136:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872960.545956:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+35:73602:x1875765311243136:12345-192.168.204.39@tcp:35:touch.0 Request processed in 266us (621us total) trans 124554051597 rc 0/0 00000100:00100000:3.0:1788872960.545980:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 247 00000100:00100000:2.0:1788872960.549207:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.549442:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311243392 00000100:00100000:1.0:1788872960.549452:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311243392 00000100:00100000:1.0:1788872960.549517:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1479 00000100:00100000:1.0:1788872960.549527:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+35:73602:x1875765311243392:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:1.0:1788872960.549751:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872960.549772:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd23 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2a1 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.549880:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd2a lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.549896:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd2a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.549906:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd2a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.549919:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4200/0xe4e6e89fb01dbd31 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.549925:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4200/0xe4e6e89fb01dbd31 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.549930:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4200/0xe4e6e89fb01dbd31 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788872960.550280:0:66192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x385:0x0], index 0: 0 00010000:00010000:0.0:1788872960.553058:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbd38 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553080:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbd38 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553105:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbd38 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553159:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd2a lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553167:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd2a lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553173:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd2a lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553188:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd2a lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553194:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872960.553198:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd2a lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553205:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd2a lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553218:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872960.553221:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872960.553226:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd2a lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553232:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd2a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872960.553248:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000141fe328 reply state 00000000929d83df transno 124554051598 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4200/0xe4e6e89fb01dbd31 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553266:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4200/0xe4e6e89fb01dbd31 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553273:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff98a9f016a600) 00010000:00010000:0.0:1788872960.553275:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872960.553279:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788872960.553331:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd23 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2a1 expref: 38 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553347:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbd38 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2a1 expref: 37 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.553355:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff98a9e1f8f100) 00010000:00010000:0.0:1788872960.553357:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872960.553360:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58af600, rc 0) 00000100:00100000:0.0:1788872960.553451:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+38:73602:x1875765311243392:12345-192.168.204.39@tcp:101:touch.0 Request processed in 3925us (4257us total) trans 124554051598 rc 0/0 00000100:00100000:0.0:1788872960.553460:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1479 00000100:00100000:0.0:1788872960.558132:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872960.558233:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311243648 00000100:00100000:2.0:1788872960.558243:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311243648 00000100:00100000:2.0:1788872960.558317:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1480 00000100:00100000:2.0:1788872960.558328:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+38:73602:x1875765311243648:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:2.0:1788872960.558386:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872960.558415:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbd38 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2a1 expref: 38 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.558444:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff98a9e1f8f100) 00010000:00010000:2.0:1788872960.558454:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872960.558523:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ba00/0xe4e6e89fb01dbd46 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.558536:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ba00/0xe4e6e89fb01dbd46 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.558753:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ba00/0xe4e6e89fb01dbd46 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872960.558924:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad76dbbf reply state 0000000073b17044 transno 124554051599 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ba00/0xe4e6e89fb01dbd46 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.558937:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ba00/0xe4e6e89fb01dbd46 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.558943:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff98a9c1358200) 00010000:00010000:2.0:1788872960.558958:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872960.558961:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872960.559060:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+39:73602:x1875765311243648:12345-192.168.204.39@tcp:36:touch.0 Request processed in 733us (938us total) trans 124554051599 rc 0/0 00000100:00100000:2.0:1788872960.559068:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1480 00000100:00100000:2.0:1788872960.562816:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.562939:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311243776 00000100:00100000:0.0:1788872960.562949:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311243776 00000100:00100000:0.0:1788872960.563010:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1481 00000100:00100000:0.0:1788872960.563020:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+39:73602:x1875765311243776:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872960.563045:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872960.563067:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01dbd4d lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2a8 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.563156:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01dbd4d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2a8 expref: 40 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.563172:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae200/0xe4e6e89fb01dbd4d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2a8 expref: 40 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.563199:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff98a9c1358200) 00010000:00010000:0.0:1788872960.563203:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788872960.563206:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58ae200, rc 0) 00000100:00100000:0.0:1788872960.563265:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+40:73602:x1875765311243776:12345-192.168.204.39@tcp:101:touch.0 Request processed in 246us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872960.563272:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1481 00000100:00100000:2.0:1788872960.567112:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.567237:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311243904 00000100:00100000:0.0:1788872960.567247:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311243904 00000100:00100000:0.0:1788872960.567300:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6016 00000100:00100000:0.0:1788872960.567317:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311243904:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:0.0:1788872960.567537:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2405:x1875765311243904:12345-192.168.204.39@tcp:2:touch.0 Request processed in 220us (433us total) trans 4294969460 rc 0/0 00000100:00100000:0.0:1788872960.567572:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6016 00000100:00100000:2.0:1788872960.571226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.571300:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311244160 00000100:00100000:3.0:1788872960.571319:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311244160 00000100:00100000:3.0:1788872960.571376:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 248 00000100:00100000:3.0:1788872960.571386:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+40:73602:x1875765311244160:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872960.571767:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+41:73602:x1875765311244160:12345-192.168.204.39@tcp:35:touch.0 Request processed in 381us (550us total) trans 124554051600 rc 0/0 00000100:00100000:3.0:1788872960.571776:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 248 00000100:00100000:2.0:1788872960.580104:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.580294:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311244416 00000100:00100000:0.0:1788872960.580304:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311244416 00000100:00100000:0.0:1788872960.580369:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1482 00000100:00100000:0.0:1788872960.580381:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+41:73602:x1875765311244416:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872960.580406:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872960.580428:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbd54 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2af expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.580619:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbd5b lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.580636:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbd5b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.580649:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbd5b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.580664:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dbd62 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.580672:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dbd62 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.580679:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dbd62 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788872960.581254:0:66193:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x386:0x0], index 0: 0 00010000:00010000:1.0:1788872960.581396:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbd69 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581407:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbd69 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581416:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbd69 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581461:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbd5b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581467:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbd5b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581473:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbd5b lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581479:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbd5b lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581485:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872960.581489:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbd5b lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581496:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbd5b lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581509:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872960.581512:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872960.581517:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbd5b lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581523:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbd5b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872960.581537:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf7013be reply state 0000000004042f63 transno 124554051601 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dbd62 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581602:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dbd62 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581615:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff98a9e1f8f800) 00010000:00010000:1.0:1788872960.581617:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872960.581620:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788872960.581652:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbd54 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2af expref: 44 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581666:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbd69 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2af expref: 43 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.581673:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff98a9f016aa00) 00010000:00010000:1.0:1788872960.581675:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872960.581677:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa002a4a00, rc 0) 00000100:00100000:1.0:1788872960.581747:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+44:73602:x1875765311244416:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1369us (1653us total) trans 124554051601 rc 0/0 00000100:00100000:1.0:1788872960.581754:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1482 00000100:00100000:2.0:1788872960.588190:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.588421:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311244672 00000100:00100000:0.0:1788872960.588432:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311244672 00000100:00100000:0.0:1788872960.588498:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1483 00000100:00100000:0.0:1788872960.588508:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+44:73602:x1875765311244672:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:0.0:1788872960.588599:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872960.588627:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbd69 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2af expref: 44 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.588647:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff98a9f016aa00) 00010000:00010000:0.0:1788872960.588658:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872960.588738:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dbd77 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.588751:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dbd77 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.588761:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dbd77 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872960.588876:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087a46ab1 reply state 000000007ccfb405 transno 124554051602 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dbd77 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.588889:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dbd77 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.588895:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff98a9e1f8f400) 00010000:00010000:0.0:1788872960.588898:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872960.588900:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788872960.588982:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+45:73602:x1875765311244672:12345-192.168.204.39@tcp:36:touch.0 Request processed in 475us (810us total) trans 124554051602 rc 0/0 00000100:00100000:0.0:1788872960.588990:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1483 00000100:00100000:0.0:1788872960.593856:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.593972:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311244800 00000100:00100000:3.0:1788872960.593982:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311244800 00000100:00100000:3.0:1788872960.594040:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1484 00000100:00100000:3.0:1788872960.594049:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+45:73602:x1875765311244800:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:3.0:1788872960.594073:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872960.594092:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbd7e lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2b6 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.594153:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbd7e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2b6 expref: 46 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.594166:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449ac00/0xe4e6e89fb01dbd7e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2b6 expref: 46 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.594188:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff98a9e1f8f400) 00010000:00010000:3.0:1788872960.594191:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788872960.594194:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449ac00, rc 0) 00000100:00100000:3.0:1788872960.594247:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+46:73602:x1875765311244800:12345-192.168.204.39@tcp:101:touch.0 Request processed in 199us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872960.594266:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1484 00000100:00100000:2.0:1788872960.597610:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.598396:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311244928 00000100:00100000:1.0:1788872960.598416:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311244928 00000100:00100000:1.0:1788872960.598483:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6017 00000100:00100000:1.0:1788872960.598494:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2404:x1875765311244928:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:1.0:1788872960.599063:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2404:x1875765311244928:12345-192.168.204.39@tcp:2:touch.0 Request processed in 568us (1461us total) trans 4294969461 rc 0/0 00000100:00100000:1.0:1788872960.599071:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6017 00000100:00100000:2.0:1788872960.605993:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.606090:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311245184 00000100:00100000:3.0:1788872960.606101:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311245184 00000100:00100000:3.0:1788872960.606159:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 249 00000100:00100000:3.0:1788872960.606169:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+46:73602:x1875765311245184:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872960.606919:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+47:73602:x1875765311245184:12345-192.168.204.39@tcp:35:touch.0 Request processed in 747us (933us total) trans 124554051603 rc 0/0 00000100:00100000:3.0:1788872960.606928:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 249 00000100:00100000:0.0:1788872960.610148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.610359:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311245440 00000100:00100000:1.0:1788872960.611704:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311245440 00000100:00100000:1.0:1788872960.611885:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1485 00000100:00100000:1.0:1788872960.611898:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+47:73602:x1875765311245440:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:1.0:1788872960.611938:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872960.611962:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbd85 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2bd expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.612085:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd8c lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.612103:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd8c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.612115:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd8c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.612130:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd93 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.612137:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd93 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.612145:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd93 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788872960.612771:0:66193:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x387:0x0], index 0: 0 00010000:00010000:1.0:1788872960.613176:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbd9a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613253:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbd9a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613262:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbd9a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613381:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd8c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613390:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd8c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613396:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd8c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613404:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd8c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613520:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872960.613525:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd8c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613533:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd8c lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613633:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872960.613637:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872960.613641:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd8c lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613648:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbd8c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872960.613665:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d048f77 reply state 00000000edf65134 transno 124554051604 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd93 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613675:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd93 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613699:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff98a9f016af00) 00010000:00010000:1.0:1788872960.613702:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872960.613705:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788872960.613744:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbd85 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2bd expref: 50 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613758:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbd9a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2bd expref: 49 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.613765:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff98a9f016a000) 00010000:00010000:1.0:1788872960.613768:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872960.613770:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa002a5800, rc 0) 00000100:00100000:1.0:1788872960.614103:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+50:73602:x1875765311245440:12345-192.168.204.39@tcp:101:touch.0 Request processed in 2206us (3961us total) trans 124554051604 rc 0/0 00000100:00100000:1.0:1788872960.614113:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1485 00000100:00100000:0.0:1788872960.618388:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.618497:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311245696 00000100:00100000:1.0:1788872960.618507:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311245696 00000100:00100000:1.0:1788872960.618612:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1486 00000100:00100000:1.0:1788872960.618623:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+50:73602:x1875765311245696:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:1.0:1788872960.618702:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872960.618731:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbd9a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2bd expref: 50 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.618764:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff98a9f016a000) 00010000:00010000:1.0:1788872960.618776:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872960.618843:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbda8 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.618869:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbda8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.618880:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbda8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872960.619178:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f669bf35 reply state 000000007575fdff transno 124554051605 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbda8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.619191:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbda8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.619198:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff98a9f016ad00) 00010000:00010000:1.0:1788872960.619201:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872960.619204:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872960.619299:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+51:73602:x1875765311245696:12345-192.168.204.39@tcp:36:touch.0 Request processed in 677us (920us total) trans 124554051605 rc 0/0 00000100:00100000:1.0:1788872960.619306:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1486 00000100:00100000:2.0:1788872960.622232:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.622400:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311245824 00000100:00100000:3.0:1788872960.622422:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311245824 00000100:00100000:3.0:1788872960.622491:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1487 00000100:00100000:3.0:1788872960.622501:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+51:73602:x1875765311245824:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:3.0:1788872960.622524:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872960.622587:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbdaf lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2c4 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.622652:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbdaf lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2c4 expref: 52 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.622666:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a800/0xe4e6e89fb01dbdaf lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2c4 expref: 52 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.622685:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff98a9f016ad00) 00010000:00010000:3.0:1788872960.622688:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788872960.622701:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449a800, rc 0) 00000100:00100000:3.0:1788872960.622750:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+52:73602:x1875765311245824:12345-192.168.204.39@tcp:101:touch.0 Request processed in 251us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872960.622769:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1487 00000100:00100000:2.0:1788872960.627119:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.627209:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311245952 00000100:00100000:1.0:1788872960.627220:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311245952 00000100:00100000:1.0:1788872960.627281:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6018 00000100:00100000:1.0:1788872960.627292:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2405:x1875765311245952:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:1.0:1788872960.627523:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2405:x1875765311245952:12345-192.168.204.39@tcp:2:touch.0 Request processed in 233us (418us total) trans 4294969462 rc 0/0 00000100:00100000:1.0:1788872960.627532:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6018 00000100:00100000:2.0:1788872960.631150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.631241:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311246208 00000100:00100000:1.0:1788872960.631250:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311246208 00000100:00100000:1.0:1788872960.631300:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 250 00000100:00100000:1.0:1788872960.631327:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+52:73602:x1875765311246208:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:1.0:1788872960.631659:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+53:73602:x1875765311246208:12345-192.168.204.39@tcp:35:touch.0 Request processed in 333us (529us total) trans 124554051606 rc 0/0 00000100:00100000:1.0:1788872960.631667:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 250 00000100:00100000:3.0:1788872960.635472:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872960.635645:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311246464 00000100:00100000:2.0:1788872960.635655:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311246464 00000100:00100000:2.0:1788872960.635720:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1488 00000100:00100000:2.0:1788872960.635730:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+53:73602:x1875765311246464:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:2.0:1788872960.635754:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872960.635776:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdb6 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2cb expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.635894:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbdbd lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.635910:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbdbd lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.635941:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbdbd lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.635959:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1b800/0xe4e6e89fb01dbdc4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.635967:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1b800/0xe4e6e89fb01dbdc4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.635974:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1b800/0xe4e6e89fb01dbdc4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788872960.636260:0:66192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x388:0x0], index 0: 0 00010000:00010000:2.0:1788872960.636378:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdcb lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636386:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdcb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636394:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdcb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636439:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbdbd lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636447:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbdbd lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636454:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbdbd lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636461:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbdbd lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636473:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1aa00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872960.636477:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbdbd lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636484:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbdbd lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636495:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872960.636498:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872960.636502:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbdbd lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636509:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbdbd lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872960.636522:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da567fa5 reply state 0000000061601d84 transno 124554051607 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1b800/0xe4e6e89fb01dbdc4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636532:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1b800/0xe4e6e89fb01dbdc4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636538:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff98a9c1358000) 00010000:00010000:2.0:1788872960.636541:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872960.636543:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788872960.636653:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdb6 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2cb expref: 56 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636668:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdcb lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2cb expref: 55 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.636687:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff98a9c1358d00) 00010000:00010000:2.0:1788872960.636699:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872960.636702:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9caa1a000, rc 0) 00000100:00100000:2.0:1788872960.636760:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+56:73602:x1875765311246464:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1031us (1299us total) trans 124554051607 rc 0/0 00000100:00100000:2.0:1788872960.636767:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1488 00000100:00100000:2.0:1788872960.649149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.649347:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311246720 00000100:00100000:1.0:1788872960.649357:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311246720 00000100:00100000:1.0:1788872960.649424:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1489 00000100:00100000:1.0:1788872960.649434:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+56:73602:x1875765311246720:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:1.0:1788872960.649502:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872960.649533:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdcb lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2cb expref: 56 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.649605:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff98a9c1358d00) 00010000:00010000:1.0:1788872960.649617:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872960.649678:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbdd9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.649702:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbdd9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.649712:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbdd9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872960.649847:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000dd3929f reply state 0000000081e330c1 transno 124554051608 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbdd9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.649861:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbdd9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.649887:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff98a9f016a000) 00010000:00010000:1.0:1788872960.649890:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872960.649893:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872960.649992:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+57:73602:x1875765311246720:12345-192.168.204.39@tcp:36:touch.0 Request processed in 560us (862us total) trans 124554051608 rc 0/0 00000100:00100000:1.0:1788872960.650000:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1489 00000100:00100000:0.0:1788872960.664468:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.664613:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311246848 00000100:00100000:3.0:1788872960.664623:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311246848 00000100:00100000:3.0:1788872960.664682:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1490 00000100:00100000:3.0:1788872960.664703:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+57:73602:x1875765311246848:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:3.0:1788872960.664729:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872960.664753:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a400/0xe4e6e89fb01dbde0 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2d2 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.664823:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a400/0xe4e6e89fb01dbde0 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2d2 expref: 58 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.664838:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a400/0xe4e6e89fb01dbde0 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2d2 expref: 58 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.664856:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff98a9f016a000) 00010000:00010000:3.0:1788872960.664858:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788872960.664862:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449a400, rc 0) 00000100:00100000:3.0:1788872960.664929:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+58:73602:x1875765311246848:12345-192.168.204.39@tcp:101:touch.0 Request processed in 238us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872960.664937:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1490 00000100:00100000:3.0:1788872960.673862:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.674014:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311246976 00000100:00100000:1.0:1788872960.674025:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311246976 00000100:00100000:1.0:1788872960.674089:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6019 00000100:00100000:1.0:1788872960.674100:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2404:x1875765311246976:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:1.0:1788872960.674337:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2404:x1875765311246976:12345-192.168.204.39@tcp:2:touch.0 Request processed in 239us (484us total) trans 4294969463 rc 0/0 00000100:00100000:1.0:1788872960.674344:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6019 00000100:00100000:2.0:1788872960.694174:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.694321:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311247232 00000100:00100000:3.0:1788872960.694331:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311247232 00000100:00100000:3.0:1788872960.694386:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 251 00000100:00100000:3.0:1788872960.694396:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfc01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+58:73602:x1875765311247232:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872960.694751:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfc01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+59:73602:x1875765311247232:12345-192.168.204.39@tcp:35:touch.0 Request processed in 355us (586us total) trans 124554051609 rc 0/0 00000100:00100000:3.0:1788872960.694760:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 251 00000100:00100000:0.0:1788872960.701626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872960.701837:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311247488 00000100:00100000:2.0:1788872960.701848:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311247488 00000100:00100000:2.0:1788872960.701906:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1491 00000100:00100000:2.0:1788872960.701916:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+59:73602:x1875765311247488:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:2.0:1788872960.701940:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872960.701963:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbde7 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2d9 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702067:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdee lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702082:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdee lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702092:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdee lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702105:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdf5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702129:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdf5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702136:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdf5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788872960.702674:0:66192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x389:0x0], index 0: 0 00010000:00010000:2.0:1788872960.702827:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbdfc lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702837:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbdfc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702845:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbdfc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702874:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdee lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702882:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdee lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702888:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdee lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702895:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdee lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702900:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1be00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872960.702905:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdee lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702921:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdee lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702935:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872960.702937:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872960.702942:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdee lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702948:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbdee lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872960.702961:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a482c4f0 reply state 000000004b623a58 transno 124554051610 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdf5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702970:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdf5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.702976:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff98a9c1358400) 00010000:00010000:2.0:1788872960.702978:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872960.702980:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788872960.703012:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbde7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2d9 expref: 62 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.703025:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbdfc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2d9 expref: 61 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.703032:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff98a9c1358700) 00010000:00010000:2.0:1788872960.703034:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872960.703037:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899c00, rc 0) 00000100:00100000:2.0:1788872960.703102:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+62:73602:x1875765311247488:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1188us (1486us total) trans 124554051610 rc 0/0 00000100:00100000:2.0:1788872960.703110:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1491 00000100:00100000:2.0:1788872960.708112:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.708184:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311247744 00000100:00100000:1.0:1788872960.708195:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311247744 00000100:00100000:1.0:1788872960.708242:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1492 00000100:00100000:1.0:1788872960.708251:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+62:73602:x1875765311247744:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:1.0:1788872960.708316:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872960.708342:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbdfc lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2d9 expref: 62 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.708359:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff98a9c1358700) 00010000:00010000:1.0:1788872960.708370:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872960.708429:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbe0a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.708459:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbe0a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.708479:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbe0a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872960.708643:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e9bcc9f reply state 000000007a7be946 transno 124554051611 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbe0a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.708656:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbe0a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.708662:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff98a9f016ab00) 00010000:00010000:1.0:1788872960.708665:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872960.708667:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872960.708770:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+63:73602:x1875765311247744:12345-192.168.204.39@tcp:36:touch.0 Request processed in 518us (666us total) trans 124554051611 rc 0/0 00000100:00100000:1.0:1788872960.708778:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1492 00000100:00100000:0.0:1788872960.714183:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.714605:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311247872 00000100:00100000:3.0:1788872960.714616:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311247872 00000100:00100000:3.0:1788872960.714678:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1493 00000100:00100000:3.0:1788872960.714699:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+63:73602:x1875765311247872:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:3.0:1788872960.714725:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872960.714748:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b200/0xe4e6e89fb01dbe11 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2e0 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.714828:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b200/0xe4e6e89fb01dbe11 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2e0 expref: 64 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.714844:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b200/0xe4e6e89fb01dbe11 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2e0 expref: 64 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.714863:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff98a9f016ab00) 00010000:00010000:3.0:1788872960.714867:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788872960.714872:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449b200, rc 0) 00000100:00100000:3.0:1788872960.714934:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+64:73602:x1875765311247872:12345-192.168.204.39@tcp:101:touch.0 Request processed in 247us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872960.714941:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1493 00000100:00100000:2.0:1788872960.718246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.718383:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311248000 00000100:00100000:1.0:1788872960.718393:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311248000 00000100:00100000:1.0:1788872960.718462:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6020 00000100:00100000:1.0:1788872960.718472:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2405:x1875765311248000:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:1.0:1788872960.718722:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+12:2405:x1875765311248000:12345-192.168.204.39@tcp:2:touch.0 Request processed in 251us (482us total) trans 4294969464 rc 0/0 00000100:00100000:1.0:1788872960.718731:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6020 00000100:00100000:2.0:1788872960.723980:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.724111:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311248256 00000100:00100000:3.0:1788872960.724122:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311248256 00000100:00100000:3.0:1788872960.724181:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 252 00000100:00100000:3.0:1788872960.724192:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+64:73602:x1875765311248256:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872960.724606:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+65:73602:x1875765311248256:12345-192.168.204.39@tcp:35:touch.0 Request processed in 415us (634us total) trans 124554051612 rc 0/0 00000100:00100000:3.0:1788872960.724615:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 252 00000100:00100000:2.0:1788872960.730755:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.731472:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311248512 00000100:00100000:1.0:1788872960.731485:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311248512 00000100:00100000:1.0:1788872960.731637:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1494 00000100:00100000:1.0:1788872960.731663:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+65:73602:x1875765311248512:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:1.0:1788872960.731697:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872960.731720:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbe18 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2e7 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.731854:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dbe1f lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.731869:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dbe1f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.731881:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dbe1f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.731906:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9da00/0xe4e6e89fb01dbe26 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.731913:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9da00/0xe4e6e89fb01dbe26 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.731920:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9da00/0xe4e6e89fb01dbe26 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788872960.733802:0:66193:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38a:0x0], index 0: 0 00010000:00010000:1.0:1788872960.735033:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dbe2d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735052:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dbe2d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735064:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dbe2d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735118:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dbe1f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735126:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dbe1f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735536:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dbe1f lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735546:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dbe1f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735587:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9dc00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872960.735592:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dbe1f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735600:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dbe1f lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735613:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872960.735616:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872960.735620:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dbe1f lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735627:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dbe1f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872960.735642:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d50e3d11 reply state 000000009b032abf transno 124554051613 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9da00/0xe4e6e89fb01dbe26 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735653:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9da00/0xe4e6e89fb01dbe26 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735668:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff98a9f016ac00) 00010000:00010000:1.0:1788872960.735670:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872960.735673:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788872960.735725:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dbe18 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2e7 expref: 68 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735741:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dbe2d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2e7 expref: 67 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.735749:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff98a9f016ae00) 00010000:00010000:1.0:1788872960.735751:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872960.735754:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9c400, rc 0) 00000100:00100000:1.0:1788872960.736600:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+68:73602:x1875765311248512:12345-192.168.204.39@tcp:101:touch.0 Request processed in 4882us (5796us total) trans 124554051613 rc 0/0 00000100:00100000:1.0:1788872960.736614:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1494 00000100:00100000:0.0:1788872960.740477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.740754:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311248768 00000100:00100000:1.0:1788872960.740766:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311248768 00000100:00100000:1.0:1788872960.740821:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1495 00000100:00100000:1.0:1788872960.740831:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+68:73602:x1875765311248768:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:1.0:1788872960.740926:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872960.740953:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dbe2d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2e7 expref: 68 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.740972:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff98a9f016ae00) 00010000:00010000:1.0:1788872960.740983:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872960.741034:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dbe3b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.741055:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dbe3b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.741065:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dbe3b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872960.741629:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005addfe5 reply state 000000000b9f499d transno 124554051614 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dbe3b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.741645:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dbe3b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.741652:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff98a9f016aa00) 00010000:00010000:1.0:1788872960.741655:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872960.741658:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872960.741770:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+69:73602:x1875765311248768:12345-192.168.204.39@tcp:36:touch.0 Request processed in 938us (1302us total) trans 124554051614 rc 0/0 00000100:00100000:1.0:1788872960.741779:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1495 00000100:00100000:2.0:1788872960.745515:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.745709:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311248896 00000100:00100000:3.0:1788872960.745719:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311248896 00000100:00100000:3.0:1788872960.745776:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1496 00000100:00100000:3.0:1788872960.745785:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+69:73602:x1875765311248896:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:3.0:1788872960.745820:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872960.745844:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a600/0xe4e6e89fb01dbe42 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2ee expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.745900:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a600/0xe4e6e89fb01dbe42 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2ee expref: 70 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.745914:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a600/0xe4e6e89fb01dbe42 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2ee expref: 70 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.745930:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff98a9f016aa00) 00010000:00010000:3.0:1788872960.745934:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788872960.745937:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449a600, rc 0) 00000100:00100000:3.0:1788872960.746292:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+70:73602:x1875765311248896:12345-192.168.204.39@tcp:101:touch.0 Request processed in 506us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872960.746767:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1496 00000100:00100000:2.0:1788872960.749881:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.750212:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311249024 00000100:00100000:0.0:1788872960.750222:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311249024 00000100:00100000:0.0:1788872960.750273:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6021 00000100:00100000:0.0:1788872960.750297:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0804304d-5904-48ad-87f2-bcbc7642a62a+12:2406:x1875765311249024:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:0.0:1788872960.750523:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0804304d-5904-48ad-87f2-bcbc7642a62a+13:2406:x1875765311249024:12345-192.168.204.39@tcp:2:touch.0 Request processed in 228us (650us total) trans 4294969465 rc 0/0 00000100:00100000:0.0:1788872960.750531:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6021 00000100:00100000:0.0:1788872960.767391:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872960.767813:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311249280 00000100:00100000:1.0:1788872960.767823:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311249280 00000100:00100000:1.0:1788872960.767875:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 253 00000100:00100000:1.0:1788872960.767884:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+70:73602:x1875765311249280:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:1.0:1788872960.768166:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+71:73602:x1875765311249280:12345-192.168.204.39@tcp:35:touch.0 Request processed in 282us (785us total) trans 124554051615 rc 0/0 00000100:00100000:1.0:1788872960.768183:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 253 00000100:00100000:3.0:1788872960.775142:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872960.775310:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311249536 00000100:00100000:2.0:1788872960.775321:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311249536 00000100:00100000:2.0:1788872960.775387:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1497 00000100:00100000:2.0:1788872960.775397:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+71:73602:x1875765311249536:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:2.0:1788872960.775422:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872960.775443:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbe49 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2f5 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.775722:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbe50 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.775739:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbe50 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.775749:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbe50 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.775764:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dbe57 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.775770:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dbe57 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.775796:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dbe57 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788872960.781425:0:66192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38b:0x0], index 0: 0 00010000:00010000:2.0:1788872960.781679:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbe5e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781706:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbe5e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781717:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbe5e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781755:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbe50 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781762:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbe50 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781767:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbe50 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781774:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbe50 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781780:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872960.781784:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbe50 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781792:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbe50 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781829:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872960.781831:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872960.781836:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbe50 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781843:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbe50 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872960.781857:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c024dbb3 reply state 000000005ee7cd47 transno 124554051616 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dbe57 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781866:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dbe57 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781872:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff98a9c1358700) 00010000:00010000:2.0:1788872960.781874:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872960.781877:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788872960.781916:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbe49 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2f5 expref: 74 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781931:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbe5e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2f5 expref: 73 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.781939:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff98a9c1358d00) 00010000:00010000:2.0:1788872960.781941:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872960.781943:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899400, rc 0) 00000100:00100000:2.0:1788872960.782047:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+74:73602:x1875765311249536:12345-192.168.204.39@tcp:101:touch.0 Request processed in 6651us (6914us total) trans 124554051616 rc 0/0 00000100:00100000:2.0:1788872960.782056:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1497 00000100:00100000:2.0:1788872960.796058:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.796193:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311249792 00000100:00100000:0.0:1788872960.796202:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311249792 00000100:00100000:0.0:1788872960.796263:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1498 00000100:00100000:0.0:1788872960.796273:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+74:73602:x1875765311249792:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:0.0:1788872960.796343:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872960.796369:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbe5e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2f5 expref: 74 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.796388:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff98a9c1358d00) 00010000:00010000:0.0:1788872960.796398:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872960.796458:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbe6c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.796471:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbe6c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.796493:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbe6c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872960.796651:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052231b42 reply state 00000000c236a5e5 transno 124554051617 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbe6c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.796663:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbe6c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.796683:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff98a9e1f8fb00) 00010000:00010000:0.0:1788872960.796685:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872960.796699:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788872960.796797:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+75:73602:x1875765311249792:12345-192.168.204.39@tcp:36:touch.0 Request processed in 524us (746us total) trans 124554051617 rc 0/0 00000100:00100000:0.0:1788872960.796804:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1498 00000100:00100000:0.0:1788872960.800386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.800642:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311249920 00000100:00100000:3.0:1788872960.800651:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311249920 00000100:00100000:3.0:1788872960.800718:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1499 00000100:00100000:3.0:1788872960.800727:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+75:73602:x1875765311249920:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:3.0:1788872960.800749:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872960.800768:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b000/0xe4e6e89fb01dbe73 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb2fc expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.800829:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b000/0xe4e6e89fb01dbe73 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2fc expref: 76 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.800843:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b000/0xe4e6e89fb01dbe73 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb2fc expref: 76 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.800860:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff98a9e1f8fb00) 00010000:00010000:3.0:1788872960.800864:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788872960.800867:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449b000, rc 0) 00000100:00100000:3.0:1788872960.800969:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+76:73602:x1875765311249920:12345-192.168.204.39@tcp:101:touch.0 Request processed in 243us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872960.800983:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1499 00000100:00100000:3.0:1788872960.809543:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.809841:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311250048 00000100:00100000:0.0:1788872960.809852:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311250048 00000100:00100000:0.0:1788872960.809906:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6022 00000100:00100000:0.0:1788872960.809916:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+13:2404:x1875765311250048:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:0.0:1788872960.810134:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+14:2404:x1875765311250048:12345-192.168.204.39@tcp:2:touch.0 Request processed in 219us (609us total) trans 4294969466 rc 0/0 00000100:00100000:0.0:1788872960.810142:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6022 00000100:00100000:2.0:1788872960.813297:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.813489:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311250304 00000100:00100000:3.0:1788872960.813498:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311250304 00000100:00100000:3.0:1788872960.813588:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 254 00000100:00100000:3.0:1788872960.813598:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+76:73602:x1875765311250304:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872960.814146:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+77:73602:x1875765311250304:12345-192.168.204.39@tcp:35:touch.0 Request processed in 548us (855us total) trans 124554051618 rc 0/0 00000100:00100000:3.0:1788872960.814154:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 254 00000100:00100000:1.0:1788872960.821911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872960.822606:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311250560 00000100:00100000:2.0:1788872960.822618:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311250560 00000100:00100000:2.0:1788872960.822672:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1500 00000100:00100000:2.0:1788872960.822682:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+77:73602:x1875765311250560:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:2.0:1788872960.822717:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872960.822741:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbe7a lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb303 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.822864:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbe81 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.822881:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbe81 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.822891:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbe81 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.822906:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbe88 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.822912:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbe88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.822918:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbe88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788872960.835731:0:66193:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38c:0x0], index 0: 0 00010000:00010000:0.0:1788872960.835935:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbe8f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.835954:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbe8f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.835967:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbe8f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.836005:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbe81 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.836012:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbe81 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.836030:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbe81 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.836037:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbe81 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.836043:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872960.836048:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbe81 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.836055:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbe81 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.836068:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872960.836071:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872960.836076:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbe81 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.836082:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbe81 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872960.836095:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009fc2b5aa reply state 00000000f5529335 transno 124554051619 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbe88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.836105:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbe88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.836111:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff98a9c1358300) 00010000:00010000:0.0:1788872960.836114:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872960.836117:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788872960.836168:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbe7a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb303 expref: 80 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.836201:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbe8f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb303 expref: 79 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.836208:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff98a9e1f8f100) 00010000:00010000:0.0:1788872960.836212:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872960.836214:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58af600, rc 0) 00000100:00100000:0.0:1788872960.836296:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+80:73602:x1875765311250560:12345-192.168.204.39@tcp:101:touch.0 Request processed in 13615us (14396us total) trans 124554051619 rc 0/0 00000100:00100000:0.0:1788872960.836305:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1500 00000100:00100000:2.0:1788872960.847959:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.848073:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311250816 00000100:00100000:0.0:1788872960.848084:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311250816 00000100:00100000:0.0:1788872960.848149:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1501 00000100:00100000:0.0:1788872960.848160:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+80:73602:x1875765311250816:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:0.0:1788872960.848216:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872960.848243:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbe8f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb303 expref: 80 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.848262:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff98a9e1f8f100) 00010000:00010000:0.0:1788872960.848272:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872960.848335:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dbe9d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.848348:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dbe9d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.848358:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dbe9d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872960.848481:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000074b00892 reply state 00000000e53deb6d transno 124554051620 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dbe9d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.848493:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dbe9d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.848500:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:0.0:1788872960.848502:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872960.848504:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788872960.848643:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+81:73602:x1875765311250816:12345-192.168.204.39@tcp:36:touch.0 Request processed in 484us (692us total) trans 124554051620 rc 0/0 00000100:00100000:0.0:1788872960.848651:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1501 00000100:00100000:2.0:1788872960.862156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.863870:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311250944 00000100:00100000:3.0:1788872960.863910:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311250944 00000100:00100000:3.0:1788872960.863988:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1502 00000100:00100000:3.0:1788872960.864011:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+81:73602:x1875765311250944:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:3.0:1788872960.864041:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872960.864063:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a000/0xe4e6e89fb01dbea4 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb30a expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.864125:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a000/0xe4e6e89fb01dbea4 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb30a expref: 82 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.864153:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a000/0xe4e6e89fb01dbea4 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb30a expref: 82 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.864626:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:3.0:1788872960.864631:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788872960.864636:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c449a000, rc 0) 00000100:00100000:3.0:1788872960.864717:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+82:73602:x1875765311250944:12345-192.168.204.39@tcp:101:touch.0 Request processed in 706us (2568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872960.864724:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1502 00000100:00100000:3.0:1788872960.870602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872960.871022:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311251072 00000100:00100000:2.0:1788872960.871046:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311251072 00000100:00100000:2.0:1788872960.871112:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6023 00000100:00100000:2.0:1788872960.871122:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0804304d-5904-48ad-87f2-bcbc7642a62a+14:2407:x1875765311251072:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:2.0:1788872960.871352:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0804304d-5904-48ad-87f2-bcbc7642a62a+15:2407:x1875765311251072:12345-192.168.204.39@tcp:2:touch.0 Request processed in 231us (759us total) trans 4294969467 rc 0/0 00000100:00100000:2.0:1788872960.871360:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6023 00000100:00100000:2.0:1788872960.878058:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.878239:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311251328 00000100:00100000:3.0:1788872960.878249:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311251328 00000100:00100000:3.0:1788872960.878316:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 255 00000100:00100000:3.0:1788872960.878326:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+82:73602:x1875765311251328:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872960.886502:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+83:73602:x1875765311251328:12345-192.168.204.39@tcp:35:touch.0 Request processed in 8166us (9092us total) trans 124554051621 rc 0/0 00000100:00100000:3.0:1788872960.886517:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 255 00000100:00100000:0.0:1788872960.891980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872960.892177:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311251584 00000100:00100000:2.0:1788872960.892188:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311251584 00000100:00100000:2.0:1788872960.892247:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1503 00000100:00100000:2.0:1788872960.892258:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+83:73602:x1875765311251584:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:2.0:1788872960.892283:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872960.892306:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbeab lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb311 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.892645:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbeb2 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.892660:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbeb2 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.892673:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbeb2 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.892699:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbeb9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.892707:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbeb9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.892730:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbeb9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788872960.893678:0:66192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38d:0x0], index 0: 0 00010000:00010000:2.0:1788872960.893835:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbec0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.893847:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbec0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.893856:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbec0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.895253:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbeb2 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.895267:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbeb2 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.895274:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbeb2 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.895282:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbeb2 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.895288:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872960.895292:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbeb2 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.895299:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbeb2 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.895330:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872960.895333:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872960.895338:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbeb2 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.895345:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbeb2 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872960.895360:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb347280 reply state 00000000ac3e8175 transno 124554051622 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbeb9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.895370:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbeb9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.895377:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff98a9c1358a00) 00010000:00010000:2.0:1788872960.895380:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872960.895382:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788872960.895423:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbeab lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb311 expref: 86 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.895437:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbec0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb311 expref: 85 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872960.895444:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff98a9c1358f00) 00010000:00010000:2.0:1788872960.895447:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872960.895449:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa898000, rc 0) 00000100:00100000:2.0:1788872960.895527:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+86:73602:x1875765311251584:12345-192.168.204.39@tcp:101:touch.0 Request processed in 3270us (3556us total) trans 124554051622 rc 0/0 00000100:00100000:2.0:1788872960.895536:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1503 00000100:00100000:1.0:1788872960.901012:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.901083:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311251840 00000100:00100000:0.0:1788872960.901095:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311251840 00000100:00100000:0.0:1788872960.901163:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1504 00000100:00100000:0.0:1788872960.901183:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+86:73602:x1875765311251840:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:0.0:1788872960.901262:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872960.901293:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbec0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb311 expref: 86 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.901312:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff98a9c1358f00) 00010000:00010000:0.0:1788872960.901323:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872960.901399:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbece lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.901421:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbece lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.901442:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbece lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872960.901614:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000476a3e53 reply state 00000000bb3e6f6e transno 124554051623 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbece lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.901627:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbece lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.901632:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff98a9e1f8f100) 00010000:00010000:0.0:1788872960.901636:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872960.901638:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788872960.901734:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+87:73602:x1875765311251840:12345-192.168.204.39@tcp:36:touch.0 Request processed in 562us (731us total) trans 124554051623 rc 0/0 00000100:00100000:0.0:1788872960.901741:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1504 00000100:00100000:3.0:1788872960.906792:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.906864:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311251968 00000100:00100000:0.0:1788872960.906875:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311251968 00000100:00100000:0.0:1788872960.906944:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1505 00000100:00100000:0.0:1788872960.906955:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+87:73602:x1875765311251968:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872960.906979:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872960.907000:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af400/0xe4e6e89fb01dbed5 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb318 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.907057:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af400/0xe4e6e89fb01dbed5 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb318 expref: 88 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.907071:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af400/0xe4e6e89fb01dbed5 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb318 expref: 88 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.907111:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff98a9e1f8f100) 00010000:00010000:0.0:1788872960.907114:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788872960.907118:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58af400, rc 0) 00000100:00100000:0.0:1788872960.907199:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+88:73602:x1875765311251968:12345-192.168.204.39@tcp:101:touch.0 Request processed in 245us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872960.907207:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1505 00000100:00100000:1.0:1788872960.925414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.925584:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311252096 00000100:00100000:0.0:1788872960.925594:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311252096 00000100:00100000:0.0:1788872960.925654:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6024 00000100:00100000:0.0:1788872960.925665:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+15:2405:x1875765311252096:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:0.0:1788872960.925918:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+16:2405:x1875765311252096:12345-192.168.204.39@tcp:2:touch.0 Request processed in 254us (522us total) trans 4294969468 rc 0/0 00000100:00100000:0.0:1788872960.925925:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6024 00000100:00100000:1.0:1788872960.933107:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.933337:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311252352 00000100:00100000:3.0:1788872960.933347:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311252352 00000100:00100000:3.0:1788872960.933404:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 256 00000100:00100000:3.0:1788872960.933416:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+88:73602:x1875765311252352:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872960.933820:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+89:73602:x1875765311252352:12345-192.168.204.39@tcp:35:touch.0 Request processed in 403us (721us total) trans 124554051624 rc 0/0 00000100:00100000:3.0:1788872960.933828:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 256 00000100:00100000:3.0:1788872960.940941:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.941085:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311252608 00000100:00100000:0.0:1788872960.941097:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311252608 00000100:00100000:0.0:1788872960.941164:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1506 00000100:00100000:0.0:1788872960.941184:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+89:73602:x1875765311252608:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872960.941207:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872960.941230:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbedc lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb31f expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.941335:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbee3 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.941357:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbee3 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.941382:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbee3 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.941399:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbeea lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.941406:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbeea lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.941413:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbeea lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788872960.941912:0:66193:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38e:0x0], index 0: 0 00010000:00010000:0.0:1788872960.942528:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbef1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.942629:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbef1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.942639:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbef1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.942676:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbee3 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.942694:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbee3 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.942701:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbee3 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.942707:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbee3 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.942722:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872960.942727:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbee3 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.942735:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbee3 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.942748:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872960.942751:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872960.942756:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbee3 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.942763:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbee3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872960.942776:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ff8994e reply state 000000003e5e83f8 transno 124554051625 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbeea lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.942787:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbeea lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.942793:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff98a9c5daa100) 00010000:00010000:0.0:1788872960.942796:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872960.943180:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788872960.943227:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbedc lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb31f expref: 92 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.943245:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbef1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb31f expref: 91 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.943267:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff98a9c5daa700) 00010000:00010000:0.0:1788872960.943270:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872960.943272:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58afa00, rc 0) 00000100:00100000:0.0:1788872960.943351:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+92:73602:x1875765311252608:12345-192.168.204.39@tcp:101:touch.0 Request processed in 2169us (2419us total) trans 124554051625 rc 0/0 00000100:00100000:0.0:1788872960.943360:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1506 00000100:00100000:1.0:1788872960.953873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872960.954937:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311252864 00000100:00100000:3.0:1788872960.954948:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311252864 00000100:00100000:3.0:1788872960.956332:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1507 00000100:00100000:3.0:1788872960.956348:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+92:73602:x1875765311252864:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:3.0:1788872960.956415:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872960.956445:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbef1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb31f expref: 92 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.956464:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff98a9c5daa700) 00010000:00010000:3.0:1788872960.956476:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872960.956601:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dbeff lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.956614:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dbeff lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.956624:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dbeff lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872960.956749:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002bd56d35 reply state 00000000dab025e0 transno 124554051626 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dbeff lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.956775:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dbeff lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872960.956782:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff98a9c5d04c00) 00010000:00010000:3.0:1788872960.956785:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872960.956787:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788872960.958392:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+93:73602:x1875765311252864:12345-192.168.204.39@tcp:36:touch.0 Request processed in 2042us (4520us total) trans 124554051626 rc 0/0 00000100:00100000:3.0:1788872960.958402:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1507 00000100:00100000:1.0:1788872960.968448:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.968579:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311252992 00000100:00100000:0.0:1788872960.968590:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311252992 00000100:00100000:0.0:1788872960.968654:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1508 00000100:00100000:0.0:1788872960.968664:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+93:73602:x1875765311252992:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872960.968697:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872960.968719:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbf06 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb326 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.968781:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbf06 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb326 expref: 94 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872960.968944:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af600/0xe4e6e89fb01dbf06 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb326 expref: 94 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872960.973860:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff98a9c5d04c00) 00010000:00010000:1.0:1788872960.973871:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788872960.973877:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58af600, rc 0) 00000100:00100000:1.0:1788872960.974026:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+94:73602:x1875765311252992:12345-192.168.204.39@tcp:101:touch.0 Request processed in 5358us (5582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872960.974036:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1508 00000100:00100000:1.0:1788872960.988226:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872960.988320:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311253120 00000100:00100000:0.0:1788872960.988330:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311253120 00000100:00100000:0.0:1788872960.988448:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6025 00000100:00100000:0.0:1788872960.988458:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+16:2404:x1875765311253120:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:0.0:1788872960.988749:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+17:2404:x1875765311253120:12345-192.168.204.39@tcp:2:touch.0 Request processed in 292us (533us total) trans 4294969469 rc 0/0 00000100:00100000:0.0:1788872960.988772:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6025 00000100:00100000:3.0:1788872960.998268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872961.005159:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311253376 00000100:00100000:1.0:1788872961.005176:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311253376 00000100:00100000:1.0:1788872961.005254:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 257 00000100:00100000:1.0:1788872961.005264:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfc00450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+94:73602:x1875765311253376:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:1.0:1788872961.005706:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfc00450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+95:73602:x1875765311253376:12345-192.168.204.39@tcp:35:touch.0 Request processed in 442us (7448us total) trans 124554051627 rc 0/0 00000100:00100000:1.0:1788872961.005715:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 257 00000100:00100000:1.0:1788872961.015817:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872961.015912:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311253632 00000100:00100000:2.0:1788872961.015923:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311253632 00000100:00100000:2.0:1788872961.015999:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1509 00000100:00100000:2.0:1788872961.016009:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+95:73602:x1875765311253632:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:2.0:1788872961.016038:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872961.016063:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf0d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb32d expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.016164:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf14 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.016195:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf14 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.016207:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf14 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.016222:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbf1b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.016230:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbf1b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.016235:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbf1b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788872961.016882:0:66192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38f:0x0], index 0: 0 00010000:00010000:2.0:1788872961.017018:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbf22 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017027:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbf22 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017048:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbf22 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017082:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf14 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017089:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf14 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017095:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf14 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017101:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf14 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017108:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872961.017112:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf14 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017119:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf14 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017129:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872961.017132:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872961.017136:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf14 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017142:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf14 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872961.017154:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000beed813c reply state 000000009a5c704a transno 124554051628 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbf1b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017349:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbf1b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017358:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff98a9c1358500) 00010000:00010000:2.0:1788872961.017360:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872961.017363:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788872961.017396:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf0d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb32d expref: 98 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017415:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbf22 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb32d expref: 97 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.017422:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff98a9c1358f00) 00010000:00010000:2.0:1788872961.017424:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872961.017426:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa898000, rc 0) 00000100:00100000:2.0:1788872961.017769:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+98:73602:x1875765311253632:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1760us (1971us total) trans 124554051628 rc 0/0 00000100:00100000:2.0:1788872961.017778:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1509 00000100:00100000:3.0:1788872961.021453:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872961.021584:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311253888 00000100:00100000:2.0:1788872961.021594:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311253888 00000100:00100000:2.0:1788872961.021652:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1510 00000100:00100000:2.0:1788872961.021662:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+98:73602:x1875765311253888:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:2.0:1788872961.021736:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872961.021761:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbf22 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb32d expref: 98 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.021779:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff98a9c1358f00) 00010000:00010000:2.0:1788872961.021813:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872961.021872:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbf30 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.021885:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbf30 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.021894:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbf30 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872961.022015:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de5d6c21 reply state 0000000049a0700f transno 124554051629 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbf30 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.022027:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbf30 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.022033:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff98a9c1358d00) 00010000:00010000:2.0:1788872961.022036:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872961.022038:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872961.022117:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+99:73602:x1875765311253888:12345-192.168.204.39@tcp:36:touch.0 Request processed in 456us (673us total) trans 124554051629 rc 0/0 00000100:00100000:2.0:1788872961.022125:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1510 00000100:00100000:1.0:1788872961.028522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872961.028739:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311254016 00000100:00100000:3.0:1788872961.028750:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311254016 00000100:00100000:3.0:1788872961.028810:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1511 00000100:00100000:3.0:1788872961.028820:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+99:73602:x1875765311254016:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:3.0:1788872961.028847:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872961.028869:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dbf37 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb334 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.028930:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dbf37 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb334 expref: 100 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.028944:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9000/0xe4e6e89fb01dbf37 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb334 expref: 100 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.028976:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff98a9c1358d00) 00010000:00010000:3.0:1788872961.028987:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788872961.029000:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9000, rc 0) 00000100:00100000:3.0:1788872961.029103:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+100:73602:x1875765311254016:12345-192.168.204.39@tcp:101:touch.0 Request processed in 284us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872961.029112:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1511 00000100:00100000:1.0:1788872961.041435:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.041735:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311254144 00000100:00100000:0.0:1788872961.041747:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311254144 00000100:00100000:0.0:1788872961.041811:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6026 00000100:00100000:0.0:1788872961.041822:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+17:2404:x1875765311254144:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:0.0:1788872961.042047:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+18:2404:x1875765311254144:12345-192.168.204.39@tcp:2:touch.0 Request processed in 225us (620us total) trans 4294969470 rc 0/0 00000100:00100000:0.0:1788872961.042054:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6026 00000100:00100000:3.0:1788872961.045506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872961.046253:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311254400 00000100:00100000:2.0:1788872961.046263:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311254400 00000100:00100000:3.0:1788872961.046926:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 258 00000100:00100000:3.0:1788872961.046938:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+100:73602:x1875765311254400:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872961.047290:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+101:73602:x1875765311254400:12345-192.168.204.39@tcp:35:touch.0 Request processed in 353us (1790us total) trans 124554051630 rc 0/0 00000100:00100000:3.0:1788872961.047298:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 258 00000100:00100000:1.0:1788872961.051647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.051739:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311254656 00000100:00100000:0.0:1788872961.051748:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311254656 00000100:00100000:0.0:1788872961.051817:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1512 00000100:00100000:0.0:1788872961.051827:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+101:73602:x1875765311254656:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872961.051850:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872961.051873:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbf3e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb33b expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.051980:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbf45 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.052008:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbf45 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.052021:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbf45 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.052036:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbf4c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.052061:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbf4c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.052069:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbf4c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788872961.052379:0:66193:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x390:0x0], index 0: 0 00010000:00010000:0.0:1788872961.052990:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbf53 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053145:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbf53 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053155:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbf53 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053246:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbf45 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053254:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbf45 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053261:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbf45 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053268:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbf45 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053275:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872961.053279:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbf45 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053299:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbf45 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053312:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872961.053314:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872961.053319:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbf45 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053326:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbf45 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872961.053339:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002fe6d4b8 reply state 00000000bb85da77 transno 124554051631 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbf4c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053349:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbf4c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053355:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff98a9c5daa400) 00010000:00010000:0.0:1788872961.053358:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872961.053360:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788872961.053393:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbf3e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb33b expref: 104 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053762:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbf53 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb33b expref: 103 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.053779:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff98a9c5daae00) 00010000:00010000:0.0:1788872961.053782:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872961.053785:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58afa00, rc 0) 00000100:00100000:1.0:1788872961.054343:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+104:73602:x1875765311254656:12345-192.168.204.39@tcp:101:touch.0 Request processed in 2513us (2878us total) trans 124554051631 rc 0/0 00000100:00100000:1.0:1788872961.054352:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1512 00000100:00100000:3.0:1788872961.059833:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872961.059913:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311254912 00000100:00100000:2.0:1788872961.059923:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311254912 00000100:00100000:2.0:1788872961.059986:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1513 00000100:00100000:2.0:1788872961.060006:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+104:73602:x1875765311254912:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:2.0:1788872961.060087:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872961.060117:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbf53 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb33b expref: 104 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.060147:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff98a9c5daae00) 00010000:00010000:2.0:1788872961.060159:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872961.060225:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbf61 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.060238:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbf61 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.060247:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbf61 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872961.060361:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe3fe9c7 reply state 00000000bb20c182 transno 124554051632 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbf61 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.060373:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbf61 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.060379:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff98a9c1358f00) 00010000:00010000:2.0:1788872961.060382:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872961.060384:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872961.061419:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+105:73602:x1875765311254912:12345-192.168.204.39@tcp:36:touch.0 Request processed in 1420us (1591us total) trans 124554051632 rc 0/0 00000100:00100000:2.0:1788872961.061428:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1513 00000100:00100000:3.0:1788872961.065351:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.065446:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311255040 00000100:00100000:0.0:1788872961.065455:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311255040 00000100:00100000:0.0:1788872961.065694:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1514 00000100:00100000:0.0:1788872961.065707:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+105:73602:x1875765311255040:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872961.065733:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872961.065756:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbf68 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb342 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.065929:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbf68 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb342 expref: 106 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.065945:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52afa00/0xe4e6e89fb01dbf68 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb342 expref: 106 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.065966:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff98a9c1358f00) 00010000:00010000:0.0:1788872961.065969:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788872961.065973:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52afa00, rc 0) 00000100:00100000:0.0:1788872961.066030:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+106:73602:x1875765311255040:12345-192.168.204.39@tcp:101:touch.0 Request processed in 327us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872961.066036:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1514 00000100:00100000:1.0:1788872961.077039:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872961.077263:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311255168 00000100:00100000:3.0:1788872961.077274:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311255168 00000100:00100000:3.0:1788872961.077434:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6027 00000100:00100000:3.0:1788872961.077447:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0804304d-5904-48ad-87f2-bcbc7642a62a+18:2405:x1875765311255168:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:2.0:1788872961.077956:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0804304d-5904-48ad-87f2-bcbc7642a62a+19:2405:x1875765311255168:12345-192.168.204.39@tcp:2:touch.0 Request processed in 510us (926us total) trans 4294969471 rc 0/0 00000100:00100000:2.0:1788872961.077965:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6027 00000100:00100000:1.0:1788872961.095578:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872961.095968:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311255424 00000100:00100000:2.0:1788872961.095980:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311255424 00000100:00100000:2.0:1788872961.096045:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 259 00000100:00100000:2.0:1788872961.096055:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+106:73602:x1875765311255424:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:2.0:1788872961.096746:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+107:73602:x1875765311255424:12345-192.168.204.39@tcp:35:touch.0 Request processed in 690us (1194us total) trans 124554051633 rc 0/0 00000100:00100000:2.0:1788872961.096755:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 259 00000100:00100000:3.0:1788872961.101778:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872961.102143:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311255680 00000100:00100000:2.0:1788872961.102155:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311255680 00000100:00100000:2.0:1788872961.102338:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1515 00000100:00100000:2.0:1788872961.102349:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+107:73602:x1875765311255680:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:2.0:1788872961.102374:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872961.102398:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbf6f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb349 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.102504:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf76 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.102519:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf76 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.102750:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf76 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.102770:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf7d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.102779:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf7d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.102786:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf7d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788872961.106760:0:66192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x391:0x0], index 0: 0 00010000:00010000:3.0:1788872961.108440:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dbf84 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109163:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dbf84 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109186:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dbf84 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109232:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf76 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109250:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf76 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109256:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf76 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109264:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf76 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109270:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872961.109275:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf76 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109282:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf76 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109304:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:3.0:1788872961.109308:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872961.109313:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf76 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109319:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbf76 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872961.109335:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000086aa282a reply state 00000000c519d12a transno 124554051634 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf7d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109347:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf7d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109353:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff98a9faf66d00) 00010000:00010000:3.0:1788872961.109362:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872961.109365:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788872961.109407:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbf6f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb349 expref: 110 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109424:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dbf84 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb349 expref: 109 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872961.109432:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff98a9c5d04b00) 00010000:00010000:3.0:1788872961.109434:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788872961.109436:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9800, rc 0) 00000100:00100000:3.0:1788872961.109523:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+110:73602:x1875765311255680:12345-192.168.204.39@tcp:101:touch.0 Request processed in 7174us (7754us total) trans 124554051634 rc 0/0 00000100:00100000:3.0:1788872961.109538:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1515 00000100:00100000:0.0:1788872961.113975:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872961.114689:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311255936 00000100:00100000:1.0:1788872961.114715:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311255936 00000100:00100000:1.0:1788872961.114776:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1516 00000100:00100000:1.0:1788872961.114786:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+110:73602:x1875765311255936:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:1.0:1788872961.114855:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872961.114883:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9800/0xe4e6e89fb01dbf84 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb349 expref: 110 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.114909:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff98a9c5d04b00) 00010000:00010000:1.0:1788872961.114920:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872961.115269:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dbf92 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.115285:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dbf92 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.115305:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dbf92 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872961.115434:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000648dba81 reply state 0000000098f38e1b transno 124554051635 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dbf92 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.115445:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dbf92 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.115452:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff98a9f016ae00) 00010000:00010000:1.0:1788872961.115454:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872961.115457:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872961.115605:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+111:73602:x1875765311255936:12345-192.168.204.39@tcp:36:touch.0 Request processed in 818us (1652us total) trans 124554051635 rc 0/0 00000100:00100000:1.0:1788872961.115612:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1516 00000100:00100000:1.0:1788872961.118736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.118820:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311256064 00000100:00100000:0.0:1788872961.118829:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311256064 00000100:00100000:0.0:1788872961.118886:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1517 00000100:00100000:0.0:1788872961.118897:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+111:73602:x1875765311256064:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872961.118918:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872961.118939:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbf99 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb350 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.119020:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbf99 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb350 expref: 112 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.119034:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af400/0xe4e6e89fb01dbf99 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb350 expref: 112 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.119052:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff98a9f016ae00) 00010000:00010000:0.0:1788872961.119056:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788872961.119059:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52af400, rc 0) 00000100:00100000:0.0:1788872961.119122:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+112:73602:x1875765311256064:12345-192.168.204.39@tcp:101:touch.0 Request processed in 227us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872961.119137:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1517 00000100:00100000:3.0:1788872961.124013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872961.124144:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311256192 00000100:00100000:1.0:1788872961.124154:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311256192 00000100:00100000:1.0:1788872961.124255:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6028 00000100:00100000:1.0:1788872961.124265:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+19:2405:x1875765311256192:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:1.0:1788872961.124492:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+20:2405:x1875765311256192:12345-192.168.204.39@tcp:2:touch.0 Request processed in 228us (496us total) trans 4294969472 rc 0/0 00000100:00100000:1.0:1788872961.124500:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6028 00000100:00100000:0.0:1788872961.127774:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872961.128503:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311256448 00000100:00100000:3.0:1788872961.128515:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311256448 00000100:00100000:3.0:1788872961.128607:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 260 00000100:00100000:3.0:1788872961.128616:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+112:73602:x1875765311256448:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872961.129005:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+113:73602:x1875765311256448:12345-192.168.204.39@tcp:35:touch.0 Request processed in 388us (1238us total) trans 124554051636 rc 0/0 00000100:00100000:3.0:1788872961.129013:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 260 00000100:00100000:3.0:1788872961.138981:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872961.139137:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311256704 00000100:00100000:2.0:1788872961.139148:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311256704 00000100:00100000:2.0:1788872961.139214:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1518 00000100:00100000:2.0:1788872961.139225:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+113:73602:x1875765311256704:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:2.0:1788872961.139254:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872961.139276:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbfa0 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb357 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.139392:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbfa7 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.139407:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbfa7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.139419:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbfa7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.139435:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dbfae lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.139442:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dbfae lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.139448:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dbfae lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788872961.140930:0:66193:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x392:0x0], index 0: 0 00010000:00010000:2.0:1788872961.141116:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dbfb5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.141160:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dbfb5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872961.142289:0:94390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff54ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94390:1875765327875584:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788872961.142367:0:94390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872961.142399:0:94390:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9efa6ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788872961.142421:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327875584 00000100:00100000:1.0:1788872961.142427:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327875584 00000100:00100000:1.0:1788872961.142484:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6029 00000100:00100000:1.0:1788872961.142494:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:94390:x1875765327875584:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788872961.142545:0:26192:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 930 00010000:00010000:2.0:1788872961.143825:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dbfb5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.143884:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbfa7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.143893:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbfa7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.143899:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbfa7 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.143906:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbfa7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.143912:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872961.143916:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbfa7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.143923:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbfa7 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.143937:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872961.143940:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872961.143944:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbfa7 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.143951:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dbfa7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872961.145730:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:94390:x1875765327875584:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3231us (3356us total) trans 4294969473 rc 0/0 00000100:00100000:1.0:1788872961.145741:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6029 00000004:00010000:2.0:1788872961.146433:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2ce0031 reply state 000000004a868c9a transno 124554051637 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dbfae lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.146449:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dbfae lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.146457:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff98a9faf66600) 00010000:00010000:2.0:1788872961.146459:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872961.146463:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788872961.146509:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898000/0xe4e6e89fb01dbfa0 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb357 expref: 116 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.146536:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dbfb5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb357 expref: 115 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.146544:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff98a9faf66f00) 00010000:00010000:2.0:1788872961.146570:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872961.146573:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4499200, rc 0) 00000100:00100000:2.0:1788872961.146631:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+116:73602:x1875765311256704:12345-192.168.204.39@tcp:101:touch.0 Request processed in 7407us (7676us total) trans 124554051637 rc 0/0 00000100:00100000:2.0:1788872961.146638:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1518 00000100:00080000:2.0:1788872961.146668:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872961.146810:0:94390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff54ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94390:1875765327875584:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788872961.146826:0:94390:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x392:0x0]-[0x280000401:0x3c1:0x0] 00000100:00100000:3.0:1788872961.151196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.151377:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311256960 00000100:00100000:0.0:1788872961.151388:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311256960 00000100:00100000:0.0:1788872961.151453:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1519 00000100:00100000:0.0:1788872961.151464:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+116:73602:x1875765311256960:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:0.0:1788872961.151533:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872961.151594:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dbfb5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb357 expref: 116 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.151612:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff98a9faf66f00) 00010000:00010000:0.0:1788872961.151638:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872961.151710:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbfc3 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.151722:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbfc3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.151731:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbfc3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872961.151844:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e20b7c3 reply state 000000005caad621 transno 124554051638 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbfc3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.151856:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbfc3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.151862:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff98a9c5daa000) 00010000:00010000:0.0:1788872961.151865:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872961.151867:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788872961.151946:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+117:73602:x1875765311256960:12345-192.168.204.39@tcp:36:touch.0 Request processed in 484us (759us total) trans 124554051638 rc 0/0 00000100:00100000:0.0:1788872961.151954:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1519 00000100:00100000:1.0:1788872961.167490:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.167677:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311257088 00000100:00100000:0.0:1788872961.167700:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311257088 00000100:00100000:0.0:1788872961.167766:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1520 00000100:00100000:0.0:1788872961.167777:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+117:73602:x1875765311257088:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872961.167807:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872961.167832:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbfca lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb35e expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.167896:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbfca lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb35e expref: 118 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.167930:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae800/0xe4e6e89fb01dbfca lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb35e expref: 118 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.167952:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff98a9c5daa000) 00010000:00010000:0.0:1788872961.168355:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788872961.168362:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52ae800, rc 0) 00000100:00100000:0.0:1788872961.168426:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+118:73602:x1875765311257088:12345-192.168.204.39@tcp:101:touch.0 Request processed in 649us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872961.168433:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1520 00000100:00100000:3.0:1788872961.171459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872961.171745:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311257216 00000100:00100000:1.0:1788872961.171756:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311257216 00000100:00100000:1.0:1788872961.171810:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6030 00000100:00100000:1.0:1788872961.171820:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+20:2404:x1875765311257216:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:1.0:1788872961.172619:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+21:2404:x1875765311257216:12345-192.168.204.39@tcp:2:touch.0 Request processed in 797us (1166us total) trans 4294969474 rc 0/0 00000100:00100000:1.0:1788872961.172647:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6030 00000100:00100000:3.0:1788872961.175693:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872961.175766:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311257472 00000100:00100000:1.0:1788872961.175777:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311257472 00000100:00100000:1.0:1788872961.175835:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 261 00000100:00100000:1.0:1788872961.175845:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+118:73602:x1875765311257472:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:1.0:1788872961.176492:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+119:73602:x1875765311257472:12345-192.168.204.39@tcp:35:touch.0 Request processed in 646us (817us total) trans 124554051639 rc 0/0 00000100:00100000:1.0:1788872961.176500:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 261 00000100:00100000:3.0:1788872961.179638:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.179932:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311257728 00000100:00100000:0.0:1788872961.179944:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311257728 00000100:00100000:0.0:1788872961.180011:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1521 00000100:00100000:0.0:1788872961.180022:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+119:73602:x1875765311257728:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872961.180048:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872961.180071:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dbfd1 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb365 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.180180:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbfd8 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.180196:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbfd8 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.180207:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbfd8 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.180221:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbfdf lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.180236:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbfdf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.180244:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbfdf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788872961.180824:0:66192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x393:0x0], index 0: 0 00010000:00010000:0.0:1788872961.180971:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbfe6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.180980:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbfe6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.180987:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbfe6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.181017:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbfd8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.181024:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbfd8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.181030:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbfd8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.181035:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbfd8 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.181041:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58afa00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872961.181045:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbfd8 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.181062:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbfd8 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.181072:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872961.181075:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872961.181079:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbfd8 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.181085:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dbfd8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872961.181098:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071a47d65 reply state 00000000dde3703d transno 124554051640 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbfdf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.181107:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbfdf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.181112:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff98a9c5daac00) 00010000:00010000:0.0:1788872961.181114:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872961.181117:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788872961.181142:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dbfd1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb365 expref: 122 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.181155:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbfe6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb365 expref: 121 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.181161:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff98a9c5daa600) 00010000:00010000:0.0:1788872961.181163:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872961.181177:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58ae000, rc 0) 00000100:00100000:0.0:1788872961.181235:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+122:73602:x1875765311257728:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1216us (1607us total) trans 124554051640 rc 0/0 00000100:00100000:0.0:1788872961.181243:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1521 00000100:00100000:0.0:1788872961.195447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872961.198035:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311257984 00000100:00100000:1.0:1788872961.198050:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311257984 00000100:00100000:1.0:1788872961.198180:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1522 00000100:00100000:1.0:1788872961.198191:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+122:73602:x1875765311257984:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:1.0:1788872961.198259:0:66190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872961.198287:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dbfe6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb365 expref: 122 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.198759:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff98a9c5daa600) 00010000:00010000:1.0:1788872961.198779:0:66190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872961.198837:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dbff4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.198850:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dbff4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.198860:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dbff4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872961.198982:0:66190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063200117 reply state 00000000763cd1aa transno 124554051641 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dbff4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.199009:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dbff4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.199015:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff98a9f016a400) 00010000:00010000:1.0:1788872961.199018:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872961.199021:0:66190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872961.199121:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+123:73602:x1875765311257984:12345-192.168.204.39@tcp:36:touch.0 Request processed in 930us (3682us total) trans 124554051641 rc 0/0 00000100:00100000:1.0:1788872961.199129:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1522 00000100:00100000:3.0:1788872961.204693:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872961.204893:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311258112 00000100:00100000:1.0:1788872961.204902:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311258112 00000100:00100000:1.0:1788872961.204964:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1523 00000100:00100000:1.0:1788872961.204976:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+123:73602:x1875765311258112:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:1.0:1788872961.205003:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872961.205025:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01dbffb lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb36c expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.205080:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01dbffb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb36c expref: 124 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.205093:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d600/0xe4e6e89fb01dbffb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb36c expref: 124 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.205111:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff98a9f016a400) 00010000:00010000:1.0:1788872961.205138:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788872961.205142:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4f9d600, rc 0) 00000100:00100000:1.0:1788872961.205215:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+124:73602:x1875765311258112:12345-192.168.204.39@tcp:101:touch.0 Request processed in 241us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872961.205222:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1523 00000100:00100000:3.0:1788872961.209116:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.209373:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311258240 00000100:00100000:0.0:1788872961.209383:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311258240 00000100:00100000:0.0:1788872961.209444:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6031 00000100:00100000:0.0:1788872961.209455:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0804304d-5904-48ad-87f2-bcbc7642a62a+21:2406:x1875765311258240:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:0.0:1788872961.210082:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0804304d-5904-48ad-87f2-bcbc7642a62a+22:2406:x1875765311258240:12345-192.168.204.39@tcp:2:touch.0 Request processed in 625us (971us total) trans 4294969475 rc 0/0 00000100:00100000:0.0:1788872961.210091:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6031 00000100:00100000:3.0:1788872961.213130:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.213363:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311258496 00000100:00100000:0.0:1788872961.213373:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311258496 00000100:00100000:0.0:1788872961.213497:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 262 00000100:00100000:0.0:1788872961.213508:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+124:73602:x1875765311258496:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:0.0:1788872961.214760:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+125:73602:x1875765311258496:12345-192.168.204.39@tcp:35:touch.0 Request processed in 1250us (1634us total) trans 124554051642 rc 0/0 00000100:00100000:0.0:1788872961.215158:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 262 00000100:00100000:3.0:1788872961.224710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872961.224828:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311258752 00000100:00100000:1.0:1788872961.224838:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311258752 00000100:00100000:1.0:1788872961.224903:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1524 00000100:00100000:1.0:1788872961.224913:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+125:73602:x1875765311258752:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:1.0:1788872961.224936:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872961.224959:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dc002 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb373 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225065:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dc009 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225080:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dc009 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225090:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dc009 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225105:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dc010 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225111:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dc010 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225116:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dc010 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788872961.225446:0:66193:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x394:0x0], index 0: 0 00010000:00010000:1.0:1788872961.225629:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc017 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225639:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc017 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225647:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc017 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225688:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dc009 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225695:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dc009 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225702:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dc009 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225709:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dc009 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225715:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872961.225719:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dc009 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225727:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dc009 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225739:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872961.225742:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872961.225753:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dc009 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225760:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9c400/0xe4e6e89fb01dc009 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788872961.225774:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002bcdf75b reply state 00000000f09e6bd2 transno 124554051643 ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dc010 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225785:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dc010 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225791:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff98a9f016a100) 00010000:00010000:1.0:1788872961.225793:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872961.225796:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788872961.225824:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9dc00/0xe4e6e89fb01dc002 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb373 expref: 128 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225839:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc017 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb373 expref: 127 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872961.225847:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff98a9c29bfc00) 00010000:00010000:1.0:1788872961.225849:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872961.225852:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3000, rc 0) 00000100:00100000:1.0:1788872961.226091:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+128:73602:x1875765311258752:12345-192.168.204.39@tcp:101:touch.0 Request processed in 1178us (1395us total) trans 124554051643 rc 0/0 00000100:00100000:1.0:1788872961.226099:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1524 00000100:00100000:3.0:1788872961.236237:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872961.236691:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311259008 00000100:00100000:2.0:1788872961.236702:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311259008 00000100:00100000:2.0:1788872961.236766:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1525 00000100:00100000:2.0:1788872961.236776:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+128:73602:x1875765311259008:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:2.0:1788872961.236834:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872961.236876:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc017 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb373 expref: 128 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.236896:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff98a9c29bfc00) 00010000:00010000:2.0:1788872961.236908:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872961.236975:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc025 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.236990:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc025 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.236999:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc025 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872961.237107:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e3d54e37 reply state 000000005ac2c4c7 transno 124554051644 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc025 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.237119:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc025 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.237125:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff98a9faf66700) 00010000:00010000:2.0:1788872961.237127:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872961.237130:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872961.237225:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+129:73602:x1875765311259008:12345-192.168.204.39@tcp:36:touch.0 Request processed in 450us (995us total) trans 124554051644 rc 0/0 00000100:00100000:2.0:1788872961.237232:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1525 00000100:00100000:3.0:1788872961.240667:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872961.258148:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311259136 00000100:00100000:1.0:1788872961.258164:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311259136 00000100:00100000:0.0:1788872961.258582:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1526 00000100:00100000:0.0:1788872961.258594:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+129:73602:x1875765311259136:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872961.258618:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872961.258640:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dc02c lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb37a expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.258709:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dc02c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb37a expref: 130 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.258741:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afa00/0xe4e6e89fb01dc02c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb37a expref: 130 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.258761:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff98a9faf66700) 00010000:00010000:0.0:1788872961.258765:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788872961.258781:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58afa00, rc 0) 00000100:00100000:0.0:1788872961.258849:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+130:73602:x1875765311259136:12345-192.168.204.39@tcp:101:touch.0 Request processed in 258us (18190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872961.258856:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1526 00000100:00100000:3.0:1788872961.268265:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.268480:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311259264 00000100:00100000:0.0:1788872961.268490:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311259264 00000100:00100000:0.0:1788872961.268543:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6032 00000100:00100000:0.0:1788872961.268571:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+22:2404:x1875765311259264:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:0.0:1788872961.268854:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+23:2404:x1875765311259264:12345-192.168.204.39@tcp:2:touch.0 Request processed in 284us (596us total) trans 4294969476 rc 0/0 00000100:00100000:0.0:1788872961.268864:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6032 00000100:00100000:1.0:1788872961.291745:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872961.292355:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311259520 00000100:00100000:3.0:1788872961.292365:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311259520 00000100:00100000:3.0:1788872961.292431:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 263 00000100:00100000:3.0:1788872961.292441:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfc03850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+130:73602:x1875765311259520:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:3.0:1788872961.293506:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfc03850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+131:73602:x1875765311259520:12345-192.168.204.39@tcp:35:touch.0 Request processed in 330us (1034us total) trans 124554051645 rc 0/0 00000100:00100000:3.0:1788872961.293517:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 263 00000100:00100000:1.0:1788872961.302315:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.302494:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311259776 00000100:00100000:0.0:1788872961.302505:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311259776 00000100:00100000:0.0:1788872961.302596:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1527 00000100:00100000:0.0:1788872961.302607:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+131:73602:x1875765311259776:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872961.302633:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872961.302655:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc033 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb381 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.302775:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc03a lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.302796:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc03a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.302807:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc03a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.302823:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01dc041 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.302831:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01dc041 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.302837:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01dc041 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788872961.303196:0:66192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x395:0x0], index 0: 0 00010000:00010000:0.0:1788872961.303327:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc048 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.303337:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc048 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.303345:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc048 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.305114:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc03a lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.305128:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc03a lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.305134:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc03a lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.306214:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc03a lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.306224:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872961.306229:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc03a lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.306238:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc03a lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.306254:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872961.306257:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872961.306262:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc03a lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.306269:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc03a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788872961.306287:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001cfcb4bb reply state 00000000eab45f1b transno 124554051646 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01dc041 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.306299:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01dc041 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.306307:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff98a9c5daa900) 00010000:00010000:0.0:1788872961.306309:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872961.306313:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788872961.307642:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc033 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb381 expref: 134 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.307670:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc048 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb381 expref: 133 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.307705:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff98a9c5daa200) 00010000:00010000:0.0:1788872961.307708:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872961.307711:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4c00, rc 0) 00000100:00100000:0.0:1788872961.309191:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+134:73602:x1875765311259776:12345-192.168.204.39@tcp:101:touch.0 Request processed in 6578us (6878us total) trans 124554051646 rc 0/0 00000100:00100000:0.0:1788872961.309202:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1527 00000100:00100000:0.0:1788872961.316193:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872961.321631:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311260032 00000100:00100000:2.0:1788872961.321645:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311260032 00000100:00100000:2.0:1788872961.321730:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1528 00000100:00100000:2.0:1788872961.321742:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+134:73602:x1875765311260032:12345-192.168.204.39@tcp:36:touch.0 00010000:00010000:2.0:1788872961.322416:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872961.322692:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc048 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb381 expref: 134 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.322713:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff98a9c5daa200) 00010000:00010000:2.0:1788872961.322725:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872961.323070:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc056 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.323088:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc056 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.323098:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc056 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872961.323215:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dba248bd reply state 000000004ba78260 transno 124554051647 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc056 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.323227:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc056 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872961.323234:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff98a9faf66000) 00010000:00010000:2.0:1788872961.323237:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872961.323240:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872961.324764:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+135:73602:x1875765311260032:12345-192.168.204.39@tcp:36:touch.0 Request processed in 3017us (8571us total) trans 124554051647 rc 0/0 00000100:00100000:2.0:1788872961.324775:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1528 00010000:00010000:2.0:1788872961.339581:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872961.357403:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.358001:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311260160 00000100:00100000:0.0:1788872961.358012:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311260160 00000100:00100000:0.0:1788872961.358073:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1529 00000100:00100000:0.0:1788872961.358083:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+135:73602:x1875765311260160:12345-192.168.204.39@tcp:101:touch.0 00010000:00010000:0.0:1788872961.358107:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872961.358129:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5200/0xe4e6e89fb01dc05d lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb388 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.358200:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5200/0xe4e6e89fb01dc05d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb388 expref: 136 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.358215:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5200/0xe4e6e89fb01dc05d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb388 expref: 136 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872961.358232:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff98a9faf66000) 00010000:00010000:0.0:1788872961.358235:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788872961.358238:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5200, rc 0) 00000100:00100000:0.0:1788872961.358303:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+136:73602:x1875765311260160:12345-192.168.204.39@tcp:101:touch.0 Request processed in 222us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872961.358322:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1529 00000100:00100000:1.0:1788872961.367835:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872961.368351:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311260288 00000100:00100000:2.0:1788872961.368363:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311260288 00000100:00100000:2.0:1788872961.368437:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6033 00000100:00100000:2.0:1788872961.368448:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0804304d-5904-48ad-87f2-bcbc7642a62a+23:2405:x1875765311260288:12345-192.168.204.39@tcp:2:touch.0 00000100:00100000:2.0:1788872961.368699:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0804304d-5904-48ad-87f2-bcbc7642a62a+24:2405:x1875765311260288:12345-192.168.204.39@tcp:2:touch.0 Request processed in 252us (875us total) trans 4294969477 rc 0/0 00000100:00100000:2.0:1788872961.368707:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6033 00000100:00100000:1.0:1788872961.389348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872961.389749:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311260544 00000100:00100000:0.0:1788872961.389759:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311260544 00000100:00100000:0.0:1788872961.389835:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 264 00000100:00100000:0.0:1788872961.389845:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+136:73602:x1875765311260544:12345-192.168.204.39@tcp:35:touch.0 00000100:00100000:0.0:1788872961.390129:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+137:73602:x1875765311260544:12345-192.168.204.39@tcp:35:touch.0 Request processed in 285us (790us total) trans 124554051648 rc 0/0 00000100:00100000:0.0:1788872961.390137:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 264 00000100:00100000:0.0:1788872961.721003:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327875712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872961.721076:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872961.721195:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327875712 00000100:00100000:2.0:1788872961.721204:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327875712 00000100:00100000:2.0:1788872961.721278:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2231 00000100:00100000:2.0:1788872961.721288:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327875712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872961.721311:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872961.721371:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327875712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872961.721379:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2231 00000100:00100000:2.0:1788872961.721423:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327875712:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788872961.721625:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872961.721924:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327875840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872961.721958:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872961.722042:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327875840 00000100:00100000:0.0:1788872961.722047:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327875840 00000100:00100000:0.0:1788872961.722083:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2232 00000100:00100000:0.0:1788872961.722089:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327875840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872961.722109:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872961.722147:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327875840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872961.722153:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2232 00000100:00080000:3.0:1788872961.723688:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872961.723741:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327875840:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788872962.360848:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872963.257067:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327875968:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257159:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257214:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327876480:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257276:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327876992:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257323:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327877504:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257365:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788872963.257370:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327876096:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257409:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257425:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327876608:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257462:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327877120:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257481:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257507:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327876224:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257530:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257544:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327876736:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257603:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257620:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327877248:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257654:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257674:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788872963.257679:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327876352:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257701:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257717:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f09f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327876864:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257738:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257754:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327877376:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.257776:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.257807:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327876736 00000100:00100000:2.0:1788872963.257815:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327876736 00000100:00100000:2.0:1788872963.257871:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327877248 00000100:00100000:2.0:1788872963.257874:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327877248 00000100:00100000:2.0:1788872963.257893:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327876864 00000100:00100000:2.0:1788872963.257896:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327876864 00000100:00100000:2.0:1788872963.257915:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327877376 00000100:00100000:2.0:1788872963.257919:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327877376 00000100:00100000:2.0:1788872963.257953:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764 00000100:00100000:2.0:1788872963.257962:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327876736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258015:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327876736:12345-0@lo:400:kworker.0 Request processed in 54us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.258022:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764 00000100:00100000:2.0:1788872963.258039:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765 00000100:00100000:2.0:1788872963.258045:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327877248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258070:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875765327877248:12345-0@lo:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.258077:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765 00000100:00100000:2.0:1788872963.258087:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766 00000100:00100000:2.0:1788872963.258093:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327876864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258116:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327876864:12345-0@lo:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.258122:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766 00000100:00100000:2.0:1788872963.258132:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767 00000100:00100000:2.0:1788872963.258138:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327877376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258161:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327877376:12345-0@lo:400:kworker.0 Request processed in 24us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.258166:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767 00000100:00100000:2.0:1788872963.258208:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f09f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327876864:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258220:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327877376:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258228:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327876736:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258238:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327877248:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258287:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327876480 00000100:00100000:2.0:1788872963.258291:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327876480 00000100:00100000:2.0:1788872963.258314:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327876992 00000100:00100000:2.0:1788872963.258316:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327876992 00000100:00100000:2.0:1788872963.258327:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327877504 00000100:00100000:2.0:1788872963.258329:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327877504 00000100:00100000:2.0:1788872963.258338:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327876096 00000100:00100000:2.0:1788872963.258340:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327876096 00000100:00100000:2.0:1788872963.258352:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327876224 00000100:00100000:2.0:1788872963.258355:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327876224 00000100:00100000:2.0:1788872963.258365:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327876352 00000100:00100000:2.0:1788872963.258367:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327876352 00000100:00100000:2.0:1788872963.258378:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:2.0:1788872963.258383:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327876480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258422:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327876480:12345-0@lo:400:kworker.0 Request processed in 38us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.258428:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:2.0:1788872963.258439:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1788872963.258444:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327876992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258471:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327876992:12345-0@lo:400:kworker.0 Request processed in 27us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.258476:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1788872963.258487:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:2.0:1788872963.258493:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327877504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258518:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327877504:12345-0@lo:400:kworker.0 Request processed in 26us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.258523:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:2.0:1788872963.258534:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:2.0:1788872963.258546:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327876096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258603:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327876096:12345-0@lo:400:kworker.0 Request processed in 56us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.258610:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:2.0:1788872963.258623:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:2.0:1788872963.258629:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327876224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258674:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327876224:12345-0@lo:400:kworker.0 Request processed in 45us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.258680:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:2.0:1788872963.258691:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:2.0:1788872963.258697:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327876352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258723:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327876352:12345-0@lo:400:kworker.0 Request processed in 27us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.258729:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:2.0:1788872963.258754:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327876096:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258768:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327876480:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258779:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327876992:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258790:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327877504:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258819:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327876352:0@lo:400:kworker.0 00000100:00100000:2.0:1788872963.258829:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327876224:0@lo:400:kworker.0 00000100:00100000:0.0:1788872963.259107:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327875968 00000100:00100000:0.0:1788872963.259113:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327875968 00000100:00100000:0.0:1788872963.259157:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788872963.259164:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327875968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872963.259233:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327875968:12345-0@lo:400:kworker.0 Request processed in 69us (2073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872963.259239:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788872963.259308:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327876608 00000100:00100000:0.0:1788872963.259312:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327876608 00000100:00100000:0.0:1788872963.259336:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327877120 00000100:00100000:0.0:1788872963.259339:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327877120 00000100:00100000:0.0:1788872963.259356:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4061 00000100:00100000:0.0:1788872963.259361:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327876608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872963.259397:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327876608:12345-0@lo:400:kworker.0 Request processed in 36us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872963.259403:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4061 00000100:00100000:0.0:1788872963.259414:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4062 00000100:00100000:0.0:1788872963.259420:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327877120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872963.259450:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327877120:12345-0@lo:400:kworker.0 Request processed in 31us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872963.259455:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4062 00000100:00100000:0.0:1788872963.259497:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327876608:0@lo:400:kworker.0 00000100:00100000:0.0:1788872963.259509:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327877120:0@lo:400:kworker.0 00000100:00100000:0.0:1788872963.259517:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327875968:0@lo:400:kworker.0 00000100:00100000:3.0:1788872963.259785:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327877632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872963.259824:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872963.259879:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327877632 00000100:00100000:3.0:1788872963.259883:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327877632 00000100:00100000:3.0:1788872963.259909:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4063 00000100:00100000:3.0:1788872963.259915:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327877632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788872963.259947:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1788872963.260002:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c7830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327877632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872963.260008:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4063 00000100:00080000:3.0:1788872963.260033:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872963.260039:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872963.260043:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872963.260045:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872963.260068:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327877632:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788872963.391225:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872963.768978:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872963.769002:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327877760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872963.769067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872963.769112:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327877760 00000100:00100000:2.0:1788872963.769241:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327877888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872963.769271:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.769317:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327877888 00000100:00100000:2.0:1788872963.769324:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327877888 00000100:00100000:2.0:1788872963.769361:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233 00000100:00100000:2.0:1788872963.769370:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327877888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872963.769400:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872963.769445:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327877888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.769451:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233 00000100:00100000:2.0:1788872963.769509:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327877888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872963.769748:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327877760 00000100:00100000:1.0:1788872963.769929:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327878016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872963.769963:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872963.770146:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4064 00000100:00100000:2.0:1788872963.770153:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327877760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872963.770176:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:2.0:1788872963.770214:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327877760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.770220:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4064 00000100:00100000:2.0:1788872963.770258:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c3a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327877760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872963.770425:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327878016 00000100:00100000:0.0:1788872963.770430:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327878016 00000100:00100000:0.0:1788872963.770463:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2234 00000100:00100000:0.0:1788872963.770471:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327878016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872963.770498:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788872963.770579:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875765327878016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872963.770586:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2234 00000100:00100000:2.0:1788872963.770801:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327878016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788872963.849412:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872963.849467:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872963.849519:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872963.849591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872963.849619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872963.849660:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311261056 00000100:00100000:1.0:1788872963.849672:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311261056 00000100:00100000:1.0:1788872963.849731:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311261184 00000100:00100000:1.0:1788872963.849734:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311261184 00000100:00100000:1.0:1788872963.849771:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2768 00000100:00100000:1.0:1788872963.849782:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+24:2406:x1875765311261056:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872963.849859:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+24:2406:x1875765311261056:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 78us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872963.849867:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2768 00000100:00100000:1.0:1788872963.849884:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2769 00000100:00100000:1.0:1788872963.849890:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2406:x1875765311261184:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788872963.849914:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2406:x1875765311261184:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 24us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872963.849920:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2769 00000100:00080000:3.0:1788872963.850227:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872963.850233:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788872963.851405:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311260672 00000100:00100000:0.0:1788872963.851417:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311260672 00000100:00100000:0.0:1788872963.851488:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 182 00000100:00100000:0.0:1788872963.851498:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311260672:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872963.851593:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311260672:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 97us (2073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872963.851601:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 182 00000100:00100000:2.0:1788872963.852401:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311260800 00000100:00100000:2.0:1788872963.852409:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311260800 00000100:00100000:2.0:1788872963.852470:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311260928 00000100:00100000:2.0:1788872963.852474:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311260928 00000100:00100000:2.0:1788872963.852498:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1500 00000100:00100000:2.0:1788872963.852507:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+137:2406:x1875765311260800:12345-192.168.204.39@tcp:400:kworker.0 00000100:00080000:3.0:1788872963.852566:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872963.852570:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788872963.852578:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+137:2406:x1875765311260800:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 73us (3177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.852601:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1500 00000100:00100000:2.0:1788872963.852617:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1501 00000100:00100000:2.0:1788872963.852623:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2406:x1875765311260928:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872963.852664:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2406:x1875765311260928:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 41us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872963.852670:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1501 00000100:00100000:1.0:1788872964.088921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872964.089056:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311261312 00000100:00100000:2.0:1788872964.089067:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311261312 00000100:00100000:2.0:1788872964.089131:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1530 00000100:00100000:2.0:1788872964.089141:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+137:73630:x1875765311261312:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:2.0:1788872964.089181:0:66190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:2.0:1788872964.089266:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+137:73630:x1875765311261312:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 124us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872964.089274:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1530 00000100:00100000:1.0:1788872964.110823:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872964.110983:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311261440 00000100:00100000:3.0:1788872964.110994:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311261440 00000100:00100000:3.0:1788872964.111053:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1531 00000100:00100000:3.0:1788872964.111064:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+11:73630:x1875765311261440:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872964.111103:0:83669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1788872964.111183:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+11:73630:x1875765311261440:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 122us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872964.111191:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1531 00000100:00100000:0.0:1788872964.123610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872964.141893:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311261568 00000100:00100000:2.0:1788872964.141908:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311261568 00000100:00100000:2.0:1788872964.142032:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2235 00000100:00100000:2.0:1788872964.142044:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+24:73630:x1875765311261568:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:2.0:1788872964.142071:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872964.142162:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+24:73630:x1875765311261568:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 120us (18559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872964.142170:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2235 00000100:00100000:1.0:1788872964.152834:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872964.168405:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311261696 00000100:00100000:0.0:1788872964.168419:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311261696 00000100:00100000:0.0:1788872964.170230:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2236 00000100:00100000:0.0:1788872964.170776:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+7:73630:x1875765311261696:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:0.0:1788872964.170814:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872964.170899:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+7:73630:x1875765311261696:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 135us (18074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872964.203100:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2236 00010000:00010000:0.0:1788872964.411489:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872965.435594:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788872965.445068:0:94370:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051648 is committed 00010000:00010000:1.0:1788872965.447720:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b800/0xe4e6e89fb01dbc04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447742:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b800/0xe4e6e89fb01dbc04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447750:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b800/0xe4e6e89fb01dbc04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447756:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449b800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.447761:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b800/0xe4e6e89fb01dbc04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447770:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b800/0xe4e6e89fb01dbc04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447789:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff98a9c5d04800) 00010000:00010000:1.0:1788872965.447792:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.447797:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b800/0xe4e6e89fb01dbc04 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447804:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b800/0xe4e6e89fb01dbc04 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447832:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a200/0xe4e6e89fb01dbc0b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447839:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a200/0xe4e6e89fb01dbc0b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447845:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a200/0xe4e6e89fb01dbc0b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447868:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1a200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.447872:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a200/0xe4e6e89fb01dbc0b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447878:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a200/0xe4e6e89fb01dbc0b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447886:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872965.447889:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.447892:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a200/0xe4e6e89fb01dbc0b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447898:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a200/0xe4e6e89fb01dbc0b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447913:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc66 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447919:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc66 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447925:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc66 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447929:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.447931:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc66 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447936:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc66 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447955:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872965.447957:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788872965.447959:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc66 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447965:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4000/0xe4e6e89fb01dbc66 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447978:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dbc97 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447985:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dbc97 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447989:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dbc97 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.447993:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aec00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.447996:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dbc97 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448002:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dbc97 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448009:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff98a9e1f8fe00) 00010000:00010000:1.0:1788872965.448012:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.448015:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dbc97 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448020:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dbc97 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448044:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbcac lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448050:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbcac lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448055:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbcac lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448060:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.448063:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbcac lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448068:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbcac lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448077:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff98a9f016a800) 00010000:00010000:1.0:1788872965.448079:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.448082:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbcac lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448087:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5600/0xe4e6e89fb01dbcac lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448098:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5a00/0xe4e6e89fb01dbccf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448103:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5a00/0xe4e6e89fb01dbccf lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448109:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5a00/0xe4e6e89fb01dbccf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448119:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.448123:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5a00/0xe4e6e89fb01dbccf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448129:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5a00/0xe4e6e89fb01dbccf lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448137:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff98a9f016a500) 00010000:00010000:1.0:1788872965.448140:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.448142:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5a00/0xe4e6e89fb01dbccf lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448149:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5a00/0xe4e6e89fb01dbccf lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448164:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbce4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448170:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbce4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448177:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbce4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448183:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.448187:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbce4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448195:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbce4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448216:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff98a9f016a700) 00010000:00010000:1.0:1788872965.448218:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.448221:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbce4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448228:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4c00/0xe4e6e89fb01dbce4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448242:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a200/0xe4e6e89fb01dbd00 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448249:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a200/0xe4e6e89fb01dbd00 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448255:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a200/0xe4e6e89fb01dbd00 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.448261:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c449a200 already unused, calling callback (ffffffffc19d74f0) 00000001:00080000:2.0:1788872965.448384:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969477 is committed 00000001:00080000:2.0:1788872965.448428:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969473 is committed 00010000:00010000:1.0:1788872965.449708:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a200/0xe4e6e89fb01dbd00 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449721:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a200/0xe4e6e89fb01dbd00 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449742:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff98a9c5d04a00) 00010000:00010000:1.0:1788872965.449746:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.449752:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a200/0xe4e6e89fb01dbd00 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449759:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449a200/0xe4e6e89fb01dbd00 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449827:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbd15 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449834:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbd15 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449842:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbd15 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449849:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.449853:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbd15 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449859:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbd15 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449869:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff98a9f016a300) 00010000:00010000:1.0:1788872965.449872:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.449875:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbd15 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449881:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4400/0xe4e6e89fb01dbd15 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449900:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4200/0xe4e6e89fb01dbd31 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449906:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4200/0xe4e6e89fb01dbd31 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449912:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4200/0xe4e6e89fb01dbd31 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449923:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.449927:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4200/0xe4e6e89fb01dbd31 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449933:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4200/0xe4e6e89fb01dbd31 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449942:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff98a9f016a600) 00010000:00010000:1.0:1788872965.449944:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.449947:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4200/0xe4e6e89fb01dbd31 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449952:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4200/0xe4e6e89fb01dbd31 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449968:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ba00/0xe4e6e89fb01dbd46 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449973:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ba00/0xe4e6e89fb01dbd46 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449979:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ba00/0xe4e6e89fb01dbd46 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449984:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1ba00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.449987:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ba00/0xe4e6e89fb01dbd46 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.449993:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ba00/0xe4e6e89fb01dbd46 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450013:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff98a9c1358200) 00010000:00010000:1.0:1788872965.450014:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.450018:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ba00/0xe4e6e89fb01dbd46 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450024:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1ba00/0xe4e6e89fb01dbd46 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450037:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dbd62 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450042:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dbd62 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450049:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dbd62 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450054:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58afc00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.450058:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dbd62 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450064:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dbd62 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450072:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff98a9e1f8f800) 00010000:00010000:1.0:1788872965.450074:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.450077:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dbd62 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450083:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dbd62 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450108:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dbd77 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450115:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dbd77 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450122:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dbd77 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450127:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.450130:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dbd77 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450135:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dbd77 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450143:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff98a9e1f8f400) 00010000:00010000:1.0:1788872965.450146:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.450149:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dbd77 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450154:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dbd77 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450165:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd93 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450170:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd93 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450175:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd93 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450186:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.450190:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd93 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450196:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd93 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450205:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff98a9f016af00) 00010000:00010000:1.0:1788872965.450208:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.450210:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd93 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450217:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5c00/0xe4e6e89fb01dbd93 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450237:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbda8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450243:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbda8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450248:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbda8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450253:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.450256:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbda8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450262:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbda8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450280:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff98a9f016ad00) 00010000:00010000:1.0:1788872965.450282:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.450285:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbda8 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450290:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5200/0xe4e6e89fb01dbda8 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450301:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1b800/0xe4e6e89fb01dbdc4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450308:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1b800/0xe4e6e89fb01dbdc4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450312:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1b800/0xe4e6e89fb01dbdc4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450317:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1b800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.450319:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1b800/0xe4e6e89fb01dbdc4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450324:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1b800/0xe4e6e89fb01dbdc4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450330:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff98a9c1358000) 00010000:00010000:1.0:1788872965.450332:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.450335:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1b800/0xe4e6e89fb01dbdc4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450340:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1b800/0xe4e6e89fb01dbdc4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450364:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbdd9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450370:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbdd9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450375:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbdd9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450380:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a5800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.450383:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbdd9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450389:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbdd9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450397:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff98a9f016a000) 00010000:00010000:1.0:1788872965.450400:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.450402:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbdd9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450407:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a5800/0xe4e6e89fb01dbdd9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450417:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdf5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450422:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdf5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450427:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdf5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450438:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1a000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.450442:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdf5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450448:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdf5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450456:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff98a9c1358400) 00010000:00010000:1.0:1788872965.450458:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.450461:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdf5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450467:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1a000/0xe4e6e89fb01dbdf5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450482:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbe0a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450488:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbe0a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.450494:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbe0a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.453945:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.453956:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbe0a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.453968:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbe0a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454009:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff98a9f016ab00) 00010000:00010000:1.0:1788872965.454013:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.454017:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbe0a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454023:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4a00/0xe4e6e89fb01dbe0a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454050:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9da00/0xe4e6e89fb01dbe26 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454057:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9da00/0xe4e6e89fb01dbe26 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454063:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9da00/0xe4e6e89fb01dbe26 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454067:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9da00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.454071:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9da00/0xe4e6e89fb01dbe26 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454077:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9da00/0xe4e6e89fb01dbe26 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454084:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff98a9f016ac00) 00010000:00010000:1.0:1788872965.454086:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.454089:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9da00/0xe4e6e89fb01dbe26 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454095:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9da00/0xe4e6e89fb01dbe26 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454125:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dbe3b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454132:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dbe3b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454151:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dbe3b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454155:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ce00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.454158:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dbe3b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454164:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dbe3b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454172:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff98a9f016aa00) 00010000:00010000:1.0:1788872965.454174:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.454177:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dbe3b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454183:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ce00/0xe4e6e89fb01dbe3b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454194:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dbe57 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454201:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dbe57 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454206:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dbe57 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454218:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.454221:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dbe57 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454227:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dbe57 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454236:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff98a9c1358700) 00010000:00010000:1.0:1788872965.454239:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.454241:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dbe57 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454247:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dbe57 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454264:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbe6c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454270:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbe6c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454275:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbe6c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454280:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.454283:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbe6c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454290:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbe6c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454310:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff98a9e1f8fb00) 00010000:00010000:1.0:1788872965.454312:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.454315:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbe6c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454320:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dbe6c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454334:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbe88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454341:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbe88 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454346:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbe88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454352:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.454355:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbe88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454361:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbe88 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.454368:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff98a9c1358300) 00010000:00010000:1.0:1788872965.456156:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.456167:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbe88 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456179:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dbe88 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456233:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dbe9d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456240:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dbe9d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456247:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dbe9d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456255:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.456260:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dbe9d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456268:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dbe9d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456282:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:1.0:1788872965.456285:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.456287:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dbe9d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456293:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dbe9d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456304:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbeb9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456310:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbeb9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456317:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbeb9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456329:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.456332:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbeb9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456338:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbeb9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456347:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff98a9c1358a00) 00010000:00010000:1.0:1788872965.456350:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.456353:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbeb9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456358:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dbeb9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456373:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbece lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456380:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbece lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456385:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbece lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456390:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aee00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.456393:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbece lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456398:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbece lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456417:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff98a9e1f8f100) 00010000:00010000:1.0:1788872965.456419:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.456422:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbece lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456428:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dbece lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456442:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbeea lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456448:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbeea lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456453:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbeea lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456458:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aea00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.456461:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbeea lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456467:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbeea lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456474:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff98a9c5daa100) 00010000:00010000:1.0:1788872965.456477:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.456479:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbeea lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456485:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aea00/0xe4e6e89fb01dbeea lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456508:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dbeff lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456514:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dbeff lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456520:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dbeff lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456526:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.456529:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dbeff lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456535:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dbeff lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456543:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff98a9c5d04c00) 00010000:00010000:1.0:1788872965.456546:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.456566:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dbeff lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456573:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8400/0xe4e6e89fb01dbeff lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456586:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbf1b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456592:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbf1b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456610:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbf1b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456622:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.456625:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbf1b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456631:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbf1b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456638:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff98a9c1358500) 00010000:00010000:1.0:1788872965.456640:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.456643:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbf1b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456649:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dbf1b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456664:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbf30 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456670:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbf30 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456675:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbf30 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456679:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1aa00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.456682:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbf30 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456688:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbf30 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456706:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff98a9c1358d00) 00010000:00010000:1.0:1788872965.456709:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.456711:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbf30 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456716:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1aa00/0xe4e6e89fb01dbf30 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456727:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbf4c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456732:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbf4c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456738:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbf4c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456742:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.456745:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbf4c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456750:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbf4c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456757:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff98a9c5daa400) 00010000:00010000:1.0:1788872965.456759:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.456761:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbf4c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.456766:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dbf4c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460414:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbf61 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460431:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbf61 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460440:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbf61 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460446:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1be00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.460451:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbf61 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460459:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbf61 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460476:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff98a9c1358f00) 00010000:00010000:1.0:1788872965.460480:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.460485:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbf61 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460492:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9caa1be00/0xe4e6e89fb01dbf61 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460516:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf7d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460524:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf7d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460530:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf7d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460562:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.460566:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf7d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460572:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf7d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460579:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff98a9faf66d00) 00010000:00010000:1.0:1788872965.460582:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.460584:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf7d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460590:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dbf7d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460621:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dbf92 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460628:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dbf92 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460635:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dbf92 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460640:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9d400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.460643:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dbf92 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460648:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dbf92 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460667:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff98a9f016ae00) 00010000:00010000:1.0:1788872965.460670:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.460673:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dbf92 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460679:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9d400/0xe4e6e89fb01dbf92 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460692:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dbfae lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460699:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dbfae lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460704:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dbfae lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460709:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4499400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.460711:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dbfae lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460717:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dbfae lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460725:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff98a9faf66600) 00010000:00010000:1.0:1788872965.460727:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.460729:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dbfae lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460735:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dbfae lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460754:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbfc3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460760:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbfc3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460765:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbfc3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460771:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.460774:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbfc3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460780:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbfc3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460787:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff98a9c5daa000) 00010000:00010000:1.0:1788872965.460790:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.460792:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbfc3 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460798:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dbfc3 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460807:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbfdf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460813:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbfdf lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460819:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbfdf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460829:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.460832:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbfdf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460839:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbfdf lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460847:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff98a9c5daac00) 00010000:00010000:1.0:1788872965.460850:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.460853:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbfdf lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460859:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dbfdf lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460876:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dbff4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460882:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dbff4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460889:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dbff4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460894:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9ca00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.460897:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dbff4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460902:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dbff4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460922:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff98a9f016a400) 00010000:00010000:1.0:1788872965.460924:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.460927:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dbff4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460933:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4f9ca00/0xe4e6e89fb01dbff4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460945:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dc010 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460953:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dc010 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460959:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dc010 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460964:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98aa002a4800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.460967:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dc010 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460972:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dc010 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460980:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff98a9f016a100) 00010000:00010000:1.0:1788872965.460982:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.460984:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dc010 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.460990:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98aa002a4800/0xe4e6e89fb01dc010 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461017:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc025 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461023:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc025 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461029:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc025 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461034:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4498e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.461037:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc025 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461044:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc025 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461052:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff98a9faf66700) 00010000:00010000:1.0:1788872965.461054:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.461057:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc025 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461063:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc025 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461073:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01dc041 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461078:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01dc041 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461084:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01dc041 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461095:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.461099:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01dc041 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461105:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01dc041 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461114:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff98a9c5daa900) 00010000:00010000:1.0:1788872965.461116:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.461119:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01dc041 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461125:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4800/0xe4e6e89fb01dc041 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461775:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc056 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461784:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc056 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461791:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc056 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461796:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4499c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872965.461800:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc056 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461806:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc056 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461828:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff98a9faf66000) 00010000:00010000:1.0:1788872965.461830:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872965.461834:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc056 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872965.461840:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc056 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872965.610008:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872965.613573:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311261824 00000100:00100000:2.0:1788872965.613604:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311261824 00000100:00100000:2.0:1788872965.613699:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1532 00000100:00100000:2.0:1788872965.613714:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+31:73665:x1875765311261824:12345-192.168.204.39@tcp:41:lfs.0 00000100:00080000:3.0:1788872965.613757:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1788872965.613770:0:68674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:2.0:1788872965.613894:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+31:73665:x1875765311261824:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 184us (3902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872965.613903:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1532 00000100:00100000:2.0:1788872965.625694:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872965.626927:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311261952 00000100:00100000:3.0:1788872965.626945:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311261952 00000100:00100000:3.0:1788872965.627048:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1533 00000100:00100000:3.0:1788872965.627081:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+11:73665:x1875765311261952:12345-192.168.204.39@tcp:41:lfs.0 00000004:00000024:3.0:1788872965.627133:0:66190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1788872965.627240:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+11:73665:x1875765311261952:12345-192.168.204.39@tcp:41:lfs.0 Request processed in 164us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872965.627250:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1533 00000100:00080000:2.0:1788872965.627803:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788872965.635277:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872965.635368:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311262080 00000100:00100000:2.0:1788872965.635382:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311262080 00000100:00100000:2.0:1788872965.635486:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2237 00000100:00100000:2.0:1788872965.635499:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+5:73665:x1875765311262080:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:2.0:1788872965.635608:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872965.635716:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+5:73665:x1875765311262080:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 219us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872965.635726:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2237 00000100:00080000:3.0:1788872965.635799:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872965.641218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872965.642159:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311262208 00000100:00100000:1.0:1788872965.642179:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311262208 00000100:00100000:1.0:1788872965.642279:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2238 00000100:00100000:1.0:1788872965.642296:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+7:73665:x1875765311262208:12345-192.168.204.39@tcp:13:lfs.0 00002000:00000024:1.0:1788872965.642350:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872965.642469:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0804304d-5904-48ad-87f2-bcbc7642a62a+7:73665:x1875765311262208:12345-192.168.204.39@tcp:13:lfs.0 Request processed in 179us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872965.642477:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2238 00000100:00080000:3.0:1788872965.642813:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872965.773521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872965.773697:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311262464 00000100:00100000:3.0:1788872965.773709:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311262464 00000100:00100000:3.0:1788872965.773848:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1534 00000100:00100000:3.0:1788872965.773860:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+31:73672:x1875765311262464:12345-192.168.204.39@tcp:36:mcreate.0 00010000:00010000:3.0:1788872965.773926:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788872965.773956:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c449b400/0xe4e6e89fb01dbc43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb262 expref: 31 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.773977:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:3.0:1788872965.773982:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872965.774056:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01dc064 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774072:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01dc064 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774082:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01dc064 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774098:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dc06b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774117:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dc06b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774125:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dc06b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774543:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01dc064 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774586:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01dc064 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774602:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01dc064 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774609:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872965.774613:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01dc064 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774621:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01dc064 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774630:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:3.0:1788872965.774633:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872965.774636:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01dc064 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774643:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9e00/0xe4e6e89fb01dc064 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788872965.774653:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001f64f759 reply state 00000000aa72070e transno 124554051649 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dc06b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774673:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dc06b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.774680:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5d04900) 00010000:00010000:3.0:1788872965.774682:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788872965.774686:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788872965.774784:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+32:73672:x1875765311262464:12345-192.168.204.39@tcp:36:mcreate.0 Request processed in 926us (1274us total) trans 124554051649 rc 0/0 00000100:00100000:3.0:1788872965.774798:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1534 00000100:00100000:1.0:1788872965.838395:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872965.838542:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311262592 00000100:00100000:0.0:1788872965.838608:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311262592 00000100:00100000:0.0:1788872965.838704:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1535 00000100:00100000:0.0:1788872965.838719:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+32:73675:x1875765311262592:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:0.0:1788872965.838760:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872965.838795:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb38f expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872965.838893:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01dc079 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872965.838934:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01dc079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872965.838949:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01dc079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872965.839025:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788872965.839030:0:66192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788872965.839055:0:66192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01dc079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872965.839091:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb38f expref: 34 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872965.839114:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01dc079 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb38f expref: 33 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872965.839125:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:0.0:1788872965.839129:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788872965.839132:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5800, rc 0) 00000100:00100000:0.0:1788872965.839206:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+33:73675:x1875765311262592:12345-192.168.204.39@tcp:101:rm.0 Request processed in 492us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872965.839213:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1535 00000100:00100000:1.0:1788872965.841739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872965.841841:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311262720 00000100:00100000:3.0:1788872965.841858:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311262720 00000100:00100000:2.0:1788872965.843412:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1536 00000100:00100000:2.0:1788872965.843428:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+33:73675:x1875765311262720:12345-192.168.204.39@tcp:101:rm.0 00010000:00010000:2.0:1788872965.843451:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872965.843477:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb396 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843567:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc087 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843611:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc087 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843623:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc087 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843636:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc08e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843643:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc08e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843651:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc08e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843738:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499a00/0xe4e6e89fb01dc095 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843747:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499a00/0xe4e6e89fb01dc095 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843754:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499a00/0xe4e6e89fb01dc095 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872965.843793:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1a:0x0]: returning size 0 00000004:00200000:2.0:1788872965.843797:0:66190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788872965.843817:0:66190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499a00/0xe4e6e89fb01dc095 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843830:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499a00/0xe4e6e89fb01dc095 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843850:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc087 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843857:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc087 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843862:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc087 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843869:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc087 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843874:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4498a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872965.843878:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc087 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843886:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc087 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843898:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:2.0:1788872965.843902:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872965.843907:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc087 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843913:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc087 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843928:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc08e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843933:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc08e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843945:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc08e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843950:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4499e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872965.843953:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc08e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843959:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc08e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843967:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5d04900) 00010000:00010000:2.0:1788872965.843970:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872965.843973:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc08e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.843978:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc08e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.844003:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb396 expref: 35 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.844016:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499a00/0xe4e6e89fb01dc095 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb396 expref: 34 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.844023:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff98a9faf66e00) 00010000:00010000:2.0:1788872965.844025:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872965.844028:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4499a00, rc 0) 00000100:00100000:2.0:1788872965.844107:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+34:73675:x1875765311262720:12345-192.168.204.39@tcp:101:rm.0 Request processed in 682us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872965.844125:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1536 00000100:00100000:1.0:1788872965.853358:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872965.853533:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311262976 00000100:00100000:2.0:1788872965.853543:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311262976 00000100:00100000:2.0:1788872965.853624:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1537 00000100:00100000:2.0:1788872965.853635:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+34:73675:x1875765311262976:12345-192.168.204.39@tcp:36:rm.0 00010000:00010000:2.0:1788872965.853693:0:66193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788872965.853722:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499a00/0xe4e6e89fb01dc095 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb396 expref: 34 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.853740:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff98a9faf66e00) 00010000:00010000:2.0:1788872965.853756:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01dc079 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb38f expref: 33 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.853766:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:2.0:1788872965.853770:0:66193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872965.853791:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc09c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.853808:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc09c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.853818:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc09c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.853830:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc0a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.853838:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc0a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.853862:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc0a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.853943:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc0aa lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.853952:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc0aa lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.853959:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc0aa lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.855433:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc0b1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.855452:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc0b1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.855462:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc0b1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.855471:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc0b1 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.855479:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc0b1 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.855486:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc0b1 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856060:0:66193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872965.856091:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc0aa lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856110:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc0aa lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856118:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc0aa lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856124:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4498a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872965.856129:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc0aa lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856137:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc0aa lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856149:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff98a9faf66900) 00010000:00010000:2.0:1788872965.856152:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788872965.856156:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc0aa lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856163:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc0aa lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856183:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc09c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856189:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc09c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856193:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc09c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856198:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc09c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856219:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4498200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872965.856222:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc09c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856227:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc09c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856235:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:2.0:1788872965.856237:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872965.856240:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc09c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856246:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc09c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788872965.856256:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f84948ed reply state 00000000f4648263 transno 124554051650 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc0a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856268:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc0a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872965.856275:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5d04900) 00010000:00010000:2.0:1788872965.856278:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872965.856281:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872965.856379:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+34:73675:x1875765311262976:12345-192.168.204.39@tcp:36:rm.0 Request processed in 2735us (3019us total) trans 124554051650 rc 0/0 00000100:00100000:2.0:1788872965.856389:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1537 00010000:00010000:3.0:1788872965.861448:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872965.861466:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc0b1 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.861479:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4499000 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:3.0:1788872965.861484:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc0b1 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.861494:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc0b1 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.861516:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff98a9faf66900) 00010000:00010000:3.0:1788872965.861519:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788872965.861524:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc0b1 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872965.861531:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc0b1 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872965.862063:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872965.862066:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872965.862068:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872966.461091:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872966.841300:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f080bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327878144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788872966.841383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872966.841490:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327878144 00000100:00100000:2.0:1788872966.841498:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327878144 00000100:00100000:2.0:1788872966.841596:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239 00000100:00100000:2.0:1788872966.841623:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327878144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788872966.841649:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788872966.841696:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327878144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872966.841703:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239 00000100:00100000:2.0:1788872966.841760:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f080bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327878144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788872966.842356:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c1eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327878272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788872966.842396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872966.842469:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327878272 00000100:00100000:0.0:1788872966.842474:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327878272 00000100:00100000:0.0:1788872966.842524:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2240 00000100:00100000:0.0:1788872966.842531:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327878272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872966.842544:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788872966.842623:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327878272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872966.842630:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2240 00000100:00100000:0.0:1788872966.842663:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c1eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327878272:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788872966.842976:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872966.842980:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788872967.486608:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872968.380512:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872968.380577:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327878400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872968.380652:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872968.380908:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327878400 00000100:00100000:3.0:1788872968.380917:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327878400 00000100:00100000:3.0:1788872968.380966:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4065 00000100:00100000:3.0:1788872968.380976:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327878400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788872968.381015:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1788872968.381066:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327878400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872968.381074:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4065 00000100:00100000:3.0:1788872968.381394:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327878912:0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.381428:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872968.381449:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327879424:0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.381473:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872968.381488:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327879936:0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.381508:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872968.381528:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788872968.381533:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327878784:0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.381591:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872968.381609:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327879296:0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.381630:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872968.381646:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327879808:0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.381691:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872968.381720:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327878912 00000100:00100000:3.0:1788872968.381724:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327878912 00000100:00100000:0.0:1788872968.381953:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327878528:0@lo:400:kworker.0 00000100:00100000:0.0:1788872968.381994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872968.382047:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327879936 00000100:00100000:3.0:1788872968.382051:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327879936 00000100:00100000:2.0:1788872968.382235:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327878656:0@lo:400:kworker.0 00000100:00100000:2.0:1788872968.382265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872968.389016:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327879040:0@lo:400:kworker.0 00000100:00100000:0.0:1788872968.389107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872968.389147:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327879552:0@lo:400:kworker.0 00000100:00100000:0.0:1788872968.389168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872968.389237:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327878528 00000100:00100000:0.0:1788872968.389247:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327878528 00000100:00100000:0.0:1788872968.389315:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788872968.389337:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327878528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872968.389396:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327878528:12345-0@lo:400:kworker.0 Request processed in 60us (7400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872968.389405:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788872968.389467:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327878528:0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.390432:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327878784 00000100:00100000:3.0:1788872968.390439:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327878784 00000100:00100000:3.0:1788872968.390470:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327878656 00000100:00100000:3.0:1788872968.390473:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327878656 00000100:00100000:3.0:1788872968.390487:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327879040 00000100:00100000:3.0:1788872968.390489:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327879040 00000100:00100000:3.0:1788872968.390499:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327879552 00000100:00100000:3.0:1788872968.390501:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327879552 00000100:00100000:3.0:1788872968.390514:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:3.0:1788872968.390522:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327878912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.390608:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875765327878912:12345-0@lo:400:kworker.0 Request processed in 87us (9180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872968.390616:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:3.0:1788872968.390630:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:3.0:1788872968.390636:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327879936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.390664:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327879936:12345-0@lo:400:kworker.0 Request processed in 28us (9155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872968.390670:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:3.0:1788872968.390692:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1788872968.390699:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327878784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.390726:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875765327878784:12345-0@lo:400:kworker.0 Request processed in 28us (9135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872968.390731:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1788872968.390750:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1788872968.390755:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f080bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327878656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.390796:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f080bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327878656:12345-0@lo:400:kworker.0 Request processed in 40us (8529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872968.390802:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1788872968.390814:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:3.0:1788872968.390819:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327879040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.390854:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327879040:12345-0@lo:400:kworker.0 Request processed in 35us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872968.390861:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:3.0:1788872968.390872:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:3.0:1788872968.390878:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327879552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.390904:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327879552:12345-0@lo:400:kworker.0 Request processed in 27us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872968.390911:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00080000:3.0:1788872968.390936:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872968.390940:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872968.390971:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1875765327878784:0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.390983:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1875765327878912:0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.390994:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327879936:0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.391023:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327879040:0@lo:400:kworker.0 00000100:00100000:3.0:1788872968.391032:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327879552:0@lo:400:kworker.0 00000100:00100000:1.0:1788872968.391889:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327878400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872968.391930:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327879424 00000100:00100000:1.0:1788872968.391936:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327879424 00000100:00100000:1.0:1788872968.391981:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327879296 00000100:00100000:1.0:1788872968.391984:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327879296 00000100:00100000:1.0:1788872968.392004:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327879808 00000100:00100000:1.0:1788872968.392006:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327879808 00000100:00100000:1.0:1788872968.392028:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770 00000100:00100000:1.0:1788872968.392036:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327879424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872968.392102:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327879424:12345-0@lo:400:kworker.0 Request processed in 67us (10627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872968.392109:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770 00000100:00100000:1.0:1788872968.392126:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771 00000100:00100000:1.0:1788872968.392133:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327879296:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788872968.392149:0:26182:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f9ec2d80 x1875765327879296/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:139/0 lens 224/224 e 0 to 0 dl 1788872979 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872968.392180:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327879296:12345-0@lo:400:kworker.0 Request processed in 48us (10549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872968.392187:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771 00000100:00100000:1.0:1788872968.392197:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772 00000100:00100000:1.0:1788872968.392203:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f9ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327879808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872968.392230:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f9ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327879808:12345-0@lo:400:kworker.0 Request processed in 27us (10539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872968.392235:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772 00000100:00080000:1.0:1788872968.392259:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788872968.392262:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872968.392284:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327879296:0@lo:400:kworker.0 00000100:00100000:1.0:1788872968.392306:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327879808:0@lo:400:kworker.0 00000100:00100000:1.0:1788872968.392317:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327879424:0@lo:400:kworker.0 00000100:00100000:2.0:1788872968.393296:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327878656:0@lo:400:kworker.0 00000100:00100000:2.0:1788872968.393308:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327879168:0@lo:400:kworker.0 00000100:00100000:2.0:1788872968.393365:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872968.393401:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327879680:0@lo:400:kworker.0 00000100:00100000:2.0:1788872968.393426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872968.393478:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327879680 00000100:00100000:2.0:1788872968.393483:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327879680 00000100:00100000:2.0:1788872968.393523:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773 00000100:00100000:2.0:1788872968.393530:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327879680:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788872968.393575:0:26188:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9e9b03480 x1875765327879680/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:139/0 lens 224/224 e 0 to 0 dl 1788872979 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872968.393611:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327879680:12345-0@lo:400:kworker.0 Request processed in 81us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872968.393618:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773 00000100:00100000:0.0:1788872968.394166:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327879168 00000100:00100000:0.0:1788872968.394173:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327879168 00000100:00100000:0.0:1788872968.394217:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4066 00000100:00100000:0.0:1788872968.394225:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327879168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872968.394283:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327879168:12345-0@lo:400:kworker.0 Request processed in 60us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872968.394290:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4066 00000100:00100000:2.0:1788872968.396648:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327879168:0@lo:400:kworker.0 00000100:00100000:2.0:1788872968.396667:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327879680:0@lo:400:kworker.0 00000100:00080000:2.0:1788872968.396890:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788872968.506911:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872968.889915:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788872968.889942:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327880192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872968.890030:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872968.890071:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9e9b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327880064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872968.890094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872968.890134:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327880192 00000100:00100000:2.0:1788872968.890144:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327880192 00000100:00100000:2.0:1788872968.890198:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327880064 00000100:00100000:2.0:1788872968.890201:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327880064 00000100:00100000:2.0:1788872968.890221:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2241 00000100:00100000:2.0:1788872968.890230:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327880192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788872968.890263:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00010000:00000080:2.0:1788872968.890278:0:8440:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9e9b00700 x1875765327880192/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:139/0 lens 224/368 e 0 to 0 dl 1788872979 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872968.890320:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327880192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872968.890328:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2241 00000100:00100000:2.0:1788872968.890348:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2242 00000100:00100000:2.0:1788872968.890354:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327880064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872968.890368:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872968.890396:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327880064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872968.890401:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2242 00000100:00100000:2.0:1788872968.890441:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327880192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872968.890465:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9e9b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327880064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872968.891562:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872968.891577:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327880320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872968.891629:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872968.891664:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327880320 00000100:00100000:3.0:1788872968.892077:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327880320 00000100:00100000:3.0:1788872968.892124:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4067 00000100:00100000:3.0:1788872968.892133:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327880320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872968.892164:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:3.0:1788872968.892206:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327880320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872968.892213:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4067 00000100:00100000:3.0:1788872968.892255:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327880320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872968.971484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872968.971523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872968.971582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872968.971604:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872968.971631:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872968.971658:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311263488 00000100:00100000:2.0:1788872968.971662:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311263232 00000100:00100000:2.0:1788872968.971667:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311263232 00000100:00100000:0.0:1788872968.971667:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311263488 00000100:00100000:0.0:1788872968.971719:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311263616 00000100:00100000:0.0:1788872968.971723:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311263616 00000100:00100000:3.0:1788872968.972694:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311263360 00000100:00100000:3.0:1788872968.972700:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311263360 00000100:00100000:2.0:1788872968.974356:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1508 00000100:00100000:2.0:1788872968.974370:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+34:2404:x1875765311263232:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872968.974466:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+34:2404:x1875765311263232:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 98us (2990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872968.974474:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1508 00000100:00100000:0.0:1788872968.974800:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2774 00000100:00100000:0.0:1788872968.974824:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2404:x1875765311263488:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000080:0.0:1788872968.974842:0:9961:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c1eef800 x1875765311263488/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:139/0 lens 224/224 e 0 to 0 dl 1788872979 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872968.974870:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2404:x1875765311263488:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 61us (3345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872968.974877:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2774 00000100:00100000:0.0:1788872968.974890:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2775 00000100:00100000:0.0:1788872968.974898:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311263616:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872968.974922:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311263616:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 25us (3290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872968.974927:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2775 00000100:00100000:0.0:1788872968.974948:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311263104 00000100:00100000:0.0:1788872968.974966:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311263104 00000100:00100000:0.0:1788872968.974997:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 184 00000100:00100000:0.0:1788872968.975002:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311263104:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872968.976449:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311263104:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 1437us (4857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872968.976460:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 184 00000100:00080000:0.0:1788872968.976502:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872968.976508:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788872968.976511:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872968.976513:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872968.977512:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1509 00000100:00100000:3.0:1788872968.977524:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2404:x1875765311263360:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872968.977614:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2404:x1875765311263360:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 93us (6008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872968.977620:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1509 00010000:00010000:2.0:1788872969.532981:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872970.554374:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872971.576758:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872971.961405:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327880448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872971.961494:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872971.961572:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327880448 00000100:00100000:3.0:1788872971.961580:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327880448 00000100:00100000:3.0:1788872971.961645:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243 00000100:00100000:3.0:1788872971.961654:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327880448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872971.961682:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872971.961726:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327880448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872971.961740:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243 00000100:00080000:3.0:1788872971.961760:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872971.961796:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327880448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872971.963715:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327880576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872971.963781:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872971.964051:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327880576 00000100:00100000:3.0:1788872971.964059:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327880576 00000100:00100000:3.0:1788872971.964119:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244 00000100:00100000:3.0:1788872971.964129:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327880576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872971.964157:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00010000:00000080:3.0:1788872971.964171:0:24262:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9ee81e300 x1875765327880576/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:142/0 lens 224/368 e 0 to 0 dl 1788872982 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872971.964224:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327880576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872971.964231:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244 00000100:00100000:3.0:1788872971.964277:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327880576:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1788872971.965649:0:94370:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051650 is committed 00010000:00010000:2.0:1788872971.965893:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dc06b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.965905:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dc06b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.965913:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dc06b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.965919:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872971.965924:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dc06b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.965931:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dc06b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.965950:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5d04900) 00010000:00010000:2.0:1788872971.965953:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872971.965971:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dc06b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.965977:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9a00/0xe4e6e89fb01dc06b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.965997:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc0a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.966003:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc0a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.966008:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc0a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.966013:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4499e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872971.966016:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc0a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.966021:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc0a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.966029:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb034821 (ffff98a9c5d04900) 00010000:00010000:2.0:1788872971.966031:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872971.966033:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc0a3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872971.966038:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499e00/0xe4e6e89fb01dc0a3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb034821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788872971.966131:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788872972.600745:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872973.497425:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327880832:0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.497516:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872973.497566:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327881344:0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.497602:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872973.497622:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327881856:0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.497643:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872973.497666:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788872973.497672:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327880960:0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.497692:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872973.497708:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327881472:0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.497744:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872973.497761:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327881984:0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.497778:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872973.497809:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327880832 00000100:00100000:3.0:1788872973.497816:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327880832 00000100:00100000:3.0:1788872973.497863:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327880960 00000100:00100000:3.0:1788872973.497866:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327880960 00000100:00100000:3.0:1788872973.497886:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1788872973.497894:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327880832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.497958:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327880832:12345-0@lo:400:kworker.0 Request processed in 63us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872973.497965:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1788872973.497983:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:3.0:1788872973.497989:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327880960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.498015:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327880960:12345-0@lo:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872973.498020:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:3.0:1788872973.498039:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327881344 00000100:00100000:3.0:1788872973.498043:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327881344 00000100:00100000:3.0:1788872973.498066:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327881856 00000100:00100000:3.0:1788872973.498069:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327881856 00000100:00100000:3.0:1788872973.498085:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4068 00000100:00100000:3.0:1788872973.498090:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327881344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.499813:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327881344:12345-0@lo:400:kworker.0 Request processed in 1709us (2198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872973.499827:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4068 00000100:00100000:3.0:1788872973.499869:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4069 00000100:00100000:3.0:1788872973.499897:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327881856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.499965:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327881856:12345-0@lo:400:kworker.0 Request processed in 73us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872973.499971:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4069 00000100:00100000:3.0:1788872973.500013:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327881472 00000100:00100000:3.0:1788872973.500020:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327881472 00000100:00100000:3.0:1788872973.500066:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327881984 00000100:00100000:3.0:1788872973.500069:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327881984 00000100:00100000:3.0:1788872973.500086:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776 00000100:00100000:3.0:1788872973.500091:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327881472:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872973.500109:0:26187:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4d17800 x1875765327881472/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:144/0 lens 224/224 e 0 to 0 dl 1788872984 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872973.500139:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327881472:12345-0@lo:400:kworker.0 Request processed in 48us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872973.500145:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776 00000100:00100000:3.0:1788872973.500156:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777 00000100:00100000:3.0:1788872973.500161:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327881984:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788872973.500172:0:26187:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4d15180 x1875765327881984/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:144/0 lens 224/224 e 0 to 0 dl 1788872984 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872973.500199:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327881984:12345-0@lo:400:kworker.0 Request processed in 38us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872973.500205:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777 00000100:00080000:3.0:1788872973.500225:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788872973.500230:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788872973.500233:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788872973.500295:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327880960:0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.500319:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327881472:0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.500329:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327881984:0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.500353:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327880832:0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.500366:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327881344:0@lo:400:kworker.0 00000100:00100000:3.0:1788872973.500375:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327881856:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.501565:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327880704:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.501661:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872973.501705:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327881216:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.501732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872973.501753:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327881728:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.501781:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872973.501800:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327882240:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.501823:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872973.501846:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788872973.501853:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327881088:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.501877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872973.501899:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9efa58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327881600:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.501922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872973.501954:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327882112:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.501979:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872973.502012:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327880704 00000100:00100000:2.0:1788872973.502018:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327880704 00000100:00100000:2.0:1788872973.502059:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788872973.502078:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327880704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502134:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327880704:12345-0@lo:400:kworker.0 Request processed in 69us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872973.502141:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788872973.502171:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327881216 00000100:00100000:2.0:1788872973.502175:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327881216 00000100:00100000:2.0:1788872973.502205:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327881728 00000100:00100000:2.0:1788872973.502208:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327881728 00000100:00100000:2.0:1788872973.502224:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327882240 00000100:00100000:2.0:1788872973.502234:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327882240 00000100:00100000:2.0:1788872973.502249:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327881088 00000100:00100000:2.0:1788872973.502251:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327881088 00000100:00100000:2.0:1788872973.502265:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:2.0:1788872973.502270:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9e9b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327881216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502301:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9e9b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765327881216:12345-0@lo:400:kworker.0 Request processed in 31us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872973.502307:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:2.0:1788872973.502319:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:2.0:1788872973.502324:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327881728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502350:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765327881728:12345-0@lo:400:kworker.0 Request processed in 25us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872973.502355:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:2.0:1788872973.502365:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:2.0:1788872973.502370:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9cb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327882240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502395:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9cb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327882240:12345-0@lo:400:kworker.0 Request processed in 24us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872973.502400:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:2.0:1788872973.502411:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:2.0:1788872973.502417:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c38b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327881088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502452:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c38b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327881088:12345-0@lo:400:kworker.0 Request processed in 35us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872973.502457:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:2.0:1788872973.502479:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327881600 00000100:00100000:2.0:1788872973.502483:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327881600 00000100:00100000:2.0:1788872973.502508:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327882112 00000100:00100000:2.0:1788872973.502510:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327882112 00000100:00100000:2.0:1788872973.502540:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778 00000100:00100000:2.0:1788872973.502545:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c49fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327881600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502601:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c49fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327881600:12345-0@lo:400:kworker.0 Request processed in 56us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872973.502607:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778 00000100:00100000:2.0:1788872973.502618:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779 00000100:00100000:2.0:1788872973.502625:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327882112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502650:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327882112:12345-0@lo:400:kworker.0 Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872973.502655:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779 00000100:00080000:2.0:1788872973.502694:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788872973.502699:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788872973.502701:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788872973.502731:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327881088:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502744:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9efa58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327881600:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502752:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327882112:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502759:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327880704:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502768:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765327881216:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502776:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765327881728:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.502785:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327882240:0@lo:400:kworker.0 00000100:00100000:2.0:1788872973.504448:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788872973.504470:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9fa5f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327882368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788872973.504537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872973.504625:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327882368 00000100:00100000:2.0:1788872973.504634:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327882368 00000100:00100000:2.0:1788872973.504674:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4070 00000100:00100000:2.0:1788872973.504682:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9efa58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327882368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872973.504717:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1788872973.504762:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9efa58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327882368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872973.504768:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4070 00000100:00100000:2.0:1788872973.504813:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9fa5f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327882368:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788872973.629240:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872974.009126:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788872974.009152:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327882496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872974.009522:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327882624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872974.009624:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872974.009734:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327882624 00000100:00100000:0.0:1788872974.009743:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327882624 00000100:00100000:0.0:1788872974.009789:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245 00000100:00100000:0.0:1788872974.009799:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9fa5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327882624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788872974.009831:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00010000:00000080:0.0:1788872974.009845:0:8440:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9fa5f6680 x1875765327882624/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:145/0 lens 224/368 e 0 to 0 dl 1788872985 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872974.009895:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9fa5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327882624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872974.009903:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245 00000100:00100000:2.0:1788872974.010088:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327882624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788872974.010376:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327882752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872974.010409:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872974.010519:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327882752 00000100:00100000:3.0:1788872974.010524:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327882752 00000100:00100000:3.0:1788872974.010582:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246 00000100:00100000:3.0:1788872974.010590:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327882752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788872974.010609:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872974.010741:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327882752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872974.010748:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246 00000100:00100000:1.0:1788872974.011338:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872974.011719:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327882496 00000100:00100000:3.0:1788872974.011724:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327882496 00000100:00100000:3.0:1788872974.011762:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4071 00000100:00100000:3.0:1788872974.011769:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327882496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872974.011796:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:3.0:1788872974.011841:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327882496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872974.011847:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4071 00000100:00100000:0.0:1788872974.011934:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327882496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872974.018710:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327882752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872974.099525:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872974.099673:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872974.100934:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872974.100971:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872974.101616:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311264128 00000100:00100000:0.0:1788872974.101627:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311264128 00000100:00100000:0.0:1788872974.101698:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2780 00000100:00100000:0.0:1788872974.101721:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311264128:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000080:0.0:1788872974.101750:0:26182:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a4bb80 x1875765311264128/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:145/0 lens 224/224 e 0 to 0 dl 1788872985 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872974.101805:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2405:x1875765311264128:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 86us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872974.101825:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2780 00000100:00100000:0.0:1788872974.101849:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311263744 00000100:00100000:0.0:1788872974.101853:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311263744 00000100:00100000:0.0:1788872974.101878:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 186 00000100:00100000:0.0:1788872974.101885:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311263744:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872974.101909:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c67645b7-2296-4087-92b1-886500c47477+10:2405:x1875765311263744:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 24us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872974.101915:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 186 00000100:00080000:2.0:1788872974.105657:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788872974.116149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872974.119968:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311264256 00000100:00100000:0.0:1788872974.119984:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311264256 00000100:00100000:0.0:1788872974.120066:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2781 00000100:00100000:0.0:1788872974.121557:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311264256:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872974.122504:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2405:x1875765311264256:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 1596us (5534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872974.122521:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2781 00000100:00080000:0.0:1788872974.122646:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788872974.129582:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311263872 00000100:00100000:2.0:1788872974.129598:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311263872 00000100:00100000:2.0:1788872974.130621:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311264000 00000100:00100000:2.0:1788872974.130628:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311264000 00000100:00100000:2.0:1788872974.130660:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1516 00000100:00080000:0.0:1788872974.131998:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872974.132007:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788872974.132613:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+30:2405:x1875765311263872:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872974.132728:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+30:2405:x1875765311263872:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 2057us (33648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872974.132757:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1516 00000100:00100000:2.0:1788872974.132789:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1517 00000100:00100000:2.0:1788872974.132799:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2405:x1875765311264000:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872974.132828:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2405:x1875765311264000:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 32us (31857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872974.132834:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1517 00010000:00010000:3.0:1788872974.660724:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788872974.677429:0:95910:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:1.0:1788872975.021005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.021045:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.021082:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.021184:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311264384 00000100:00100000:0.0:1788872975.021199:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311264384 00000100:00100000:0.0:1788872975.021248:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311264512 00000100:00100000:0.0:1788872975.021262:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311264512 00000100:00100000:0.0:1788872975.021279:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311264640 00000100:00100000:0.0:1788872975.021281:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311264640 00000100:00100000:0.0:1788872975.021297:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1538 00000100:00100000:0.0:1788872975.021306:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+32:73756:x1875765311264384:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.021326:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.021347:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc0b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb39d expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021424:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01dc0bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021438:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01dc0bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021451:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01dc0bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872975.021491:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788872975.021494:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788872975.021535:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01dc0bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021594:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc0b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb39d expref: 34 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021614:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4600/0xe4e6e89fb01dc0bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb39d expref: 33 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021622:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:0.0:1788872975.021630:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788872975.021634:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4600, rc 0) 00000100:00100000:0.0:1788872975.021690:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+33:73756:x1875765311264384:12345-192.168.204.39@tcp:101:dd.0 Request processed in 383us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.021697:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1538 00000100:00100000:0.0:1788872975.021715:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1539 00000100:00100000:0.0:1788872975.021722:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+32:73754:x1875765311264512:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.021729:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.021738:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc0c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3a4 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021769:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc0cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021776:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc0cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021784:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc0cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872975.021800:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788872975.021803:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788872975.021812:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc0cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021827:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc0c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3a4 expref: 34 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021837:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc0cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3a4 expref: 33 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021855:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:0.0:1788872975.021857:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788872975.021859:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5600, rc 0) 00000100:00100000:0.0:1788872975.021879:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+33:73754:x1875765311264512:12345-192.168.204.39@tcp:101:dd.0 Request processed in 158us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.021885:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1539 00000100:00100000:0.0:1788872975.021899:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1540 00000100:00100000:0.0:1788872975.021905:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+32:73757:x1875765311264640:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.021913:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.021920:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc0d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3ab expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021948:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc0db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021955:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc0db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.021963:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc0db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872975.021978:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788872975.021981:0:66979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788872975.021989:0:66979:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc0db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.022004:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc0d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3ab expref: 34 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.022028:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc0db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3ab expref: 33 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.022034:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:0.0:1788872975.022037:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788872975.022039:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5a00, rc 0) 00000100:00100000:0.0:1788872975.022060:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+33:73757:x1875765311264640:12345-192.168.204.39@tcp:101:dd.0 Request processed in 155us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.022066:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1540 00000100:00100000:0.0:1788872975.028348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.028459:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311264896 00000100:00100000:2.0:1788872975.028470:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311264896 00000100:00100000:2.0:1788872975.028540:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1541 00000100:00100000:2.0:1788872975.028583:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+33:73757:x1875765311264896:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.028603:0:66979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.028625:0:66979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498800/0xe4e6e89fb01dc0e2 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3b2 expref: -99 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.028753:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc0e9 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.028766:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc0e9 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.028778:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc0e9 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.028791:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc0f0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.028798:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc0f0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.028817:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc0f0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.028876:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc0f7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.028884:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc0f7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.028891:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc0f7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872975.028901:0:66979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x9:0x0]: returning size 0 00010000:00010000:2.0:1788872975.028993:0:66979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc0e9 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029001:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc0e9 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029007:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc0e9 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029014:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc0e9 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029020:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4499600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872975.029024:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc0e9 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029031:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc0e9 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029054:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872975.029057:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872975.029062:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc0e9 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029069:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc0e9 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029084:0:66979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc0f0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029089:0:66979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc0f0 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029094:0:66979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc0f0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029099:0:66979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4498000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872975.029101:0:66979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc0f0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029106:0:66979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc0f0 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029113:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff98a9faf66200) 00010000:00010000:2.0:1788872975.029114:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872975.029117:0:66979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc0f0 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029122:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc0f0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029178:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498800/0xe4e6e89fb01dc0e2 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3b2 expref: 36 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029192:0:66979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc0f7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3b2 expref: 35 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.029200:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff98a9c1358200) 00010000:00010000:2.0:1788872975.029202:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872975.029204:0:66979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4499200, rc 0) 00000100:00100000:2.0:1788872975.029258:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+35:73757:x1875765311264896:12345-192.168.204.39@tcp:101:dd.0 Request processed in 709us (920us total) trans 124554051651 rc 0/0 00000100:00100000:2.0:1788872975.029266:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1541 00000100:00100000:0.0:1788872975.045428:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.045474:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.045630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.045913:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311265280 00000100:00100000:2.0:1788872975.045925:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311265280 00000100:00100000:2.0:1788872975.045991:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1542 00000100:00100000:2.0:1788872975.046002:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+35:73757:x1875765311265280:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.046027:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.046050:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498800/0xe4e6e89fb01dc105 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3b9 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.046087:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc10c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.046103:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc10c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.046114:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc10c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.046249:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498800/0xe4e6e89fb01dc105 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3b9 expref: 37 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.046273:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498000/0xe4e6e89fb01dc10c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3b9 expref: 36 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.046282:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff98a9c1358200) 00010000:00010000:2.0:1788872975.046285:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788872975.046289:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4498000, rc 0) 00000100:00100000:2.0:1788872975.046348:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+36:73757:x1875765311265280:12345-192.168.204.39@tcp:101:dd.0 Request processed in 348us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.046355:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1542 00000100:00100000:1.0:1788872975.046686:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311265024 00000100:00100000:1.0:1788872975.046693:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311265024 00000100:00100000:1.0:1788872975.046736:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311265152 00000100:00100000:1.0:1788872975.046739:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311265152 00000100:00100000:1.0:1788872975.046763:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 744 00000100:00100000:1.0:1788872975.046771:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+37:2406:x1875765311265024:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788872975.046781:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872975.046797:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc0db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3ab expref: 37 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.046811:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:1.0:1788872975.046822:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872975.046851:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+36:2406:x1875765311265024:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 81us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872975.046859:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 744 00000100:00100000:1.0:1788872975.046875:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 745 00000100:00100000:1.0:1788872975.046882:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+35:2405:x1875765311265152:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788872975.046890:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872975.046916:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc0cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3a4 expref: 35 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.046928:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98a9c329d100) 00010000:00010000:1.0:1788872975.046931:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872975.046951:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+34:2405:x1875765311265152:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 70us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872975.046957:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 745 00000100:00100000:0.0:1788872975.051419:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.051504:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311265536 00000100:00100000:1.0:1788872975.051516:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311265536 00000100:00100000:1.0:1788872975.051610:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1543 00000100:00100000:1.0:1788872975.051621:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef3d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+34:73756:x1875765311265536:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872975.051643:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.051666:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc113 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3c0 expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.051813:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc11a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.051828:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc11a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.051854:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc11a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.051869:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc121 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.051875:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc121 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.051882:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc121 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.051951:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc128 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.051960:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc128 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.051967:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc128 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872975.051977:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x8:0x0]: returning size 0 00010000:00010000:1.0:1788872975.052052:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc11a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052059:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc11a lrc: 2/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052065:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc11a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052070:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872975.052080:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc11a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052088:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc11a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052101:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872975.052104:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872975.052108:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc11a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052114:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc11a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052128:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc121 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052135:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc121 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052141:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc121 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052146:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872975.052149:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc121 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052155:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc121 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052163:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff98a9c1358300) 00010000:00010000:1.0:1788872975.052165:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872975.052174:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc121 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052180:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc121 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052228:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc113 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3c0 expref: 37 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052241:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc128 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3c0 expref: 36 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.052248:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff98a9f016a300) 00010000:00010000:1.0:1788872975.052251:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872975.052253:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2200, rc 0) 00000100:00100000:1.0:1788872975.052322:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef3d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+36:73756:x1875765311265536:12345-192.168.204.39@tcp:101:dd.0 Request processed in 702us (921us total) trans 124554051652 rc 0/0 00000100:00100000:1.0:1788872975.052330:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1543 00000100:00100000:0.0:1788872975.060807:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.060859:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.060990:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311265664 00000100:00100000:1.0:1788872975.061001:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311265664 00000100:00100000:1.0:1788872975.061058:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311265920 00000100:00100000:1.0:1788872975.061061:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311265920 00000100:00100000:1.0:1788872975.061089:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1544 00000100:00100000:1.0:1788872975.061100:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+37:73756:x1875765311265664:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872975.061120:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.061141:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc136 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3c7 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061186:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dc13d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061222:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dc13d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061234:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dc13d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061347:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc136 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3c7 expref: 39 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061367:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3a00/0xe4e6e89fb01dc13d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3c7 expref: 38 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061376:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff98a9f016a300) 00010000:00010000:1.0:1788872975.061379:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788872975.061382:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3a00, rc 0) 00000100:00100000:1.0:1788872975.061445:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+38:73756:x1875765311265664:12345-192.168.204.39@tcp:101:dd.0 Request processed in 347us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872975.061453:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1544 00000100:00100000:1.0:1788872975.061472:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1545 00000100:00100000:1.0:1788872975.061479:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+37:73754:x1875765311265920:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872975.061487:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.061496:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc144 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3ce expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061618:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc14b lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061638:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc14b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061646:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc14b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061660:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc152 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061667:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc152 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061674:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc152 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061719:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2a00/0xe4e6e89fb01dc159 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061728:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2a00/0xe4e6e89fb01dc159 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061735:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2a00/0xe4e6e89fb01dc159 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872975.061745:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x6:0x0]: returning size 0 00010000:00010000:1.0:1788872975.061825:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc14b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061833:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc14b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061839:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc14b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061853:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc14b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061859:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872975.061863:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc14b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061870:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc14b lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061880:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872975.061883:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872975.061886:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc14b lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061892:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc14b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061917:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc152 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061923:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc152 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061929:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc152 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061934:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872975.061936:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc152 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061952:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc152 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061961:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff98a9c1358700) 00010000:00010000:1.0:1788872975.061963:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872975.061966:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc152 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.061972:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc152 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.062006:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc144 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3ce expref: 40 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.062018:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2a00/0xe4e6e89fb01dc159 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3ce expref: 39 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.062024:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff98a9f016a800) 00010000:00010000:1.0:1788872975.062027:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872975.062029:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2a00, rc 0) 00000100:00100000:1.0:1788872975.062060:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+39:73754:x1875765311265920:12345-192.168.204.39@tcp:101:dd.0 Request processed in 582us (1200us total) trans 124554051653 rc 0/0 00000100:00100000:1.0:1788872975.062067:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1545 00000100:00100000:0.0:1788872975.064440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.064539:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311266176 00000100:00100000:1.0:1788872975.064599:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311266176 00000100:00100000:1.0:1788872975.064660:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1546 00000100:00100000:1.0:1788872975.064671:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+39:73757:x1875765311266176:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:1.0:1788872975.064743:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872975.064770:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc0f7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3b2 expref: 39 pid: 66979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.064793:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff98a9c1358200) 00010000:00010000:1.0:1788872975.064799:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872975.064988:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc167 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.065002:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc167 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.065012:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc167 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788872975.065058:0:83669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051654 00000004:00010000:1.0:1788872975.065083:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dacef040 reply state 00000000b231b7ad transno 124554051655 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc167 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.065096:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc167 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.065102:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff98a9c1358200) 00010000:00010000:1.0:1788872975.065105:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872975.065108:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872975.065223:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+41:73757:x1875765311266176:12345-192.168.204.39@tcp:36:dd.0 Request processed in 553us (790us total) trans 124554051655 rc 0/0 00000100:00100000:1.0:1788872975.065232:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1546 00000020:00080000:1.0:1788872975.065237:0:83669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788872975.077641:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.077699:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.077728:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.083269:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.091385:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311266432 00000100:00100000:2.0:1788872975.091401:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311266432 00000100:00100000:2.0:1788872975.091436:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311266944 00000100:00100000:2.0:1788872975.091439:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311266944 00000100:00100000:2.0:1788872975.091498:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6034 00000100:00100000:2.0:1788872975.091508:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+5:73757:x1875765311266944:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.091535:0:26188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.091574:0:26188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000218b0421/0xe4e6e89fb01dc16e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3e3 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788872975.091600:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x385:0x0] initial LVB size: 0, mtime: 0x6aa00900, atime: 0x6aa00900, ctime: 0x6aa00900, blocks: 0x0 00010000:00010000:2.0:1788872975.091622:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x385:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1788872975.091627:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x385:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872975.091636:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218b0421/0xe4e6e89fb01dc16e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3e3 expref: 6 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.091670:0:26188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000218b0421/0xe4e6e89fb01dc16e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3e3 expref: 6 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.091683:0:26188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4498800, rc 0) 00010000:00000080:2.0:1788872975.091692:0:26188:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4d14000 x1875765311266944/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872975.091758:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+6:73757:x1875765311266944:12345-192.168.204.39@tcp:101:dd.0 Request processed in 250us (8499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.091764:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6034 00000100:00100000:2.0:1788872975.091804:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311266560 00000100:00100000:2.0:1788872975.091807:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311266560 00000100:00100000:2.0:1788872975.091831:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311266816 00000100:00100000:2.0:1788872975.091834:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311266816 00000100:00100000:2.0:1788872975.091853:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1547 00000100:00100000:2.0:1788872975.091859:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+43:73756:x1875765311266432:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:2.0:1788872975.091908:0:66193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872975.091929:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc128 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3c0 expref: 43 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.091946:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff98a9f016a300) 00010000:00010000:2.0:1788872975.091950:0:66193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872975.093148:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1548 00000100:00100000:0.0:1788872975.093174:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+42:73754:x1875765311266560:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.093192:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.093218:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc175 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3d5 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093258:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01dc17c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093284:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01dc17c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093295:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01dc17c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093384:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc175 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3d5 expref: 44 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093400:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5800/0xe4e6e89fb01dc17c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3d5 expref: 43 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093419:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff98a9f016a800) 00010000:00010000:0.0:1788872975.093422:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788872975.093424:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5800, rc 0) 00000100:00100000:0.0:1788872975.093470:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+43:73754:x1875765311266560:12345-192.168.204.39@tcp:101:dd.0 Request processed in 312us (15769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.093477:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1548 00000100:00100000:0.0:1788872975.093495:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1549 00000100:00100000:0.0:1788872975.093501:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+42:73755:x1875765311266816:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.093509:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.093517:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc183 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3dc expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093636:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc18a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093655:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc18a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093662:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc18a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093677:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc191 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093684:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc191 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093690:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc191 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093726:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc198 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093733:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc198 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093738:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc198 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872975.093747:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788872975.093815:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc18a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093823:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc18a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093829:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc18a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093841:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc18a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093848:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.093852:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc18a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093859:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc18a lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093869:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872975.093871:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.093875:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc18a lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093882:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc18a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093891:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc191 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093897:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc191 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093903:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc191 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093908:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.093911:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc191 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093925:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc191 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093932:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff98a9d14a2c00) 00010000:00010000:0.0:1788872975.093934:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.093937:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc191 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093942:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc191 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093971:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc183 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3dc expref: 45 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.093981:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc198 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3dc expref: 44 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.094009:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff98a9f016a700) 00010000:00010000:0.0:1788872975.094011:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872975.094013:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5600, rc 0) 00000100:00100000:0.0:1788872975.094034:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+44:73755:x1875765311266816:12345-192.168.204.39@tcp:101:dd.0 Request processed in 533us (16306us total) trans 124554051656 rc 0/0 00000100:00100000:0.0:1788872975.094041:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1549 00010000:00010000:2.0:1788872975.094778:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc1a6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.094791:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc1a6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.094808:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc1a6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788872975.094852:0:66193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051657 00000004:00010000:2.0:1788872975.094873:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044b90789 reply state 000000003c531de8 transno 124554051658 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc1a6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.094885:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc1a6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.094891:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff98a9f016a300) 00010000:00010000:2.0:1788872975.094894:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872975.094897:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872975.094964:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+46:73756:x1875765311266432:12345-192.168.204.39@tcp:36:dd.0 Request processed in 3103us (17331us total) trans 124554051658 rc 0/0 00000100:00100000:2.0:1788872975.094971:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1547 00000020:00080000:2.0:1788872975.094974:0:66193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788872975.103662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.103691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.103768:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.103791:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.103813:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.103844:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311267456 00000100:00100000:3.0:1788872975.103852:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311267456 00002000:00010000:3.0:1788872975.103884:0:24865:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/901 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.103888:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c4d16300 with x1875765311267456 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.103900:0:24865:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c4d16300. 00000100:00100000:3.0:1788872975.103935:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1008 00000100:00100000:3.0:1788872975.103945:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2404:x1875765311267456:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:3.0:1788872975.104101:0:24865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788872975.104105:0:24865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb mtime from disk: 1788872960 -> 1788872975 00002000:00010000:3.0:1788872975.104108:0:24865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb atime from disk: 1788872960 -> 1788872960 00002000:00010000:3.0:1788872975.104110:0:24865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb ctime from disk: 1788872960 -> 1788872975 00002000:00010000:3.0:1788872975.104112:0:24865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788872975.104119:0:24865:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4d16300 x1875765311267456/t4294969478(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.104423:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311267072 00000100:00100000:1.0:1788872975.104439:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311267072 00000100:00100000:1.0:1788872975.104465:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311267328 00000100:00100000:1.0:1788872975.104467:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311267328 00000100:00100000:1.0:1788872975.104478:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311267712 00000100:00100000:1.0:1788872975.104480:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311267712 00000100:00100000:1.0:1788872975.118606:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1550 00000100:00100000:1.0:1788872975.118633:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+48:73755:x1875765311267072:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872975.118660:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.118684:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc1ad lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3ea expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.118719:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc1b4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.118732:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc1b4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.118743:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc1b4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.118861:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc1ad lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3ea expref: 50 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.118883:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3400/0xe4e6e89fb01dc1b4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3ea expref: 49 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.118892:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff98a9f016a700) 00010000:00010000:1.0:1788872975.118894:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788872975.118898:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3400, rc 0) 00000100:00100000:3.0:1788872975.118935:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311267456:12345-192.168.204.39@tcp:10:dd.0 Request processed in 14990us (15164us total) trans 4294969478 rc 0/0 00000100:00100000:3.0:1788872975.118945:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1008 00002000:00010000:3.0:1788872975.118950:0:24865:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/901 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.118960:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c4d16300 with x1875765311267456 ext(0->18446744073709551615) 00000100:00100000:1.0:1788872975.118962:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+49:73755:x1875765311267072:12345-192.168.204.39@tcp:101:dd.0 Request processed in 344us (15310us total) trans 0 rc 0/0 00002000:00010000:3.0:1788872975.118969:0:24865:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c4d16300. 00000100:00100000:1.0:1788872975.118973:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1550 00000100:00100000:1.0:1788872975.118991:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1551 00000100:00100000:1.0:1788872975.118998:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+48:73758:x1875765311267328:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872975.119006:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.119015:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc1bb lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3f1 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872975.119021:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311267840 00000100:00100000:3.0:1788872975.119028:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311267840 00000100:00100000:3.0:1788872975.119065:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6035 00000100:00100000:3.0:1788872975.119071:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0804304d-5904-48ad-87f2-bcbc7642a62a+7:73756:x1875765311267840:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.119078:0:26191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.119091:0:26191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01dc1c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3f8 expref: -99 pid: 26191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872975.119112:0:26191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x384:0x0] initial LVB size: 0, mtime: 0x6aa00900, atime: 0x6aa00900, ctime: 0x6aa00900, blocks: 0x0 00010000:00010000:1.0:1788872975.119114:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc1c9 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119122:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc1c9 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.119126:0:26191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x384:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:1.0:1788872975.119129:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc1c9 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.119131:0:26191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x384:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872975.119138:0:26191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01dc1c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3f8 expref: 8 pid: 26191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119140:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1d0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119147:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1d0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.119151:0:26191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01dc1c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3f8 expref: 8 pid: 26191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119154:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1d0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.119162:0:26191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9e00, rc 0) 00010000:00000080:3.0:1788872975.119168:0:26191:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5c34380 x1875765311267840/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1788872975.119196:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc1d7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872975.119205:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0804304d-5904-48ad-87f2-bcbc7642a62a+8:73756:x1875765311267840:12345-192.168.204.39@tcp:101:dd.0 Request processed in 134us (15390us total) trans 0 rc 0/0 00010000:00010000:1.0:1788872975.119205:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc1d7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872975.119212:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6035 00010000:00010000:1.0:1788872975.119222:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc1d7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872975.119232:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xa:0x0]: returning size 0 00000100:00100000:2.0:1788872975.119309:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1552 00010000:00010000:1.0:1788872975.119310:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc1c9 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119317:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc1c9 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119341:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc1c9 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119347:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc1c9 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119355:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872975.119359:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc1c9 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119366:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc1c9 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119375:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872975.119377:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872975.119381:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc1c9 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119386:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc1c9 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119395:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1d0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119418:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1d0 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119424:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1d0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119429:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872975.119431:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1d0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119437:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1d0 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119444:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff98a9c1358700) 00010000:00010000:1.0:1788872975.119447:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872975.119450:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1d0 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119455:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1d0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119489:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc1bb lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3f1 expref: 51 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.119500:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc1d7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3f1 expref: 50 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872975.119505:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+50:73754:x1875765311267712:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:1.0:1788872975.119506:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff98a9e1f8f400) 00010000:00010000:1.0:1788872975.119509:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872975.119515:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2000, rc 0) 00000100:00100000:1.0:1788872975.119538:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+50:73758:x1875765311267328:12345-192.168.204.39@tcp:101:dd.0 Request processed in 540us (15846us total) trans 124554051659 rc 0/0 00010000:00010000:2.0:1788872975.119543:0:66979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788872975.119545:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1551 00010000:00010000:2.0:1788872975.119572:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2a00/0xe4e6e89fb01dc159 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3ce expref: 49 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.119582:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff98a9f016a800) 00010000:00010000:2.0:1788872975.119585:0:66979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872975.119687:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc1e5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.119707:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc1e5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.119714:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc1e5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788872975.119758:0:66979:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051660 00000004:00010000:2.0:1788872975.119781:0:66979:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fcd998b7 reply state 000000007082f753 transno 124554051661 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc1e5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.119791:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc1e5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.119797:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff98a9f016a800) 00010000:00010000:2.0:1788872975.119799:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872975.119802:0:66979:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872975.119853:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+51:73754:x1875765311267712:12345-192.168.204.39@tcp:36:dd.0 Request processed in 536us (16059us total) trans 124554051661 rc 0/0 00000100:00100000:2.0:1788872975.119859:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1552 00000020:00080000:2.0:1788872975.119862:0:66979:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788872975.152213:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.152280:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.152314:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.152315:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311267968 00000100:00100000:1.0:1788872975.152324:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311267968 00000100:00100000:3.0:1788872975.152349:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.152374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.152374:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311268224 00000100:00100000:1.0:1788872975.152377:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311268224 00000100:00100000:3.0:1788872975.152398:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.152414:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311268736 00000100:00100000:1.0:1788872975.152417:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311268736 00000100:00100000:3.0:1788872975.152430:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311268480 00000100:00100000:3.0:1788872975.152434:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311268480 00000100:00100000:1.0:1788872975.152441:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1553 00000100:00100000:1.0:1788872975.152449:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+53:73758:x1875765311267968:12345-192.168.204.39@tcp:101:dd.0 00000100:00100000:3.0:1788872975.152459:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6036 00000100:00100000:3.0:1788872975.152464:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+8:73754:x1875765311268480:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.152473:0:9961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.152473:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.152491:0:9961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01dc1f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb40d expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.152491:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc1ec lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb3ff expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872975.152515:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x382:0x0] initial LVB size: 0, mtime: 0x6aa00900, atime: 0x6aa00900, ctime: 0x6aa00900, blocks: 0x0 00010000:00010000:1.0:1788872975.152524:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1fa lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.152533:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x382:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:1.0:1788872975.152535:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1fa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.152537:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x382:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872975.152544:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01dc1f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb40d expref: 9 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.152583:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1fa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.152585:0:9961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01dc1f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb40d expref: 9 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.152597:0:9961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9200, rc 0) 00010000:00000080:3.0:1788872975.152604:0:9961:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5c35f80 x1875765311268480/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.152662:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+9:73754:x1875765311268480:12345-192.168.204.39@tcp:101:dd.0 Request processed in 196us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.152673:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6036 00010000:00010000:1.0:1788872975.152681:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc1ec lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3ff expref: 55 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872975.152696:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311268992 00010000:00010000:1.0:1788872975.152698:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2600/0xe4e6e89fb01dc1fa lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3ff expref: 54 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872975.152699:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311268992 00010000:00010000:1.0:1788872975.152717:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff98a9e1f8f400) 00010000:00010000:1.0:1788872975.152720:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1788872975.152722:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 265 00010000:00010000:1.0:1788872975.152724:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2600, rc 0) 00000100:00100000:3.0:1788872975.152728:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+55:73757:x1875765311268992:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:1.0:1788872975.152751:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+55:73758:x1875765311267968:12345-192.168.204.39@tcp:101:dd.0 Request processed in 303us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872975.152756:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1553 00000100:00100000:1.0:1788872975.152773:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1554 00000100:00100000:1.0:1788872975.152779:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+54:73760:x1875765311268224:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872975.152785:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.152794:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc201 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb406 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.152886:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc208 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.152895:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc208 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.152901:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc208 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.152913:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc20f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.152920:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc20f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.152926:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc20f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872975.152928:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+56:73757:x1875765311268992:12345-192.168.204.39@tcp:35:dd.0 Request processed in 200us (529us total) trans 124554051662 rc 0/0 00000100:00100000:3.0:1788872975.152935:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 265 00010000:00010000:1.0:1788872975.152972:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc216 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.152980:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc216 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.152987:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc216 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872975.153014:0:66193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xc:0x0]: returning size 0 00010000:00010000:1.0:1788872975.153059:0:66193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc208 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153067:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc208 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153074:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc208 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153079:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc208 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153085:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872975.153089:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc208 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153096:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc208 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153106:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872975.153108:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872975.153119:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc208 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153126:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc208 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153136:0:66193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc20f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153142:0:66193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc20f lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153147:0:66193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc20f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153152:0:66193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872975.153155:0:66193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc20f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153161:0:66193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc20f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153168:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff98a9c1358700) 00010000:00010000:1.0:1788872975.153171:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872975.153174:0:66193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc20f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153179:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc20f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153209:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2800/0xe4e6e89fb01dc201 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb406 expref: 57 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872975.153221:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1555 00000100:00100000:2.0:1788872975.153230:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+56:73755:x1875765311268736:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:1.0:1788872975.153232:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc216 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb406 expref: 56 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153239:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff98a9f016a000) 00010000:00010000:1.0:1788872975.153242:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872975.153244:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2e00, rc 0) 00010000:00010000:2.0:1788872975.153265:0:66979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788872975.153275:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+56:73760:x1875765311268224:12345-192.168.204.39@tcp:101:dd.0 Request processed in 496us (995us total) trans 124554051663 rc 0/0 00010000:00010000:2.0:1788872975.153279:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc198 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3dc expref: 56 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872975.153282:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1554 00010000:00010000:2.0:1788872975.153290:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff98a9f016a700) 00010000:00010000:2.0:1788872975.153293:0:66979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872975.153472:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311268352 00000100:00100000:0.0:1788872975.153478:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311268352 00002000:00010000:0.0:1788872975.153500:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/900 (0->18446744073709551615) 00002000:00100000:0.0:1788872975.153505:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5c36a00 with x1875765311268352 ext(0->18446744073709551615) 00002000:00010000:0.0:1788872975.153512:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5c36a00. 00000100:00100000:0.0:1788872975.153545:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1009 00000100:00100000:0.0:1788872975.153579:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2407:x1875765311268352:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:0.0:1788872975.153676:0:24869:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:1.0:1788872975.153678:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01dc224 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872975.153679:0:24869:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb mtime from disk: 1788872960 -> 1788872975 00002000:00010000:0.0:1788872975.153682:0:24869:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb atime from disk: 1788872960 -> 1788872960 00002000:00010000:0.0:1788872975.153684:0:24869:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb ctime from disk: 1788872960 -> 1788872975 00002000:00010000:0.0:1788872975.153686:0:24869:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1788872975.153687:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01dc224 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1788872975.153692:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5c36a00 x1875765311268352/t4294969479(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1788872975.153694:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01dc224 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872975.153722:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2407:x1875765311268352:12345-192.168.204.39@tcp:10:dd.0 Request processed in 146us (1407us total) trans 4294969479 rc 0/0 00000100:00100000:0.0:1788872975.153729:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1009 00000001:00080000:1.0:1788872975.153730:0:66979:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051664 00002000:00010000:0.0:1788872975.153732:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/900 (0->18446744073709551615) 00002000:00100000:0.0:1788872975.153734:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5c36a00 with x1875765311268352 ext(0->18446744073709551615) 00002000:00010000:0.0:1788872975.153739:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5c36a00. 00000004:00010000:1.0:1788872975.153749:0:66979:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb95100a reply state 00000000c136aa3a transno 124554051665 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01dc224 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153761:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01dc224 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.153767:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff98a9f016a700) 00010000:00010000:1.0:1788872975.153769:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872975.153771:0:66979:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872975.153820:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+57:73755:x1875765311268736:12345-192.168.204.39@tcp:36:dd.0 Request processed in 591us (1443us total) trans 124554051665 rc 0/0 00000100:00100000:1.0:1788872975.153827:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1555 00000020:00080000:1.0:1788872975.153830:0:66979:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788872975.167420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.167464:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.167504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.167565:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311269376 00000100:00100000:1.0:1788872975.167575:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311269376 00000100:00100000:1.0:1788872975.167625:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311269504 00000100:00100000:1.0:1788872975.167628:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311269504 00000100:00100000:1.0:1788872975.167649:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1556 00000100:00100000:1.0:1788872975.167659:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+58:73758:x1875765311269376:12345-192.168.204.39@tcp:36:dd.0 00000100:00100000:2.0:1788872975.167683:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1557 00000100:00100000:2.0:1788872975.167692:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+58:73760:x1875765311269504:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.167701:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.167714:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872975.167720:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc22b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb414 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.167734:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc1d7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3f1 expref: 59 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.167745:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc232 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.167750:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff98a9e1f8f400) 00010000:00010000:1.0:1788872975.167753:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872975.167758:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc232 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.167766:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc232 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.167844:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc22b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb414 expref: 59 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.167859:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499000/0xe4e6e89fb01dc232 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb414 expref: 59 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.167865:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff98a9f016a000) 00010000:00010000:2.0:1788872975.167868:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788872975.167870:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4499000, rc 0) 00010000:00010000:1.0:1788872975.167900:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dc239 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.167910:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dc239 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.167917:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dc239 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872975.167935:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+59:73760:x1875765311269504:12345-192.168.204.39@tcp:101:dd.0 Request processed in 245us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.167942:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1557 00000001:00080000:1.0:1788872975.167958:0:83669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051666 00000004:00010000:1.0:1788872975.167980:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000569403c0 reply state 0000000033f81525 transno 124554051667 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dc239 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.168013:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dc239 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.168019:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff98a9e1f8f400) 00010000:00010000:1.0:1788872975.168021:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872975.168024:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872975.168073:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+60:73758:x1875765311269376:12345-192.168.204.39@tcp:36:dd.0 Request processed in 416us (608us total) trans 124554051667 rc 0/0 00000100:00100000:1.0:1788872975.168080:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1556 00000020:00080000:1.0:1788872975.168083:0:83669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788872975.170605:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311269120 00000100:00100000:3.0:1788872975.170620:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311269120 00002000:00010000:3.0:1788872975.170653:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/898 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.170658:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5ae0380 with x1875765311269120 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.170670:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5ae0380. 00000100:00100000:3.0:1788872975.170698:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1010 00000100:00100000:3.0:1788872975.170707:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2407:x1875765311269120:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:3.0:1788872975.170847:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788872975.170851:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb mtime from disk: 1788872960 -> 1788872975 00002000:00010000:3.0:1788872975.170854:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb atime from disk: 1788872960 -> 1788872960 00002000:00010000:3.0:1788872975.170856:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb ctime from disk: 1788872960 -> 1788872975 00002000:00010000:3.0:1788872975.170858:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788872975.170866:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5ae0380 x1875765311269120/t4294969480(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.170924:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2407:x1875765311269120:12345-192.168.204.39@tcp:10:dd.0 Request processed in 218us (3523us total) trans 4294969480 rc 0/0 00000100:00100000:3.0:1788872975.170947:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1010 00002000:00010000:3.0:1788872975.170951:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/898 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.170953:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5ae0380 with x1875765311269120 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.170958:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5ae0380. 00000100:00100000:2.0:1788872975.171427:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.174278:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311269888 00000100:00100000:3.0:1788872975.174291:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311269888 00000100:00100000:2.0:1788872975.174309:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.174350:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1558 00000100:00100000:3.0:1788872975.174360:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+60:73761:x1875765311269888:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.174386:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.174425:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8e00/0xe4e6e89fb01dc240 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb41b expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.174573:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc247 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.174587:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc247 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.174598:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc247 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.174611:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dc24e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.174617:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dc24e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.174623:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dc24e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872975.174941:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311269632 00000100:00100000:1.0:1788872975.174947:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311269632 00000100:00100000:1.0:1788872975.174986:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6037 00000100:00100000:1.0:1788872975.174994:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+11:73755:x1875765311269632:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872975.175004:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.175016:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01dc255 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb422 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872975.175036:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x383:0x0] initial LVB size: 0, mtime: 0x6aa00900, atime: 0x6aa00900, ctime: 0x6aa00900, blocks: 0x0 00010000:00010000:1.0:1788872975.175052:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x383:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:1.0:1788872975.175058:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x383:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872975.175066:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01dc255 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb422 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.175078:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01dc255 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb422 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.175103:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2800, rc 0) 00010000:00000080:1.0:1788872975.175111:0:8436:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c6c95880 x1875765311269632/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.175164:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+12:73755:x1875765311269632:12345-192.168.204.39@tcp:101:dd.0 Request processed in 170us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872975.175172:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6037 00010000:00010000:3.0:1788872975.175528:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc25c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.175538:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc25c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.175545:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc25c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872975.175583:0:66192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xd:0x0]: returning size 0 00010000:00010000:2.0:1788872975.175705:0:66192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc247 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175713:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc247 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175719:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc247 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175725:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc247 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175730:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872975.175734:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc247 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175741:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc247 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175753:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872975.175756:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872975.175760:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc247 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175767:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc247 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175779:0:66192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dc24e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175786:0:66192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dc24e lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175803:0:66192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dc24e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175810:0:66192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872975.175813:0:66192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dc24e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175820:0:66192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dc24e lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175829:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff98a9c5d04f00) 00010000:00010000:2.0:1788872975.175831:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872975.175834:0:66192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dc24e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175840:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8c00/0xe4e6e89fb01dc24e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175882:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8e00/0xe4e6e89fb01dc240 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb41b expref: 63 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175900:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc25c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb41b expref: 62 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.175906:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff98a9f016ab00) 00010000:00010000:2.0:1788872975.175908:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872975.175911:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9400, rc 0) 00000100:00100000:2.0:1788872975.175953:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+62:73761:x1875765311269888:12345-192.168.204.39@tcp:101:dd.0 Request processed in 1594us (4527us total) trans 124554051668 rc 0/0 00000100:00100000:2.0:1788872975.175968:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1558 00000100:00100000:0.0:1788872975.186896:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.190646:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311270144 00000100:00100000:3.0:1788872975.190662:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311270144 00000100:00100000:3.0:1788872975.190739:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 266 00000100:00100000:3.0:1788872975.190750:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+62:73756:x1875765311270144:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:3.0:1788872975.191084:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+63:73756:x1875765311270144:12345-192.168.204.39@tcp:35:dd.0 Request processed in 334us (4196us total) trans 124554051669 rc 0/0 00000100:00100000:3.0:1788872975.191092:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 266 00000100:00100000:0.0:1788872975.193675:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.193737:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.193899:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311270272 00000100:00100000:3.0:1788872975.193909:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311270272 00000100:00100000:2.0:1788872975.193913:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311270528 00000100:00100000:2.0:1788872975.193917:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311270528 00000100:00100000:2.0:1788872975.193965:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1559 00000100:00100000:3.0:1788872975.193966:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6038 00000100:00100000:3.0:1788872975.193975:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+12:73758:x1875765311270272:12345-192.168.204.39@tcp:101:dd.0 00000100:00100000:2.0:1788872975.193975:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+63:73760:x1875765311270528:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:3.0:1788872975.193999:0:26187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.194022:0:26187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01dc26a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb429 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.194031:0:66193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788872975.194047:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x386:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:2.0:1788872975.194055:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc216 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb406 expref: 63 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.194063:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x386:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1788872975.194074:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff98a9f016a000) 00010000:00010000:2.0:1788872975.194079:0:66193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872975.194081:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x386:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872975.194088:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01dc26a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb429 expref: 13 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.194103:0:26187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01dc26a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb429 expref: 13 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.194113:0:26187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8a00, rc 0) 00010000:00000080:3.0:1788872975.194120:0:26187:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9c77b2a00 x1875765311270272/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.194171:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+13:73758:x1875765311270272:12345-192.168.204.39@tcp:101:dd.0 Request processed in 198us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.194178:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6038 00010000:00010000:2.0:1788872975.194256:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc271 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.194269:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc271 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.194278:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc271 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788872975.194322:0:66193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051670 00000004:00010000:2.0:1788872975.194347:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c99c2a8 reply state 00000000a132e906 transno 124554051671 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc271 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.194357:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc271 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.194364:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff98a9f016a000) 00010000:00010000:2.0:1788872975.194367:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872975.194376:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872975.194445:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+65:73760:x1875765311270528:12345-192.168.204.39@tcp:36:dd.0 Request processed in 471us (707us total) trans 124554051671 rc 0/0 00000100:00100000:2.0:1788872975.194451:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1559 00000020:00080000:2.0:1788872975.194455:0:66193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788872975.200741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.200824:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311270784 00000100:00100000:3.0:1788872975.200836:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311270784 00000100:00100000:3.0:1788872975.200895:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 267 00000100:00100000:3.0:1788872975.200905:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+65:73754:x1875765311270784:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:3.0:1788872975.201289:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+66:73754:x1875765311270784:12345-192.168.204.39@tcp:35:dd.0 Request processed in 384us (556us total) trans 124554051672 rc 0/0 00000100:00100000:3.0:1788872975.201297:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 267 00000100:00100000:1.0:1788872975.201652:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.203769:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311270912 00000100:00100000:3.0:1788872975.203785:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311270912 00000100:00100000:3.0:1788872975.204669:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1560 00000100:00100000:3.0:1788872975.204686:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+66:73761:x1875765311270912:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.204710:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.204752:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01dc278 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb430 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.204797:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01dc27f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.204810:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01dc27f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.204822:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01dc27f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.204936:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01dc278 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb430 expref: 68 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.204956:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8000/0xe4e6e89fb01dc27f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb430 expref: 67 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.204963:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff98a9f016ab00) 00010000:00010000:3.0:1788872975.204966:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788872975.204969:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8000, rc 0) 00000100:00100000:3.0:1788872975.205034:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+67:73761:x1875765311270912:12345-192.168.204.39@tcp:101:dd.0 Request processed in 354us (3382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.205041:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1560 00000100:00100000:1.0:1788872975.218643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.218678:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.218710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.218738:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.219000:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311271168 00000100:00100000:3.0:1788872975.219011:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311271168 00002000:00010000:3.0:1788872975.219052:0:24855:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/902 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.219056:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c1c9d880 with x1875765311271168 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.219068:0:24855:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c1c9d880. 00000100:00100000:0.0:1788872975.219122:0:25436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311271040 00000100:00100000:0.0:1788872975.219127:0:25436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311271040 00002000:00010000:0.0:1788872975.219141:0:25436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/899 (0->18446744073709551615) 00002000:00100000:0.0:1788872975.219145:0:25436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9f663e680 with x1875765311271040 ext(0->18446744073709551615) 00002000:00010000:0.0:1788872975.219151:0:25436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9f663e680. 00000100:00100000:0.0:1788872975.219199:0:25436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1011 00000100:00100000:0.0:1788872975.219210:0:25436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+14:2406:x1875765311271040:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:0.0:1788872975.219429:0:25436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788872975.219433:0:25436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb mtime from disk: 1788872960 -> 1788872975 00002000:00010000:0.0:1788872975.219436:0:25436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb atime from disk: 1788872960 -> 1788872960 00002000:00010000:0.0:1788872975.219438:0:25436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb ctime from disk: 1788872960 -> 1788872975 00002000:00010000:0.0:1788872975.219441:0:25436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788872975.219451:0:25436:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f663e680 x1875765311271040/t4294969481(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.219526:0:25436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+15:2406:x1875765311271040:12345-192.168.204.39@tcp:10:dd.0 Request processed in 318us (846us total) trans 4294969481 rc 0/0 00000100:00100000:0.0:1788872975.219534:0:25436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1011 00002000:00010000:0.0:1788872975.219537:0:25436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/899 (0->18446744073709551615) 00002000:00100000:0.0:1788872975.219540:0:25436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9f663e680 with x1875765311271040 ext(0->18446744073709551615) 00002000:00010000:0.0:1788872975.219545:0:25436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9f663e680. 00000100:00100000:1.0:1788872975.220248:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.220283:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311271424 00000100:00100000:1.0:1788872975.220288:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311271424 00000100:00100000:1.0:1788872975.220332:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311271808 00000100:00100000:1.0:1788872975.220335:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311271808 00000100:00100000:1.0:1788872975.220362:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1561 00000100:00100000:1.0:1788872975.220370:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+68:73759:x1875765311271424:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872975.220389:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.220418:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc286 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb437 expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220539:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc28d lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220584:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc28d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220595:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc28d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220611:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc294 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220618:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc294 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220624:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc294 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220679:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc29b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220688:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc29b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220695:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc29b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788872975.220705:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788872975.220773:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc28d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220783:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc28d lrc: 2/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220789:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc28d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220800:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872975.220805:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc28d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220812:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc28d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220824:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:1.0:1788872975.220827:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872975.220832:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc28d lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220839:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3200/0xe4e6e89fb01dc28d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220852:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc294 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220857:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc294 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220864:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc294 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220869:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:1.0:1788872975.220871:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc294 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.220877:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc294 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.221472:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff98a9c1358400) 00010000:00010000:1.0:1788872975.221477:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788872975.221481:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc294 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.221488:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc294 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.221540:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc286 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb437 expref: 71 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.221590:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc29b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb437 expref: 70 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.221598:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff98a9f016ad00) 00010000:00010000:1.0:1788872975.221601:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788872975.221603:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2000, rc 0) 00000100:00100000:1.0:1788872975.221650:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+70:73759:x1875765311271424:12345-192.168.204.39@tcp:101:dd.0 Request processed in 1281us (2939us total) trans 124554051673 rc 0/0 00000100:00100000:1.0:1788872975.221657:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1561 00000100:00100000:1.0:1788872975.221683:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1562 00000100:00100000:1.0:1788872975.221691:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+69:73761:x1875765311271808:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:1.0:1788872975.221726:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872975.221743:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc25c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb41b expref: 69 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.221752:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff98a9f016ab00) 00010000:00010000:1.0:1788872975.221763:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872975.222496:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc2a9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.222511:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc2a9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.222522:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc2a9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788872975.222605:0:83669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051674 00000004:00010000:1.0:1788872975.222632:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d965c985 reply state 00000000aff9d0d8 transno 124554051675 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc2a9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.222644:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc2a9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.222650:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff98a9f016ab00) 00010000:00010000:1.0:1788872975.222652:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872975.222655:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872975.222715:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+71:73761:x1875765311271808:12345-192.168.204.39@tcp:36:dd.0 Request processed in 1023us (2467us total) trans 124554051675 rc 0/0 00000100:00100000:1.0:1788872975.222721:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1562 00000020:00080000:1.0:1788872975.222726:0:83669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788872975.223091:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1012 00000100:00100000:3.0:1788872975.223112:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+14:2406:x1875765311271168:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:3.0:1788872975.223237:0:24855:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788872975.223242:0:24855:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:3.0:1788872975.223244:0:24855:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:3.0:1788872975.223247:0:24855:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:3.0:1788872975.223249:0:24855:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788872975.223258:0:24855:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c1c9d880 x1875765311271168/t4294969482(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.223289:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+15:2406:x1875765311271168:12345-192.168.204.39@tcp:10:dd.0 Request processed in 180us (4657us total) trans 4294969482 rc 0/0 00000100:00100000:3.0:1788872975.223297:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1012 00002000:00010000:3.0:1788872975.223301:0:24855:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/902 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.223305:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c1c9d880 with x1875765311271168 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.223312:0:24855:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c1c9d880. 00000100:00100000:3.0:1788872975.223337:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311271552 00000100:00100000:3.0:1788872975.223344:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311271552 00000100:00100000:3.0:1788872975.223372:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6039 00000100:00100000:3.0:1788872975.223378:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+15:73760:x1875765311271552:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.223387:0:26183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.223403:0:26183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01dc2b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb43e expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872975.223430:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x388:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:3.0:1788872975.223445:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x388:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:3.0:1788872975.223449:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x388:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872975.223463:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01dc2b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb43e expref: 16 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.223479:0:26183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01dc2b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb43e expref: 16 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.223489:0:26183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8200, rc 0) 00010000:00000080:3.0:1788872975.223495:0:26183:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f663f800 x1875765311271552/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.223518:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+16:73760:x1875765311271552:12345-192.168.204.39@tcp:101:dd.0 Request processed in 140us (4780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.223525:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6039 00000100:00100000:0.0:1788872975.232578:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.232626:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.232846:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311271936 00000100:00100000:2.0:1788872975.232855:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311271936 00000100:00100000:2.0:1788872975.232914:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311272192 00000100:00100000:2.0:1788872975.232918:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311272192 00000100:00100000:2.0:1788872975.232941:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1563 00000100:00100000:2.0:1788872975.232952:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+72:73759:x1875765311271936:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.232979:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.233014:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc2b7 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb445 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.233055:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499a00/0xe4e6e89fb01dc2be lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.233070:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499a00/0xe4e6e89fb01dc2be lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.233083:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499a00/0xe4e6e89fb01dc2be lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.233240:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498a00/0xe4e6e89fb01dc2b7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb445 expref: 74 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.233266:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499a00/0xe4e6e89fb01dc2be lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb445 expref: 73 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.233288:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff98a9f016ad00) 00010000:00010000:2.0:1788872975.233291:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788872975.233296:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4499a00, rc 0) 00000100:00100000:2.0:1788872975.236824:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f85c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+73:73759:x1875765311271936:12345-192.168.204.39@tcp:101:dd.0 Request processed in 3862us (4264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.236838:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1563 00000100:00100000:2.0:1788872975.236882:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1564 00000100:00100000:2.0:1788872975.236909:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+72:73762:x1875765311272192:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.236928:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.236950:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498600/0xe4e6e89fb01dc2c5 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb44c expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237095:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499800/0xe4e6e89fb01dc2cc lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237111:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499800/0xe4e6e89fb01dc2cc lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237123:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499800/0xe4e6e89fb01dc2cc lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237137:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498c00/0xe4e6e89fb01dc2d3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237145:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498c00/0xe4e6e89fb01dc2d3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237151:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498c00/0xe4e6e89fb01dc2d3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237250:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498400/0xe4e6e89fb01dc2da lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237259:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498400/0xe4e6e89fb01dc2da lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237266:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498400/0xe4e6e89fb01dc2da lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872975.237276:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788872975.237357:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499800/0xe4e6e89fb01dc2cc lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237365:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499800/0xe4e6e89fb01dc2cc lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237371:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499800/0xe4e6e89fb01dc2cc lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237378:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499800/0xe4e6e89fb01dc2cc lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237384:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4499800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872975.237388:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499800/0xe4e6e89fb01dc2cc lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237396:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499800/0xe4e6e89fb01dc2cc lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237417:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872975.237420:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872975.237431:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499800/0xe4e6e89fb01dc2cc lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237438:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499800/0xe4e6e89fb01dc2cc lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237454:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498c00/0xe4e6e89fb01dc2d3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237460:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498c00/0xe4e6e89fb01dc2d3 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237467:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498c00/0xe4e6e89fb01dc2d3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237471:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4498c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872975.237475:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498c00/0xe4e6e89fb01dc2d3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237480:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498c00/0xe4e6e89fb01dc2d3 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237488:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff98a9faf66b00) 00010000:00010000:2.0:1788872975.237490:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872975.237493:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498c00/0xe4e6e89fb01dc2d3 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237500:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498c00/0xe4e6e89fb01dc2d3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237540:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498600/0xe4e6e89fb01dc2c5 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb44c expref: 75 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237584:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498400/0xe4e6e89fb01dc2da lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb44c expref: 74 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.237593:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff98a9f016aa00) 00010000:00010000:2.0:1788872975.237595:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872975.237598:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4498400, rc 0) 00000100:00100000:2.0:1788872975.237659:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+74:73762:x1875765311272192:12345-192.168.204.39@tcp:101:dd.0 Request processed in 769us (5032us total) trans 124554051676 rc 0/0 00000100:00100000:2.0:1788872975.237666:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1564 00000100:00100000:1.0:1788872975.240943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.241067:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311272320 00000100:00100000:2.0:1788872975.241077:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311272320 00000100:00100000:2.0:1788872975.241126:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6040 00000100:00100000:2.0:1788872975.241136:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f663c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+16:73761:x1875765311272320:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.241154:0:26199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.241195:0:26199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c5ab107/0xe4e6e89fb01dc2e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb453 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788872975.241222:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x389:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:2.0:1788872975.241245:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x389:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1788872975.241250:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x389:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872975.241260:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c5ab107/0xe4e6e89fb01dc2e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb453 expref: 17 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.241276:0:26199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002c5ab107/0xe4e6e89fb01dc2e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb453 expref: 17 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.241304:0:26199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4499e00, rc 0) 00010000:00000080:2.0:1788872975.241313:0:26199:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f663c000 x1875765311272320/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872975.241363:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f663c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+17:73761:x1875765311272320:12345-192.168.204.39@tcp:101:dd.0 Request processed in 227us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.241370:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6040 00000100:00100000:1.0:1788872975.241668:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.241874:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311272448 00000100:00100000:2.0:1788872975.241879:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311272448 00002000:00010000:2.0:1788872975.241899:0:24856:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/904 (0->18446744073709551615) 00002000:00100000:2.0:1788872975.241903:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738ca80 with x1875765311272448 ext(0->18446744073709551615) 00002000:00010000:2.0:1788872975.241912:0:24856:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738ca80. 00000100:00100000:2.0:1788872975.241936:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1013 00000100:00100000:2.0:1788872975.241944:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+17:2404:x1875765311272448:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:2.0:1788872975.242099:0:24856:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788872975.242103:0:24856:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:2.0:1788872975.242106:0:24856:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:2.0:1788872975.242108:0:24856:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:2.0:1788872975.242111:0:24856:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788872975.242117:0:24856:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738ca80 x1875765311272448/t4294969483(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872975.242143:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+18:2404:x1875765311272448:12345-192.168.204.39@tcp:10:dd.0 Request processed in 201us (476us total) trans 4294969483 rc 0/0 00000100:00100000:2.0:1788872975.242150:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1013 00002000:00010000:2.0:1788872975.242173:0:24856:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/904 (0->18446744073709551615) 00002000:00100000:2.0:1788872975.242176:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738ca80 with x1875765311272448 ext(0->18446744073709551615) 00002000:00010000:2.0:1788872975.242181:0:24856:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738ca80. 00000100:00100000:1.0:1788872975.242662:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.242740:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311272704 00000100:00100000:2.0:1788872975.242745:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311272704 00000100:00100000:2.0:1788872975.242783:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 268 00000100:00100000:2.0:1788872975.242791:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+74:73755:x1875765311272704:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:2.0:1788872975.243050:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+75:73755:x1875765311272704:12345-192.168.204.39@tcp:35:dd.0 Request processed in 258us (388us total) trans 124554051677 rc 0/0 00000100:00100000:2.0:1788872975.243058:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 268 00000100:00100000:1.0:1788872975.254835:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.254937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.254973:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.255003:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.255060:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.255084:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.255466:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311273344 00000100:00100000:3.0:1788872975.255478:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311273344 00000100:00100000:2.0:1788872975.255493:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311273216 00000100:00100000:2.0:1788872975.255500:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311273216 00000100:00100000:2.0:1788872975.255538:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311273472 00000100:00100000:2.0:1788872975.255542:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311273472 00000100:00100000:2.0:1788872975.255575:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311273728 00000100:00100000:2.0:1788872975.255579:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311273728 00000100:00100000:2.0:1788872975.255599:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1565 00000100:00100000:2.0:1788872975.255609:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+77:73759:x1875765311273216:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:2.0:1788872975.255669:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872975.255699:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc29b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb437 expref: 77 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.255722:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff98a9f016ad00) 00010000:00010000:2.0:1788872975.255727:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872975.255911:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc2ef lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872975.255915:0:24865:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/905 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.255923:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738c380 with x1875765311273344 ext(0->18446744073709551615) 00010000:00010000:2.0:1788872975.255929:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc2ef lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872975.255933:0:24865:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738c380. 00010000:00010000:2.0:1788872975.255951:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc2ef lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788872975.255957:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1014 00000100:00100000:3.0:1788872975.255968:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+18:2405:x1875765311273344:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:3.0:1788872975.256071:0:24865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788872975.256075:0:24865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:3.0:1788872975.256078:0:24865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:3.0:1788872975.256080:0:24865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:3.0:1788872975.256083:0:24865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788872975.256092:0:24865:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738c380 x1875765311273344/t4294969484(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000001:00080000:2.0:1788872975.256101:0:83669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051678 00000004:00010000:2.0:1788872975.256132:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be464d32 reply state 00000000cc37730a transno 124554051679 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc2ef lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256146:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc2ef lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256153:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff98a9f016ad00) 00010000:00010000:2.0:1788872975.256156:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872975.256159:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788872975.256166:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+19:2405:x1875765311273344:12345-192.168.204.39@tcp:10:dd.0 Request processed in 199us (1191us total) trans 4294969484 rc 0/0 00000100:00100000:3.0:1788872975.256175:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1014 00002000:00010000:3.0:1788872975.256179:0:24865:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/905 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.256183:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738c380 with x1875765311273344 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.256188:0:24865:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738c380. 00000100:00100000:2.0:1788872975.256228:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+79:73759:x1875765311273216:12345-192.168.204.39@tcp:36:dd.0 Request processed in 619us (1289us total) trans 124554051679 rc 0/0 00000100:00100000:2.0:1788872975.256236:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1565 00000020:00080000:2.0:1788872975.256240:0:83669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788872975.256258:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1566 00000100:00100000:2.0:1788872975.256266:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+78:73762:x1875765311273472:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.256277:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.256289:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dc2f6 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb45a expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256313:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc2fd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256321:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc2fd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256339:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc2fd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256422:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499400/0xe4e6e89fb01dc2f6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb45a expref: 80 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256440:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498e00/0xe4e6e89fb01dc2fd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb45a expref: 79 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256447:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff98a9f016aa00) 00010000:00010000:2.0:1788872975.256450:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788872975.256452:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4498e00, rc 0) 00000100:00100000:2.0:1788872975.256489:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+79:73762:x1875765311273472:12345-192.168.204.39@tcp:101:dd.0 Request processed in 223us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.256496:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1566 00000100:00100000:2.0:1788872975.256511:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1567 00000100:00100000:2.0:1788872975.256518:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+78:73763:x1875765311273728:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.256526:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.256536:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dc304 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb461 expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256663:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dc30b lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256673:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dc30b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256690:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dc30b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256704:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dc312 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256712:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dc312 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256718:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dc312 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256761:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dc319 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256769:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dc319 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256778:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dc319 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872975.256787:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xf:0x0]: returning size 0 00010000:00010000:2.0:1788872975.256835:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dc30b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256843:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dc30b lrc: 2/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256849:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dc30b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256855:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872975.256867:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dc30b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256875:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dc30b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256885:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872975.256888:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872975.256891:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dc30b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256897:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898e00/0xe4e6e89fb01dc30b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256909:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dc312 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256915:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dc312 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256921:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dc312 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256926:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872975.256929:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dc312 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256935:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dc312 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256942:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff98a9faf66400) 00010000:00010000:2.0:1788872975.256944:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872975.256954:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dc312 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.256961:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898400/0xe4e6e89fb01dc312 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872975.261699:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00010000:00010000:2.0:1788872975.262803:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899400/0xe4e6e89fb01dc304 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb461 expref: 81 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.262832:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dc319 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb461 expref: 80 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.262841:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff98a9e1f8fb00) 00010000:00010000:2.0:1788872975.262844:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872975.262847:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899c00, rc 0) 00000100:00100000:2.0:1788872975.262921:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+80:73763:x1875765311273728:12345-192.168.204.39@tcp:101:dd.0 Request processed in 6402us (7859us total) trans 124554051680 rc 0/0 00000100:00100000:2.0:1788872975.262931:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1567 00000100:00100000:0.0:1788872975.263374:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311272960 00000100:00100000:0.0:1788872975.263386:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311272960 00000100:00100000:0.0:1788872975.263443:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311273984 00000100:00100000:0.0:1788872975.263447:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311273984 00000100:00100000:0.0:1788872975.263465:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 269 00000100:00100000:0.0:1788872975.263473:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfc02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+81:73758:x1875765311272960:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:3.0:1788872975.263627:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 270 00000100:00100000:3.0:1788872975.263637:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+81:73760:x1875765311273984:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:0.0:1788872975.263776:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfc02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+83:73758:x1875765311272960:12345-192.168.204.39@tcp:35:dd.0 Request processed in 302us (8950us total) trans 124554051681 rc 0/0 00000100:00100000:3.0:1788872975.263784:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+83:73760:x1875765311273984:12345-192.168.204.39@tcp:35:dd.0 Request processed in 146us (8696us total) trans 124554051682 rc 0/0 00000100:00100000:0.0:1788872975.263792:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 269 00000100:00100000:3.0:1788872975.263860:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 270 00000100:00100000:1.0:1788872975.264788:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311274240 00000100:00100000:1.0:1788872975.264797:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311274240 00000100:00100000:1.0:1788872975.264829:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 271 00000100:00100000:1.0:1788872975.264836:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+82:73761:x1875765311274240:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:1.0:1788872975.265048:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+83:73761:x1875765311274240:12345-192.168.204.39@tcp:35:dd.0 Request processed in 210us (3358us total) trans 124554051683 rc 0/0 00000100:00100000:1.0:1788872975.265056:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 271 00000100:00100000:2.0:1788872975.268613:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.268656:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.268687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.268708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.268737:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311274496 00000100:00100000:2.0:1788872975.268746:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311274496 00000100:00100000:2.0:1788872975.268786:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311274752 00000100:00100000:2.0:1788872975.268789:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311274752 00000100:00100000:2.0:1788872975.268805:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311275008 00000100:00100000:2.0:1788872975.268807:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311275008 00000100:00100000:2.0:1788872975.268825:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1568 00000100:00100000:2.0:1788872975.268834:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+85:73762:x1875765311274496:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:2.0:1788872975.268912:0:68674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872975.268941:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498400/0xe4e6e89fb01dc2da lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb44c expref: 85 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.268962:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff98a9f016aa00) 00010000:00010000:2.0:1788872975.268967:0:68674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872975.269152:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dc327 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269181:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dc327 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269201:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dc327 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788872975.269251:0:68674:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051684 00000004:00010000:2.0:1788872975.269282:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050260fd5 reply state 00000000600fbdee transno 124554051685 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dc327 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269296:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dc327 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269302:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff98a9f016aa00) 00010000:00010000:2.0:1788872975.269305:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872975.269308:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872975.269398:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+87:73762:x1875765311274496:12345-192.168.204.39@tcp:36:dd.0 Request processed in 564us (795us total) trans 124554051685 rc 0/0 00000100:00100000:2.0:1788872975.269416:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1568 00000020:00080000:2.0:1788872975.269421:0:68674:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788872975.269440:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1569 00000100:00100000:2.0:1788872975.269455:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+86:73763:x1875765311274752:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.269466:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.269480:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dc32e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb46f expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269502:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838e00/0xe4e6e89fb01dc335 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269511:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838e00/0xe4e6e89fb01dc335 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269518:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838e00/0xe4e6e89fb01dc335 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269614:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898800/0xe4e6e89fb01dc32e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb46f expref: 88 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269631:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838e00/0xe4e6e89fb01dc335 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb46f expref: 87 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269639:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff98a9e1f8fb00) 00010000:00010000:2.0:1788872975.269641:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788872975.269643:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4838e00, rc 0) 00000100:00100000:2.0:1788872975.269672:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+87:73763:x1875765311274752:12345-192.168.204.39@tcp:101:dd.0 Request processed in 218us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.269678:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1569 00000100:00100000:2.0:1788872975.269693:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1570 00000100:00100000:2.0:1788872975.269699:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+86:73764:x1875765311275008:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.269718:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.269728:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838200/0xe4e6e89fb01dc33c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb476 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269828:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838800/0xe4e6e89fb01dc343 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269838:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838800/0xe4e6e89fb01dc343 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269847:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838800/0xe4e6e89fb01dc343 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269859:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838c00/0xe4e6e89fb01dc34a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269866:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838c00/0xe4e6e89fb01dc34a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269873:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838c00/0xe4e6e89fb01dc34a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269910:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839600/0xe4e6e89fb01dc351 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269918:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839600/0xe4e6e89fb01dc351 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269925:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839600/0xe4e6e89fb01dc351 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872975.269933:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x10:0x0]: returning size 0 00010000:00010000:2.0:1788872975.269987:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838800/0xe4e6e89fb01dc343 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.269995:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838800/0xe4e6e89fb01dc343 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270002:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838800/0xe4e6e89fb01dc343 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270009:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838800/0xe4e6e89fb01dc343 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270014:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4838800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872975.270019:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838800/0xe4e6e89fb01dc343 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270026:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838800/0xe4e6e89fb01dc343 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270035:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872975.270038:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872975.270041:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838800/0xe4e6e89fb01dc343 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270047:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838800/0xe4e6e89fb01dc343 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270056:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838c00/0xe4e6e89fb01dc34a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270062:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838c00/0xe4e6e89fb01dc34a lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270068:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838c00/0xe4e6e89fb01dc34a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270078:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4838c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872975.270081:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838c00/0xe4e6e89fb01dc34a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270087:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838c00/0xe4e6e89fb01dc34a lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270095:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff98a9faf66e00) 00010000:00010000:2.0:1788872975.270097:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872975.270100:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838c00/0xe4e6e89fb01dc34a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270105:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838c00/0xe4e6e89fb01dc34a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270138:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838200/0xe4e6e89fb01dc33c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb476 expref: 89 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270150:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839600/0xe4e6e89fb01dc351 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb476 expref: 88 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.270157:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:2.0:1788872975.270159:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872975.270161:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4839600, rc 0) 00000100:00100000:2.0:1788872975.270184:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+88:73764:x1875765311275008:12345-192.168.204.39@tcp:101:dd.0 Request processed in 485us (1475us total) trans 124554051686 rc 0/0 00000100:00100000:2.0:1788872975.270191:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1570 00000100:00100000:3.0:1788872975.271069:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311274624 00000100:00100000:3.0:1788872975.271078:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311274624 00000100:00100000:3.0:1788872975.271133:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6041 00000100:00100000:3.0:1788872975.271142:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8ca10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+19:73759:x1875765311274624:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.271166:0:26189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.271193:0:26189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01dc35f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb468 expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872975.271219:0:26189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x387:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:3.0:1788872975.271237:0:26189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x387:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:3.0:1788872975.271242:0:26189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x387:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872975.271251:0:26189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01dc35f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb468 expref: 20 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.271284:0:26189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01dc35f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb468 expref: 20 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.271297:0:26189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9c00, rc 0) 00010000:00000080:3.0:1788872975.271305:0:26189:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8ca10aa00 x1875765311274624/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.271363:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8ca10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+20:73759:x1875765311274624:12345-192.168.204.39@tcp:101:dd.0 Request processed in 222us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.271370:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6041 00000100:00100000:2.0:1788872975.276829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.277150:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311275136 00000100:00100000:0.0:1788872975.277178:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311275136 00000100:00100000:0.0:1788872975.277254:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6042 00000100:00100000:0.0:1788872975.277264:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+20:73762:x1875765311275136:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.277284:0:26182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.277304:0:26182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01dc366 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb47d expref: -99 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872975.277332:0:26182:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38a:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:0.0:1788872975.277358:0:26182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38a:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1788872975.277363:0:26182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872975.277374:0:26182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01dc366 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb47d expref: 21 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.277391:0:26182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01dc366 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb47d expref: 21 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.277412:0:26182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4800, rc 0) 00010000:00000080:0.0:1788872975.277421:0:26182:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f67a2300 x1875765311275136/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.277479:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+21:73762:x1875765311275136:12345-192.168.204.39@tcp:101:dd.0 Request processed in 216us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.277486:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6042 00000100:00100000:2.0:1788872975.280258:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.280441:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311275392 00000100:00100000:0.0:1788872975.280450:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311275392 00000100:00100000:0.0:1788872975.280497:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1571 00000100:00100000:0.0:1788872975.280505:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f09d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+88:73763:x1875765311275392:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:0.0:1788872975.280588:0:68674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872975.280614:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa899c00/0xe4e6e89fb01dc319 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb461 expref: 88 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.280634:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff98a9e1f8fb00) 00010000:00010000:0.0:1788872975.280639:0:68674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872975.280796:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc36d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.280809:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc36d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.280817:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc36d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788872975.280853:0:68674:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051687 00000004:00010000:0.0:1788872975.280870:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046bb7bc9 reply state 0000000015d50f33 transno 124554051688 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc36d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.280880:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc36d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.280886:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff98a9e1f8fb00) 00010000:00010000:0.0:1788872975.280889:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872975.280903:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788872975.280975:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f09d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+90:73763:x1875765311275392:12345-192.168.204.39@tcp:36:dd.0 Request processed in 470us (727us total) trans 124554051688 rc 0/0 00000100:00100000:0.0:1788872975.280982:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1571 00000020:00080000:0.0:1788872975.280986:0:68674:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788872975.287302:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.287417:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.287570:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311275520 00000100:00100000:0.0:1788872975.287594:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311275520 00002000:00010000:0.0:1788872975.287637:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/903 (0->18446744073709551615) 00002000:00100000:0.0:1788872975.287642:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738d180 with x1875765311275520 ext(0->18446744073709551615) 00002000:00010000:0.0:1788872975.287655:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738d180. 00000100:00100000:0.0:1788872975.287686:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1015 00000100:00100000:0.0:1788872975.287697:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+21:2404:x1875765311275520:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:0.0:1788872975.287856:0:24869:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788872975.287860:0:24869:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:0.0:1788872975.287862:0:24869:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:0.0:1788872975.287864:0:24869:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:0.0:1788872975.287866:0:24869:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788872975.287875:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738d180 x1875765311275520/t4294969485(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.287946:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+22:2404:x1875765311275520:12345-192.168.204.39@tcp:10:dd.0 Request processed in 250us (652us total) trans 4294969485 rc 0/0 00000100:00100000:0.0:1788872975.287953:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1015 00002000:00010000:0.0:1788872975.287957:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/903 (0->18446744073709551615) 00002000:00100000:0.0:1788872975.287960:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738d180 with x1875765311275520 ext(0->18446744073709551615) 00002000:00010000:0.0:1788872975.287964:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738d180. 00000100:00100000:3.0:1788872975.289275:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311275776 00000100:00100000:3.0:1788872975.289287:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311275776 00000100:00100000:3.0:1788872975.289342:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1572 00000100:00100000:3.0:1788872975.289350:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+90:73765:x1875765311275776:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.289377:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.289401:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01dc374 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb484 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289569:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dc37b lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289584:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dc37b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289596:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dc37b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289632:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc382 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289640:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc382 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289647:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc382 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289712:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8e00/0xe4e6e89fb01dc389 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289721:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8e00/0xe4e6e89fb01dc389 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289729:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8e00/0xe4e6e89fb01dc389 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788872975.289739:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x11:0x0]: returning size 0 00010000:00010000:3.0:1788872975.289813:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dc37b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289821:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dc37b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289827:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dc37b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289833:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dc37b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289839:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c8800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872975.289851:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dc37b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289859:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dc37b lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289872:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:3.0:1788872975.289875:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872975.289879:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dc37b lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289887:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8800/0xe4e6e89fb01dc37b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289914:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc382 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289921:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc382 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289927:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc382 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289932:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872975.289935:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc382 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289941:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc382 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289948:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff98a9c5d04800) 00010000:00010000:3.0:1788872975.289950:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872975.289959:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc382 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.289965:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc382 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.290021:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01dc374 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb484 expref: 93 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.290037:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8e00/0xe4e6e89fb01dc389 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb484 expref: 92 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.290044:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff98a9e1f8f100) 00010000:00010000:3.0:1788872975.290047:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788872975.290050:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8e00, rc 0) 00000100:00100000:3.0:1788872975.290122:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+92:73765:x1875765311275776:12345-192.168.204.39@tcp:101:dd.0 Request processed in 772us (2705us total) trans 124554051689 rc 0/0 00000100:00100000:3.0:1788872975.290129:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1572 00000100:00100000:3.0:1788872975.291595:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.297441:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311275904 00000100:00100000:1.0:1788872975.297458:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311275904 00000100:00100000:1.0:1788872975.297537:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1573 00000100:00100000:1.0:1788872975.297572:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+92:73764:x1875765311275904:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872975.297593:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.297615:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc397 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb48b expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.297649:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dc39e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.297663:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dc39e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.297674:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dc39e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.297804:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc397 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb48b expref: 94 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.297827:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3c00/0xe4e6e89fb01dc39e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb48b expref: 93 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.297834:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:1.0:1788872975.297837:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788872975.297840:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d3c00, rc 0) 00000100:00100000:1.0:1788872975.297900:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+93:73764:x1875765311275904:12345-192.168.204.39@tcp:101:dd.0 Request processed in 353us (6311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872975.297907:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1573 00000100:00100000:2.0:1788872975.299742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.299784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.299850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.299925:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311276288 00000100:00100000:0.0:1788872975.299935:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311276288 00000100:00100000:0.0:1788872975.299986:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1574 00000100:00100000:0.0:1788872975.300004:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+93:73765:x1875765311276288:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.300031:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.300052:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc3a5 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb499 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.300100:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc3ac lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.300113:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc3ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.300125:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc3ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.300251:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc3a5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb499 expref: 95 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.300268:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4c00/0xe4e6e89fb01dc3ac lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb499 expref: 94 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.300276:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff98a9e1f8f100) 00010000:00010000:0.0:1788872975.300278:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788872975.300281:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac4c00, rc 0) 00000100:00100000:0.0:1788872975.300329:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+94:73765:x1875765311276288:12345-192.168.204.39@tcp:101:dd.0 Request processed in 335us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.300336:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1574 00000100:00100000:3.0:1788872975.301125:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311276160 00000100:00100000:3.0:1788872975.301137:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311276160 00002000:00010000:3.0:1788872975.301179:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/906 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.301184:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe6680 with x1875765311276160 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.301201:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe6680. 00000100:00100000:3.0:1788872975.301239:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1016 00000100:00100000:3.0:1788872975.301248:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+22:2405:x1875765311276160:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:3.0:1788872975.301390:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788872975.301394:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:3.0:1788872975.301418:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:3.0:1788872975.301421:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:3.0:1788872975.301423:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788872975.301432:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe6680 x1875765311276160/t4294969486(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.301477:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+23:2405:x1875765311276160:12345-192.168.204.39@tcp:10:dd.0 Request processed in 230us (1692us total) trans 4294969486 rc 0/0 00000100:00100000:3.0:1788872975.301484:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1016 00002000:00010000:3.0:1788872975.301487:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/906 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.301489:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe6680 with x1875765311276160 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.301494:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe6680. 00000100:00100000:1.0:1788872975.301845:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311276032 00000100:00100000:1.0:1788872975.301851:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311276032 00000100:00100000:1.0:1788872975.301901:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6043 00000100:00100000:1.0:1788872975.301910:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+23:73763:x1875765311276032:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872975.301919:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.301935:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01dc3b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb492 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788872975.301952:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38b:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:1.0:1788872975.301968:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38b:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:1.0:1788872975.301973:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788872975.301980:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01dc3b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb492 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.302011:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01dc3b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb492 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.302024:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2a00, rc 0) 00010000:00000080:1.0:1788872975.302028:0:8437:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe4a80 x1875765311276032/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.302056:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+24:73763:x1875765311276032:12345-192.168.204.39@tcp:101:dd.0 Request processed in 148us (2323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872975.302062:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6043 00000100:00100000:3.0:1788872975.304622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.304666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.305930:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311276544 00000100:00100000:1.0:1788872975.305944:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311276544 00000100:00100000:1.0:1788872975.306006:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 272 00000100:00100000:1.0:1788872975.306016:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+94:73759:x1875765311276544:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:1.0:1788872975.306566:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+95:73759:x1875765311276544:12345-192.168.204.39@tcp:35:dd.0 Request processed in 530us (1930us total) trans 124554051690 rc 0/0 00000100:00100000:1.0:1788872975.306577:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 272 00000100:00100000:0.0:1788872975.307100:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311276800 00000100:00100000:0.0:1788872975.307106:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311276800 00000100:00100000:0.0:1788872975.307151:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1575 00000100:00100000:0.0:1788872975.307168:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+95:73766:x1875765311276800:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.307191:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.307214:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc3ba lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4a0 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307356:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc3c1 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307372:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc3c1 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307385:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc3c1 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307400:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc3c8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307418:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc3c8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307425:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc3c8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307478:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc3cf lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307487:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc3cf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307494:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc3cf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872975.307506:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x12:0x0]: returning size 0 00010000:00010000:0.0:1788872975.307595:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc3c1 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307603:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc3c1 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307615:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc3c1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307622:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc3c1 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307629:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.307633:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc3c1 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307641:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc3c1 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307652:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872975.307655:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.307659:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc3c1 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307665:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc3c1 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307678:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc3c8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307684:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc3c8 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307690:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc3c8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307695:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac5a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.307705:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc3c8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307712:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc3c8 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307720:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff98a9d14a2400) 00010000:00010000:0.0:1788872975.307722:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.307725:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc3c8 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307731:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc3c8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307770:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc3ba lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4a0 expref: 98 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307783:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc3cf lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4a0 expref: 97 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.307791:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff98a9c5d04c00) 00010000:00010000:0.0:1788872975.307793:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872975.307795:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58ae600, rc 0) 00000100:00100000:0.0:1788872975.307832:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+97:73766:x1875765311276800:12345-192.168.204.39@tcp:101:dd.0 Request processed in 665us (3166us total) trans 124554051691 rc 0/0 00000100:00100000:0.0:1788872975.307838:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1575 00000100:00100000:2.0:1788872975.310635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.310720:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311277056 00000100:00100000:1.0:1788872975.310731:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311277056 00000100:00100000:1.0:1788872975.310789:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1576 00000100:00100000:1.0:1788872975.310799:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+97:73765:x1875765311277056:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:1.0:1788872975.310875:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872975.310912:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8e00/0xe4e6e89fb01dc389 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb484 expref: 97 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.310941:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff98a9e1f8f100) 00010000:00010000:1.0:1788872975.310945:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872975.311147:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc3dd lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.311174:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc3dd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.311339:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc3dd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788872975.311394:0:83669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051692 00000004:00010000:1.0:1788872975.311434:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004ee038cb reply state 0000000092c3c1af transno 124554051693 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc3dd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.311446:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc3dd lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.311453:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff98a9e1f8f100) 00010000:00010000:1.0:1788872975.311456:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872975.311459:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872975.311572:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+99:73765:x1875765311277056:12345-192.168.204.39@tcp:36:dd.0 Request processed in 749us (923us total) trans 124554051693 rc 0/0 00000100:00100000:1.0:1788872975.311580:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1576 00000020:00080000:1.0:1788872975.311585:0:83669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788872975.316123:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.316181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.316272:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311277312 00000100:00100000:0.0:1788872975.316284:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311277312 00000100:00100000:0.0:1788872975.316347:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1577 00000100:00100000:0.0:1788872975.316358:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+99:73764:x1875765311277312:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:0.0:1788872975.316449:0:68674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872975.316482:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839600/0xe4e6e89fb01dc351 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb476 expref: 99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.316508:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:0.0:1788872975.316513:0:68674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872975.316737:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dc3e4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.316752:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dc3e4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.316763:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dc3e4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788872975.316812:0:68674:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051694 00000004:00010000:0.0:1788872975.316836:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b3ada94 reply state 00000000f184d1a3 transno 124554051695 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dc3e4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.316848:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dc3e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.316854:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:0.0:1788872975.316856:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872975.316859:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788872975.316952:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+101:73764:x1875765311277312:12345-192.168.204.39@tcp:36:dd.0 Request processed in 596us (838us total) trans 124554051695 rc 0/0 00000100:00100000:0.0:1788872975.316960:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1577 00000020:00080000:0.0:1788872975.316965:0:68674:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788872975.317184:0:25436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311277440 00000100:00100000:3.0:1788872975.317190:0:25436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311277440 00002000:00010000:3.0:1788872975.317218:0:25436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/907 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.317224:0:25436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe4700 with x1875765311277440 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.317232:0:25436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe4700. 00000100:00100000:3.0:1788872975.317258:0:25436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1017 00000100:00100000:3.0:1788872975.317266:0:25436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+24:2404:x1875765311277440:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:3.0:1788872975.317377:0:25436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788872975.317380:0:25436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:3.0:1788872975.317383:0:25436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:3.0:1788872975.317385:0:25436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:3.0:1788872975.317387:0:25436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788872975.317397:0:25436:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe4700 x1875765311277440/t4294969487(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.317464:0:25436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2404:x1875765311277440:12345-192.168.204.39@tcp:10:dd.0 Request processed in 199us (1282us total) trans 4294969487 rc 0/0 00000100:00100000:3.0:1788872975.317471:0:25436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1017 00002000:00010000:3.0:1788872975.317474:0:25436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/907 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.317477:0:25436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe4700 with x1875765311277440 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.317482:0:25436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe4700. 00000100:00100000:2.0:1788872975.320957:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.321807:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311277568 00000100:00100000:0.0:1788872975.321832:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311277568 00000100:00100000:0.0:1788872975.321890:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6044 00000100:00100000:0.0:1788872975.321900:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+25:73765:x1875765311277568:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.321918:0:26188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.321941:0:26188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01dc3eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4a7 expref: -99 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872975.321968:0:26188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38d:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:0.0:1788872975.322000:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38d:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1788872975.322005:0:26188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872975.322014:0:26188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01dc3eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4a7 expref: 26 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.322032:0:26188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01dc3eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4a7 expref: 26 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.322045:0:26188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58aea00, rc 0) 00010000:00000080:0.0:1788872975.322054:0:26188:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe5880 x1875765311277568/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.322808:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+26:73765:x1875765311277568:12345-192.168.204.39@tcp:101:dd.0 Request processed in 901us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.322820:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6044 00000100:00100000:0.0:1788872975.337144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.337428:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.337471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.337501:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.337539:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.337602:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.337669:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311278080 00000100:00100000:2.0:1788872975.337680:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311278080 00000100:00100000:2.0:1788872975.337734:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311278336 00000100:00100000:2.0:1788872975.337738:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311278336 00000100:00100000:2.0:1788872975.337760:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1578 00000100:00100000:2.0:1788872975.337769:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+102:73766:x1875765311278080:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.337795:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.337817:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838a00/0xe4e6e89fb01dc3f2 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4b5 expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.337851:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839800/0xe4e6e89fb01dc3f9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.337864:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839800/0xe4e6e89fb01dc3f9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.337874:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839800/0xe4e6e89fb01dc3f9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338004:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838a00/0xe4e6e89fb01dc3f2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4b5 expref: 104 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338039:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839800/0xe4e6e89fb01dc3f9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4b5 expref: 103 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338047:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff98a9c5d04c00) 00010000:00010000:2.0:1788872975.338050:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788872975.338054:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4839800, rc 0) 00000100:00100000:2.0:1788872975.338113:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+103:73766:x1875765311278080:12345-192.168.204.39@tcp:101:dd.0 Request processed in 345us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.338120:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1578 00000100:00100000:2.0:1788872975.338369:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1579 00000100:00100000:2.0:1788872975.338377:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+102:73768:x1875765311278336:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.338385:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.338394:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc400 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4bc expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338502:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc407 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338513:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc407 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338521:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc407 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338534:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc40e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338588:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc40e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338597:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc40e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338647:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838400/0xe4e6e89fb01dc415 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338656:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838400/0xe4e6e89fb01dc415 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338663:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838400/0xe4e6e89fb01dc415 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788872975.338673:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x14:0x0]: returning size 0 00010000:00010000:2.0:1788872975.338753:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc407 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338767:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc407 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338773:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc407 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338780:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc407 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338787:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4839400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872975.338791:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc407 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338810:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc407 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338821:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:2.0:1788872975.338823:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872975.338827:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc407 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338833:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc407 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338846:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc40e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338851:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc40e lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338857:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc40e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338861:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4839200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:2.0:1788872975.338864:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc40e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338871:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc40e lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338877:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff98a9faf66e00) 00010000:00010000:2.0:1788872975.338880:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788872975.338883:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc40e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338904:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc40e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338946:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc400 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4bc expref: 105 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338958:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838400/0xe4e6e89fb01dc415 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4bc expref: 104 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.338965:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff98a9c1358f00) 00010000:00010000:2.0:1788872975.338967:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788872975.338969:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4838400, rc 0) 00000100:00100000:2.0:1788872975.339014:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+104:73768:x1875765311278336:12345-192.168.204.39@tcp:101:dd.0 Request processed in 638us (1512us total) trans 124554051696 rc 0/0 00000100:00100000:2.0:1788872975.339020:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1579 00000100:00100000:1.0:1788872975.340708:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311277952 00000100:00100000:1.0:1788872975.340724:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311277952 00000100:00100000:1.0:1788872975.340779:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311278592 00000100:00100000:1.0:1788872975.340783:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311278592 00000100:00100000:1.0:1788872975.340802:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 273 00000100:00100000:1.0:1788872975.340824:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+105:73763:x1875765311277952:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:1.0:1788872975.341139:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+106:73763:x1875765311277952:12345-192.168.204.39@tcp:35:dd.0 Request processed in 314us (3709us total) trans 124554051697 rc 0/0 00000100:00100000:1.0:1788872975.341146:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 273 00000100:00100000:1.0:1788872975.341166:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 274 00000100:00100000:1.0:1788872975.341173:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+105:73762:x1875765311278592:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:1.0:1788872975.341276:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+106:73762:x1875765311278592:12345-192.168.204.39@tcp:35:dd.0 Request processed in 104us (3737us total) trans 124554051698 rc 0/0 00000100:00100000:1.0:1788872975.341284:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 274 00000100:00100000:0.0:1788872975.342728:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311278720 00000100:00100000:0.0:1788872975.342741:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311278720 00002000:00010000:0.0:1788872975.342777:0:24855:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/909 (0->18446744073709551615) 00002000:00100000:0.0:1788872975.342782:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c4df2680 with x1875765311278720 ext(0->18446744073709551615) 00002000:00010000:0.0:1788872975.342794:0:24855:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c4df2680. 00000100:00100000:0.0:1788872975.342825:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1018 00000100:00100000:0.0:1788872975.342833:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+26:2406:x1875765311278720:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:0.0:1788872975.342969:0:24855:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788872975.342972:0:24855:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:0.0:1788872975.342974:0:24855:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:0.0:1788872975.342977:0:24855:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:0.0:1788872975.342979:0:24855:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788872975.342988:0:24855:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c4df2680 x1875765311278720/t4294969488(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.343040:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2406:x1875765311278720:12345-192.168.204.39@tcp:10:dd.0 Request processed in 208us (5437us total) trans 4294969488 rc 0/0 00000100:00100000:0.0:1788872975.343047:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1018 00002000:00010000:0.0:1788872975.343051:0:24855:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/909 (0->18446744073709551615) 00002000:00100000:0.0:1788872975.343054:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c4df2680 with x1875765311278720 ext(0->18446744073709551615) 00002000:00010000:0.0:1788872975.343058:0:24855:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c4df2680. 00000100:00100000:3.0:1788872975.345804:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311277696 00000100:00100000:3.0:1788872975.345819:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311277696 00000100:00100000:2.0:1788872975.346016:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6045 00000100:00100000:2.0:1788872975.346028:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0804304d-5904-48ad-87f2-bcbc7642a62a+27:73764:x1875765311277696:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.346047:0:26191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.346070:0:26191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6ece204/0xe4e6e89fb01dc423 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4ae expref: -99 pid: 26191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788872975.346095:0:26191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38c:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:2.0:1788872975.346116:0:26191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38c:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1788872975.346121:0:26191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872975.346129:0:26191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ece204/0xe4e6e89fb01dc423 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4ae expref: 28 pid: 26191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.346162:0:26191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6ece204/0xe4e6e89fb01dc423 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4ae expref: 28 pid: 26191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.346178:0:26191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4838600, rc 0) 00010000:00000080:2.0:1788872975.346185:0:26191:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9df5ac000 x1875765311277696/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872975.346261:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0804304d-5904-48ad-87f2-bcbc7642a62a+28:73764:x1875765311277696:12345-192.168.204.39@tcp:101:dd.0 Request processed in 235us (9126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.346269:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6045 00000100:00100000:0.0:1788872975.346743:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.346779:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.346844:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.346878:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311278976 00000100:00100000:2.0:1788872975.346884:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311278976 00000100:00100000:2.0:1788872975.346920:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311279104 00000100:00100000:2.0:1788872975.346923:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311279104 00000100:00100000:2.0:1788872975.346940:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311279360 00000100:00100000:2.0:1788872975.346943:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311279360 00000100:00100000:2.0:1788872975.346962:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1580 00000100:00100000:0.0:1788872975.346968:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1581 00000100:00100000:2.0:1788872975.346969:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+108:73766:x1875765311278976:12345-192.168.204.39@tcp:36:dd.0 00000100:00100000:0.0:1788872975.346982:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+108:73768:x1875765311279104:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.346989:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.347005:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dc42a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4c3 expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.347026:0:68674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788872975.347034:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dc431 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347046:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dc431 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.347047:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc3cf lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4a0 expref: 109 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347056:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dc431 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.347062:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff98a9c5d04c00) 00010000:00010000:2.0:1788872975.347066:0:68674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872975.347128:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dc42a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4c3 expref: 109 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347141:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae800/0xe4e6e89fb01dc431 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4c3 expref: 108 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347147:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff98a9c1358f00) 00010000:00010000:0.0:1788872975.347164:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788872975.347167:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58ae800, rc 0) 00000100:00100000:0.0:1788872975.347203:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+109:73768:x1875765311279104:12345-192.168.204.39@tcp:101:dd.0 Request processed in 222us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.347209:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1581 00010000:00010000:2.0:1788872975.347223:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839000/0xe4e6e89fb01dc438 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872975.347225:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1582 00000100:00100000:0.0:1788872975.347231:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+108:73767:x1875765311279360:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.347242:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839000/0xe4e6e89fb01dc438 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347245:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.347250:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839000/0xe4e6e89fb01dc438 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347254:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dc43f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4ca expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788872975.347298:0:68674:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051699 00000004:00010000:2.0:1788872975.347322:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000782af0f3 reply state 0000000016c32456 transno 124554051700 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839000/0xe4e6e89fb01dc438 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.347334:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839000/0xe4e6e89fb01dc438 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.347339:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff98a9c5d04c00) 00010000:00010000:2.0:1788872975.347341:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872975.347344:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788872975.347351:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc446 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347359:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc446 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347367:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc446 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347381:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc44d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872975.347397:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9c77b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+111:73766:x1875765311278976:12345-192.168.204.39@tcp:36:dd.0 Request processed in 428us (656us total) trans 124554051700 rc 0/0 00010000:00010000:0.0:1788872975.347412:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc44d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872975.347413:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1580 00000020:00080000:2.0:1788872975.347417:0:68674:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788872975.347419:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc44d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347459:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dc454 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347467:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dc454 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347474:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dc454 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872975.347483:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x13:0x0]: returning size 0 00010000:00010000:0.0:1788872975.347580:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc446 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347587:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc446 lrc: 2/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347593:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc446 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347598:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aec00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.347602:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc446 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347609:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc446 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347617:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872975.347619:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.347623:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc446 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347630:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc446 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347639:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc44d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347644:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc44d lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347650:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc44d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347665:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.347668:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc44d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347675:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc44d lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347683:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff98a9d14a2b00) 00010000:00010000:0.0:1788872975.347686:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.347688:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc44d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347695:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc44d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347727:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dc43f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4ca expref: 112 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347739:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dc454 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4ca expref: 111 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.347746:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff98a9c1358d00) 00010000:00010000:0.0:1788872975.347748:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872975.347750:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58af800, rc 0) 00000100:00100000:0.0:1788872975.347779:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+111:73767:x1875765311279360:12345-192.168.204.39@tcp:101:dd.0 Request processed in 547us (935us total) trans 124554051701 rc 0/0 00000100:00100000:0.0:1788872975.347785:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1582 00000100:00100000:2.0:1788872975.352381:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.352429:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.352510:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.352530:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311279744 00000100:00100000:0.0:1788872975.352584:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311279744 00000100:00100000:0.0:1788872975.352646:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 275 00000100:00100000:0.0:1788872975.352657:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfc00c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+111:73765:x1875765311279744:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:0.0:1788872975.352957:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfc00c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+112:73765:x1875765311279744:12345-192.168.204.39@tcp:35:dd.0 Request processed in 301us (525us total) trans 124554051702 rc 0/0 00000100:00100000:0.0:1788872975.352966:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 275 00000100:00100000:3.0:1788872975.353653:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311279872 00000100:00100000:3.0:1788872975.353660:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311279872 00000100:00100000:3.0:1788872975.353706:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1583 00000100:00100000:3.0:1788872975.353714:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+112:73767:x1875765311279872:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.353727:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.353747:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01dc462 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4d1 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.353779:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc469 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.353793:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc469 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.353805:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc469 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.353885:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c8600/0xe4e6e89fb01dc462 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4d1 expref: 114 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.353914:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9400/0xe4e6e89fb01dc469 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4d1 expref: 113 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.353923:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff98a9c1358d00) 00010000:00010000:3.0:1788872975.353925:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788872975.353928:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9400, rc 0) 00000100:00100000:3.0:1788872975.353972:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+113:73767:x1875765311279872:12345-192.168.204.39@tcp:101:dd.0 Request processed in 259us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.353979:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1583 00000100:00100000:1.0:1788872975.354085:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311279488 00000100:00100000:1.0:1788872975.354090:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311279488 00002000:00010000:1.0:1788872975.354114:0:24856:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/908 (0->18446744073709551615) 00002000:00100000:1.0:1788872975.354119:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe5c00 with x1875765311279488 ext(0->18446744073709551615) 00002000:00010000:1.0:1788872975.354127:0:24856:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe5c00. 00000100:00100000:1.0:1788872975.354155:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1019 00000100:00100000:1.0:1788872975.354163:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+28:2404:x1875765311279488:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:1.0:1788872975.354280:0:24856:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788872975.354284:0:24856:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:1.0:1788872975.354286:0:24856:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:1.0:1788872975.354288:0:24856:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:1.0:1788872975.354291:0:24856:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788872975.354300:0:24856:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe5c00 x1875765311279488/t4294969489(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.354343:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2404:x1875765311279488:12345-192.168.204.39@tcp:10:dd.0 Request processed in 180us (1970us total) trans 4294969489 rc 0/0 00000100:00100000:1.0:1788872975.354356:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1019 00002000:00010000:1.0:1788872975.354360:0:24856:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/908 (0->18446744073709551615) 00002000:00100000:1.0:1788872975.354362:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe5c00 with x1875765311279488 ext(0->18446744073709551615) 00002000:00010000:1.0:1788872975.354367:0:24856:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe5c00. 00000100:00100000:0.0:1788872975.360953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.361007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.361037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.361069:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311280256 00000100:00100000:0.0:1788872975.361073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.361080:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311280256 00000100:00100000:3.0:1788872975.361136:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6046 00000100:00100000:3.0:1788872975.361147:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+29:73766:x1875765311280256:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.361165:0:9961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.361186:0:9961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01dc470 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4d8 expref: -99 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872975.361213:0:9961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38e:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:3.0:1788872975.361236:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38e:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:3.0:1788872975.361241:0:9961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872975.361249:0:9961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01dc470 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4d8 expref: 30 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.361265:0:9961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01dc470 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4d8 expref: 30 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.361298:0:9961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8600, rc 0) 00010000:00000080:3.0:1788872975.361308:0:9961:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9ecf100 x1875765311280256/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.361377:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+30:73766:x1875765311280256:12345-192.168.204.39@tcp:101:dd.0 Request processed in 232us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.361385:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6046 00000100:00100000:2.0:1788872975.361461:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311280128 00000100:00100000:2.0:1788872975.361467:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311280128 00000100:00100000:2.0:1788872975.361503:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311280512 00000100:00100000:2.0:1788872975.361506:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311280512 00000100:00100000:2.0:1788872975.361527:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311280768 00000100:00100000:2.0:1788872975.361530:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311280768 00000100:00100000:2.0:1788872975.361580:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1584 00000100:00100000:2.0:1788872975.361596:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+115:73768:x1875765311280128:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:2.0:1788872975.361639:0:66193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872975.361661:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838400/0xe4e6e89fb01dc415 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4bc expref: 115 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.361680:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff98a9c1358f00) 00010000:00010000:2.0:1788872975.361685:0:66193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788872975.361828:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1585 00000100:00100000:0.0:1788872975.361837:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+115:73769:x1875765311280512:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.361846:0:66190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.361855:0:66190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dc47e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4df expref: -99 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.361856:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc477 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.361868:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc477 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.361877:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc477 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788872975.361920:0:66193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051703 00000004:00010000:2.0:1788872975.361943:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016014bc8 reply state 000000008fa1d610 transno 124554051704 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc477 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.361954:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc477 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.361955:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc485 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.361960:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff98a9c1358f00) 00010000:00010000:2.0:1788872975.361963:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.361964:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc485 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872975.361966:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788872975.361971:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc485 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.361983:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dc48c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.361989:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dc48c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362003:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dc48c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872975.362039:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+118:73768:x1875765311280128:12345-192.168.204.39@tcp:36:dd.0 Request processed in 444us (1094us total) trans 124554051704 rc 0/0 00000100:00100000:2.0:1788872975.362045:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1584 00000020:00080000:2.0:1788872975.362050:0:66193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788872975.362052:0:66190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dc493 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362060:0:66190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dc493 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362068:0:66190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dc493 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788872975.362072:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1586 00000004:00200000:0.0:1788872975.362076:0:66190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x15:0x0]: returning size 0 00000100:00100000:2.0:1788872975.362078:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+117:73767:x1875765311280768:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:2.0:1788872975.362099:0:66193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872975.362112:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af800/0xe4e6e89fb01dc454 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4ca expref: 118 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.362122:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff98a9c1358d00) 00010000:00010000:0.0:1788872975.362122:0:66190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc485 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.362125:0:66193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788872975.362129:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc485 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362134:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc485 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362141:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc485 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362147:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.362151:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc485 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.362182:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc4a1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.362191:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc4a1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.362198:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc4a1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788872975.362226:0:66193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051706 00000004:00010000:2.0:1788872975.362244:0:66193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004308dc50 reply state 000000007bcead3c transno 124554051707 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc4a1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.362253:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc4a1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.362260:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff98a9c1358d00) 00010000:00010000:2.0:1788872975.362262:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872975.362264:0:66193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872975.362302:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+120:73767:x1875765311280768:12345-192.168.204.39@tcp:36:dd.0 Request processed in 224us (1228us total) trans 124554051707 rc 0/0 00000100:00100000:2.0:1788872975.362309:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1586 00000020:00080000:2.0:1788872975.362330:0:66193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788872975.362332:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc485 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362351:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872975.362353:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.362357:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc485 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362364:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc485 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362373:0:66190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dc48c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362379:0:66190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dc48c lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362687:0:66190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dc48c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362693:0:66190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aee00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.362696:0:66190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dc48c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362702:0:66190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dc48c lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362711:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff98a9d14a2b00) 00010000:00010000:0.0:1788872975.362714:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.362716:0:66190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dc48c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362721:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aee00/0xe4e6e89fb01dc48c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362767:0:66190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae400/0xe4e6e89fb01dc47e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4df expref: 120 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362778:0:66190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dc493 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4df expref: 119 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.362785:0:66190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff98a9f016ae00) 00010000:00010000:0.0:1788872975.362787:0:66190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872975.362789:0:66190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c58afc00, rc 0) 00000100:00100000:0.0:1788872975.362819:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+119:73769:x1875765311280512:12345-192.168.204.39@tcp:101:dd.0 Request processed in 983us (1780us total) trans 124554051705 rc 0/0 00000100:00100000:0.0:1788872975.362825:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1585 00000100:00100000:0.0:1788872975.365087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.365168:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311280896 00000100:00100000:2.0:1788872975.365178:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311280896 00002000:00010000:2.0:1788872975.365218:0:24865:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/910 (0->18446744073709551615) 00002000:00100000:2.0:1788872975.365223:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecc000 with x1875765311280896 ext(0->18446744073709551615) 00002000:00010000:2.0:1788872975.365234:0:24865:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecc000. 00000100:00100000:2.0:1788872975.365256:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1020 00000100:00100000:2.0:1788872975.365265:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+30:2405:x1875765311280896:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:2.0:1788872975.365447:0:24865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788872975.365452:0:24865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:2.0:1788872975.365454:0:24865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:2.0:1788872975.365457:0:24865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:2.0:1788872975.365459:0:24865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788872975.365468:0:24865:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9ecc000 x1875765311280896/t4294969490(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872975.365531:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+31:2405:x1875765311280896:12345-192.168.204.39@tcp:10:dd.0 Request processed in 266us (453us total) trans 4294969490 rc 0/0 00000100:00100000:2.0:1788872975.365538:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1020 00002000:00010000:2.0:1788872975.365542:0:24865:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/910 (0->18446744073709551615) 00002000:00100000:2.0:1788872975.365545:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecc000 with x1875765311280896 ext(0->18446744073709551615) 00002000:00010000:2.0:1788872975.365570:0:24865:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecc000. 00000100:00100000:0.0:1788872975.365968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.367260:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311281024 00000100:00100000:3.0:1788872975.367272:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311281024 00000100:00100000:3.0:1788872975.367328:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6047 00000100:00100000:3.0:1788872975.367338:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+31:73768:x1875765311281024:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.367358:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.367382:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01dc4a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4e6 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872975.367418:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x390:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:3.0:1788872975.367439:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x390:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:3.0:1788872975.367444:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x390:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872975.367453:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01dc4a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4e6 expref: 32 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.367468:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01dc4a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4e6 expref: 32 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.367481:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8800, rc 0) 00010000:00000080:3.0:1788872975.367504:0:8436:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9eced80 x1875765311281024/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.367582:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+32:73768:x1875765311281024:12345-192.168.204.39@tcp:101:dd.0 Request processed in 245us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.367589:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6047 00000100:00100000:0.0:1788872975.369146:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.369195:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.369252:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311281152 00000100:00100000:2.0:1788872975.369260:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311281152 00000100:00100000:3.0:1788872975.369290:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311281280 00000100:00100000:3.0:1788872975.369294:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311281280 00000100:00100000:2.0:1788872975.369310:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1587 00000100:00100000:2.0:1788872975.369319:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef779850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+119:73769:x1875765311281152:12345-192.168.204.39@tcp:101:dd.0 00000100:00100000:3.0:1788872975.369328:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6048 00000100:00100000:3.0:1788872975.369333:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+32:73767:x1875765311281280:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.369341:0:26187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.369341:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.369360:0:26187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01dc4af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4f4 expref: -99 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.369365:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838a00/0xe4e6e89fb01dc4b6 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4ed expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872975.369381:0:26187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38f:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:2.0:1788872975.369393:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838200/0xe4e6e89fb01dc4bd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.369415:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838200/0xe4e6e89fb01dc4bd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.369422:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38f:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:3.0:1788872975.369426:0:26187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872975.369426:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838200/0xe4e6e89fb01dc4bd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.369433:0:26187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01dc4af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4f4 expref: 33 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.369444:0:26187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01dc4af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4f4 expref: 33 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.369454:0:26187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8c00, rc 0) 00010000:00000080:3.0:1788872975.369461:0:26187:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9ecea00 x1875765311281280/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.369504:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+33:73767:x1875765311281280:12345-192.168.204.39@tcp:101:dd.0 Request processed in 171us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.369528:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6048 00010000:00010000:2.0:1788872975.369530:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838a00/0xe4e6e89fb01dc4b6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4ed expref: 121 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.369572:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838200/0xe4e6e89fb01dc4bd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4ed expref: 120 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.369581:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff98a9f016ae00) 00010000:00010000:2.0:1788872975.369585:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788872975.369588:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4838200, rc 0) 00000100:00100000:2.0:1788872975.369624:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef779850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+120:73769:x1875765311281152:12345-192.168.204.39@tcp:101:dd.0 Request processed in 306us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.369631:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1587 00000100:00100000:3.0:1788872975.372259:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.372773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.373478:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311281664 00000100:00100000:0.0:1788872975.373491:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311281664 00000100:00100000:0.0:1788872975.373584:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1588 00000100:00100000:0.0:1788872975.373594:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+120:73771:x1875765311281664:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.373620:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.373646:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc4c4 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb4fb expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.373778:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc4cb lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.373812:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc4cb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.373824:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc4cb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.373840:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc4d2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.373847:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc4d2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.373853:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc4d2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.373911:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc4d9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.373919:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc4d9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.373926:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc4d9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872975.373936:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x17:0x0]: returning size 0 00010000:00010000:0.0:1788872975.374026:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc4cb lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374035:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc4cb lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374041:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc4cb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374054:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc4cb lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374061:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58aec00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.374065:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc4cb lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374073:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc4cb lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374085:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872975.374088:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.374093:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc4cb lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374100:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58aec00/0xe4e6e89fb01dc4cb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374112:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc4d2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374118:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc4d2 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374124:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc4d2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374129:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58ae600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.374132:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc4d2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374148:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc4d2 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374157:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff98a9c2bf9700) 00010000:00010000:0.0:1788872975.374159:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.374162:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc4d2 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374168:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae600/0xe4e6e89fb01dc4d2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374210:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58ae000/0xe4e6e89fb01dc4c4 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4fb expref: 123 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374224:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc4d9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4fb expref: 122 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.374231:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff98a9f016a400) 00010000:00010000:0.0:1788872975.374234:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872975.374236:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5600, rc 0) 00000100:00100000:0.0:1788872975.374303:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+122:73771:x1875765311281664:12345-192.168.204.39@tcp:101:dd.0 Request processed in 709us (1530us total) trans 124554051708 rc 0/0 00000100:00100000:0.0:1788872975.374311:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1588 00000100:00100000:1.0:1788872975.374398:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311281408 00000100:00100000:1.0:1788872975.374413:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311281408 00002000:00010000:1.0:1788872975.374438:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/912 (0->18446744073709551615) 00002000:00100000:1.0:1788872975.374442:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a42a00 with x1875765311281408 ext(0->18446744073709551615) 00002000:00010000:1.0:1788872975.374451:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a42a00. 00000100:00100000:1.0:1788872975.374479:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1021 00000100:00100000:1.0:1788872975.374486:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+33:2406:x1875765311281408:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:1.0:1788872975.374622:0:24869:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788872975.374626:0:24869:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:1.0:1788872975.374628:0:24869:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:1.0:1788872975.374630:0:24869:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:1.0:1788872975.374632:0:24869:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788872975.374640:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a42a00 x1875765311281408/t4294969491(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.374675:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+34:2406:x1875765311281408:12345-192.168.204.39@tcp:10:dd.0 Request processed in 189us (2425us total) trans 4294969491 rc 0/0 00000100:00100000:1.0:1788872975.374681:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1021 00002000:00010000:1.0:1788872975.374684:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/912 (0->18446744073709551615) 00002000:00100000:1.0:1788872975.374687:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a42a00 with x1875765311281408 ext(0->18446744073709551615) 00002000:00010000:1.0:1788872975.374692:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a42a00. 00000100:00100000:0.0:1788872975.376305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.376356:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.376428:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311281920 00000100:00100000:1.0:1788872975.376437:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311281920 00000100:00100000:1.0:1788872975.376503:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1589 00000100:00100000:1.0:1788872975.376513:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+122:73769:x1875765311281920:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:1.0:1788872975.376592:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872975.376621:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58afc00/0xe4e6e89fb01dc493 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4df expref: 122 pid: 66190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.376640:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff98a9f016ae00) 00010000:00010000:1.0:1788872975.376645:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872975.376827:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc4e7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.376842:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc4e7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.376854:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc4e7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788872975.376902:0:83669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051709 00000004:00010000:1.0:1788872975.376929:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa2d58af reply state 00000000b3134a23 transno 124554051710 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc4e7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.376941:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc4e7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.376946:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff98a9f016ae00) 00010000:00010000:1.0:1788872975.376948:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872975.376951:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872975.377055:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+124:73769:x1875765311281920:12345-192.168.204.39@tcp:36:dd.0 Request processed in 542us (758us total) trans 124554051710 rc 0/0 00000100:00100000:1.0:1788872975.377080:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1589 00000020:00080000:1.0:1788872975.377084:0:83669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788872975.377577:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311282304 00000100:00100000:2.0:1788872975.377585:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311282304 00000100:00100000:2.0:1788872975.377621:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 276 00000100:00100000:2.0:1788872975.377629:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+124:73764:x1875765311282304:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:2.0:1788872975.377809:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+125:73764:x1875765311282304:12345-192.168.204.39@tcp:35:dd.0 Request processed in 180us (1452us total) trans 124554051711 rc 0/0 00000100:00100000:2.0:1788872975.377823:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 276 00000100:00100000:0.0:1788872975.381015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.381104:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311282048 00000100:00100000:3.0:1788872975.381114:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311282048 00002000:00010000:3.0:1788872975.381164:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/911 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.381169:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecdf80 with x1875765311282048 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.381181:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecdf80. 00000100:00100000:3.0:1788872975.381216:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1022 00000100:00100000:3.0:1788872975.381226:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+34:2407:x1875765311282048:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:3.0:1788872975.381395:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788872975.381399:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:3.0:1788872975.381412:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:3.0:1788872975.381414:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:3.0:1788872975.381416:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788872975.381426:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9ecdf80 x1875765311282048/t4294969492(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.381493:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+35:2407:x1875765311282048:12345-192.168.204.39@tcp:10:dd.0 Request processed in 268us (488us total) trans 4294969492 rc 0/0 00000100:00100000:3.0:1788872975.381500:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1022 00002000:00010000:3.0:1788872975.381504:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/911 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.381507:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecdf80 with x1875765311282048 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.381512:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecdf80. 00000100:00100000:2.0:1788872975.382989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.383061:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311282432 00000100:00100000:3.0:1788872975.383070:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311282432 00000100:00100000:3.0:1788872975.383185:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6049 00000100:00100000:3.0:1788872975.383195:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+35:73769:x1875765311282432:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.383211:0:26183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.383232:0:26183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01dc4ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb502 expref: -99 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872975.383257:0:26183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x391:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:3.0:1788872975.383280:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x391:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:3.0:1788872975.383285:0:26183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x391:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872975.383294:0:26183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01dc4ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb502 expref: 36 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.383312:0:26183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01dc4ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb502 expref: 36 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.383327:0:26183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c8400, rc 0) 00010000:00000080:3.0:1788872975.383333:0:26183:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe7800 x1875765311282432/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.383603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.383719:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.383754:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311282688 00000100:00100000:0.0:1788872975.383760:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311282688 00000100:00100000:0.0:1788872975.383795:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311282816 00000100:00100000:0.0:1788872975.383798:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311282816 00000100:00100000:0.0:1788872975.383822:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1590 00000100:00100000:0.0:1788872975.383829:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+126:73770:x1875765311282688:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.383845:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.383859:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc4f5 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb509 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872975.383904:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1591 00000100:00100000:1.0:1788872975.383913:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+127:73771:x1875765311282816:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:1.0:1788872975.383921:0:66193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788872975.383932:0:66193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc4fc lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb510 expref: -99 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.383952:0:66193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc503 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.383966:0:66193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc503 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.383975:0:66193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc503 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.383978:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc50a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.383985:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc50a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.383992:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc50a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384007:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dc511 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384014:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dc511 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384019:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dc511 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384058:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc518 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.384062:0:66193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc4fc lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb510 expref: 129 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384066:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc518 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384079:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc518 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.384081:0:66193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2e00/0xe4e6e89fb01dc503 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb510 expref: 128 pid: 66193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.384088:0:66193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff98a9f016a400) 00000004:00200000:0.0:1788872975.384089:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x16:0x0]: returning size 0 00010000:00010000:1.0:1788872975.384091:0:66193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788872975.384094:0:66193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9df4d2e00, rc 0) 00000100:00100000:1.0:1788872975.384128:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+128:73771:x1875765311282816:12345-192.168.204.39@tcp:101:dd.0 Request processed in 216us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872975.384141:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1591 00010000:00010000:0.0:1788872975.384183:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc50a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384192:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc50a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384198:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc50a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384205:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc50a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384211:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.384215:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc50a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384223:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc50a lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384233:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872975.384236:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.384240:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc50a lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384246:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc50a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384256:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dc511 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384268:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dc511 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384274:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dc511 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384279:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52af000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.384282:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dc511 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384289:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dc511 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384298:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff98a9c2bf9800) 00010000:00010000:0.0:1788872975.384300:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.384303:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dc511 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384309:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dc511 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384343:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc4f5 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb509 expref: 129 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384354:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc518 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb509 expref: 128 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.384361:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff98a9c5daa000) 00010000:00010000:0.0:1788872975.384364:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872975.384371:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c52ae200, rc 0) 00000100:00100000:0.0:1788872975.384594:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+128:73770:x1875765311282688:12345-192.168.204.39@tcp:101:dd.0 Request processed in 764us (991us total) trans 124554051712 rc 0/0 00000100:00100000:0.0:1788872975.384601:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1590 00000100:00100000:3.0:1788872975.385118:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+36:73769:x1875765311282432:12345-192.168.204.39@tcp:101:dd.0 Request processed in 193us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.385127:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6049 00000100:00100000:1.0:1788872975.392422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.392464:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.392498:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.392529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.392588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.392590:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311283072 00000100:00100000:0.0:1788872975.392599:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311283072 00000100:00100000:0.0:1788872975.392641:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311283328 00000100:00100000:0.0:1788872975.392644:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311283328 00000100:00100000:3.0:1788872975.392646:0:25436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311283968 00000100:00100000:3.0:1788872975.392650:0:25436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311283968 00000100:00100000:0.0:1788872975.392655:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311283584 00000100:00100000:0.0:1788872975.392657:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311283584 00000100:00100000:0.0:1788872975.392669:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 277 00002000:00010000:3.0:1788872975.392676:0:25436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/913 (0->18446744073709551615) 00000100:00100000:0.0:1788872975.392677:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+130:73766:x1875765311283072:12345-192.168.204.39@tcp:35:dd.0 00002000:00100000:3.0:1788872975.392680:0:25436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738ea00 with x1875765311283968 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.392691:0:25436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738ea00. 00000100:00100000:3.0:1788872975.392733:0:25436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1023 00000100:00100000:3.0:1788872975.392739:0:25436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+36:2404:x1875765311283968:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:3.0:1788872975.392854:0:25436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788872975.392858:0:25436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:3.0:1788872975.392860:0:25436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:3.0:1788872975.392862:0:25436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:3.0:1788872975.392864:0:25436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788872975.392873:0:25436:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738ea00 x1875765311283968/t4294969493(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.392925:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+131:73766:x1875765311283072:12345-192.168.204.39@tcp:35:dd.0 Request processed in 247us (523us total) trans 124554051713 rc 0/0 00000100:00100000:0.0:1788872975.392933:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 277 00000100:00100000:0.0:1788872975.392950:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 278 00000100:00100000:0.0:1788872975.392956:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+130:73767:x1875765311283328:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:2.0:1788872975.392996:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 279 00000100:00100000:2.0:1788872975.393005:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+130:73768:x1875765311283584:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:1.0:1788872975.395471:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311283840 00000100:00100000:1.0:1788872975.395485:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311283840 00000100:00100000:1.0:1788872975.395573:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1592 00000100:00100000:1.0:1788872975.395584:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+133:73771:x1875765311283840:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:1.0:1788872975.395645:0:66192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872975.395676:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5600/0xe4e6e89fb01dc4d9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4fb expref: 133 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.395695:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff98a9f016a400) 00010000:00010000:1.0:1788872975.395700:0:66192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872975.395863:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc526 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.395878:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc526 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.395899:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc526 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788872975.395950:0:66192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051716 00000004:00010000:1.0:1788872975.395976:0:66192:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa3180fb reply state 00000000337c4722 transno 124554051717 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc526 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.396064:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc526 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.396070:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff98a9f016a400) 00010000:00010000:1.0:1788872975.396073:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872975.396076:0:66192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788872975.396675:0:25436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+37:2404:x1875765311283968:12345-192.168.204.39@tcp:10:dd.0 Request processed in 3929us (4080us total) trans 4294969493 rc 0/0 00000100:00100000:3.0:1788872975.396685:0:25436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1023 00002000:00010000:3.0:1788872975.396690:0:25436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/913 (0->18446744073709551615) 00002000:00100000:3.0:1788872975.396694:0:25436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738ea00 with x1875765311283968 ext(0->18446744073709551615) 00002000:00010000:3.0:1788872975.396702:0:25436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738ea00. 00000100:00100000:3.0:1788872975.397394:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.397480:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.397818:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+135:73767:x1875765311283328:12345-192.168.204.39@tcp:35:dd.0 Request processed in 4859us (5350us total) trans 124554051714 rc 0/0 00000100:00100000:0.0:1788872975.397829:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 278 00000100:00100000:0.0:1788872975.397858:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311284096 00000100:00100000:0.0:1788872975.397866:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311284096 00000100:00100000:0.0:1788872975.397897:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311284352 00000100:00100000:0.0:1788872975.397900:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311284352 00000100:00100000:0.0:1788872975.397920:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1593 00000100:00100000:0.0:1788872975.397928:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+136:73770:x1875765311284096:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.397948:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.397976:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dc52d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb517 expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398011:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc534 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398023:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc534 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398035:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc534 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398144:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52af000/0xe4e6e89fb01dc52d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb517 expref: 138 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398165:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac5a00/0xe4e6e89fb01dc534 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb517 expref: 137 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398174:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff98a9c5daa000) 00010000:00010000:0.0:1788872975.398176:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788872975.398179:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9efac5a00, rc 0) 00000100:00100000:0.0:1788872975.398223:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+137:73770:x1875765311284096:12345-192.168.204.39@tcp:101:dd.0 Request processed in 295us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.398229:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1593 00000100:00100000:0.0:1788872975.398244:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1594 00000100:00100000:0.0:1788872975.398252:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+136:73772:x1875765311284352:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.398260:0:68674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.398269:0:68674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc53b lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb51e expref: -99 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398382:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc542 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398393:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc542 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398400:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc542 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398426:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7200/0xe4e6e89fb01dc549 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398435:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7200/0xe4e6e89fb01dc549 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398443:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7200/0xe4e6e89fb01dc549 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398484:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6800/0xe4e6e89fb01dc550 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398492:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6800/0xe4e6e89fb01dc550 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398498:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6800/0xe4e6e89fb01dc550 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872975.398507:0:68674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x18:0x0]: returning size 0 00010000:00010000:0.0:1788872975.398598:0:68674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc542 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398606:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc542 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398618:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc542 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398623:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc542 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398629:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.398633:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc542 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398641:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc542 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398651:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872975.398653:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.398657:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc542 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398663:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4a00/0xe4e6e89fb01dc542 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398674:0:68674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7200/0xe4e6e89fb01dc549 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398680:0:68674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7200/0xe4e6e89fb01dc549 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398686:0:68674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7200/0xe4e6e89fb01dc549 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398690:0:68674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.398699:0:68674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7200/0xe4e6e89fb01dc549 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398705:0:68674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7200/0xe4e6e89fb01dc549 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398714:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff98a9c2bf9800) 00010000:00010000:0.0:1788872975.398716:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.398719:0:68674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7200/0xe4e6e89fb01dc549 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398724:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7200/0xe4e6e89fb01dc549 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398760:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4400/0xe4e6e89fb01dc53b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb51e expref: 139 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398771:0:68674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6800/0xe4e6e89fb01dc550 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb51e expref: 138 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.398777:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff98a9faf66700) 00010000:00010000:0.0:1788872975.398779:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872975.398782:0:68674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e6800, rc 0) 00000100:00100000:0.0:1788872975.398807:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+138:73772:x1875765311284352:12345-192.168.204.39@tcp:101:dd.0 Request processed in 557us (1327us total) trans 124554051718 rc 0/0 00000100:00100000:0.0:1788872975.398813:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1594 00000100:00100000:2.0:1788872975.402361:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+137:73768:x1875765311283584:12345-192.168.204.39@tcp:35:dd.0 Request processed in 9344us (9848us total) trans 124554051715 rc 0/0 00000100:00100000:2.0:1788872975.402376:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 279 00000100:00100000:0.0:1788872975.404854:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.404918:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.405003:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311284864 00000100:00100000:3.0:1788872975.405013:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311284864 00000100:00100000:2.0:1788872975.405026:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311284608 00000100:00100000:2.0:1788872975.405029:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311284608 00000100:00100000:2.0:1788872975.405060:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 280 00000100:00100000:3.0:1788872975.405064:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1595 00000100:00100000:3.0:1788872975.405070:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+138:73770:x1875765311284864:12345-192.168.204.39@tcp:36:dd.0 00000100:00100000:2.0:1788872975.405070:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+138:73769:x1875765311284608:12345-192.168.204.39@tcp:35:dd.0 00010000:00010000:3.0:1788872975.405427:0:68674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788872975.405431:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+139:73769:x1875765311284608:12345-192.168.204.39@tcp:35:dd.0 Request processed in 360us (585us total) trans 124554051719 rc 0/0 00000100:00100000:2.0:1788872975.405438:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 280 00010000:00010000:3.0:1788872975.405454:0:68674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c52ae200/0xe4e6e89fb01dc518 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb509 expref: 138 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.405494:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff98a9c5daa000) 00010000:00010000:3.0:1788872975.405500:0:68674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872975.406309:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+137:73771:x1875765311283840:12345-192.168.204.39@tcp:36:dd.0 Request processed in 10722us (13773us total) trans 124554051717 rc 0/0 00000100:00100000:1.0:1788872975.406319:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1592 00000020:00080000:1.0:1788872975.406323:0:66192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788872975.406374:0:68674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc55e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.406389:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc55e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.406410:0:68674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc55e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788872975.406457:0:68674:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051720 00000100:00100000:3.0:1788872975.416382:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.416455:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311284992 00000100:00100000:2.0:1788872975.416464:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311284992 00000100:00100000:2.0:1788872975.416539:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6050 00000100:00100000:2.0:1788872975.416569:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+37:73771:x1875765311284992:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.416588:0:26199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.416611:0:26199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a054b5bf/0xe4e6e89fb01dc565 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb525 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788872975.416638:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x393:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:2.0:1788872975.416661:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x393:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1788872975.416681:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x393:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788872975.416690:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a054b5bf/0xe4e6e89fb01dc565 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb525 expref: 38 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.416708:0:26199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a054b5bf/0xe4e6e89fb01dc565 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb525 expref: 38 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.416721:0:26199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4839a00, rc 0) 00010000:00000080:2.0:1788872975.416728:0:26199:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a43b80 x1875765311284992/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872975.416783:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+38:73771:x1875765311284992:12345-192.168.204.39@tcp:101:dd.0 Request processed in 236us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.416791:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6050 00000004:00010000:0.0:1788872975.416839:0:68674:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c6987b83 reply state 000000007af5a309 transno 124554051721 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc55e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.416865:0:68674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc55e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.416873:0:68674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff98a9c5daa000) 00010000:00010000:0.0:1788872975.416876:0:68674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788872975.416879:0:68674:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788872975.416972:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+139:73770:x1875765311284864:12345-192.168.204.39@tcp:36:dd.0 Request processed in 11901us (12052us total) trans 124554051721 rc 0/0 00000100:00100000:0.0:1788872975.416980:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1595 00000020:00080000:0.0:1788872975.416983:0:68674:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788872975.419875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.419909:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.419978:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311285120 00000100:00100000:3.0:1788872975.419988:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311285120 00000100:00100000:3.0:1788872975.420040:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6051 00000100:00100000:3.0:1788872975.420050:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+38:73770:x1875765311285120:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:3.0:1788872975.420066:0:26189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788872975.420087:0:26189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01dc56c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb52c expref: -99 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788872975.420110:0:26189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x392:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:3.0:1788872975.420130:0:26189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x392:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:3.0:1788872975.420134:0:26189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x392:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788872975.420142:0:26189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01dc56c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb52c expref: 39 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872975.420143:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311285248 00000100:00100000:0.0:1788872975.420147:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311285248 00002000:00010000:0.0:1788872975.420169:0:24855:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/915 (0->18446744073709551615) 00002000:00100000:0.0:1788872975.420174:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe4e00 with x1875765311285248 ext(0->18446744073709551615) 00002000:00010000:0.0:1788872975.420190:0:24855:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe4e00. 00010000:00010000:3.0:1788872975.420191:0:26189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01dc56c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb52c expref: 40 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872975.420204:0:26189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9c56c9a00, rc 0) 00000100:00100000:0.0:1788872975.420210:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1024 00010000:00000080:3.0:1788872975.420211:0:26189:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe4380 x1875765311285120/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.420216:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+40:2404:x1875765311285248:12345-192.168.204.39@tcp:10:dd.0 00000100:00100000:3.0:1788872975.420264:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+40:73770:x1875765311285120:12345-192.168.204.39@tcp:101:dd.0 Request processed in 216us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.420270:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6051 00002000:00010000:0.0:1788872975.420355:0:24855:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788872975.420359:0:24855:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:0.0:1788872975.420362:0:24855:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:0.0:1788872975.420364:0:24855:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:0.0:1788872975.420366:0:24855:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788872975.420373:0:24855:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe4e00 x1875765311285248/t4294969494(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.420416:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+40:2404:x1875765311285248:12345-192.168.204.39@tcp:10:dd.0 Request processed in 200us (506us total) trans 4294969494 rc 0/0 00000100:00100000:0.0:1788872975.420435:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1024 00002000:00010000:0.0:1788872975.420437:0:24855:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/915 (0->18446744073709551615) 00002000:00100000:0.0:1788872975.420440:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe4e00 with x1875765311285248 ext(0->18446744073709551615) 00002000:00010000:0.0:1788872975.420445:0:24855:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe4e00. 00000100:00100000:2.0:1788872975.424120:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.424210:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311285376 00000100:00100000:0.0:1788872975.424221:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311285376 00002000:00010000:0.0:1788872975.424264:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/914 (0->18446744073709551615) 00002000:00100000:0.0:1788872975.424269:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe5180 with x1875765311285376 ext(0->18446744073709551615) 00002000:00010000:0.0:1788872975.424283:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe5180. 00000100:00100000:0.0:1788872975.424321:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1025 00000100:00100000:0.0:1788872975.424331:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+40:2405:x1875765311285376:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:0.0:1788872975.424511:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788872975.424515:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:0.0:1788872975.424517:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:0.0:1788872975.424520:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:0.0:1788872975.424522:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788872975.424531:0:8443:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe5180 x1875765311285376/t4294969495(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.424644:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+41:2405:x1875765311285376:12345-192.168.204.39@tcp:10:dd.0 Request processed in 314us (536us total) trans 4294969495 rc 0/0 00000100:00100000:0.0:1788872975.424652:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1025 00002000:00010000:0.0:1788872975.424655:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/914 (0->18446744073709551615) 00002000:00100000:0.0:1788872975.424658:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe5180 with x1875765311285376 ext(0->18446744073709551615) 00002000:00010000:0.0:1788872975.424663:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe5180. 00000100:00100000:3.0:1788872975.426892:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.427048:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311285632 00000100:00100000:2.0:1788872975.427059:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311285632 00000100:00100000:2.0:1788872975.427111:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 281 00000100:00100000:2.0:1788872975.427122:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfc03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+139:73771:x1875765311285632:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:2.0:1788872975.427428:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfc03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+140:73771:x1875765311285632:12345-192.168.204.39@tcp:35:dd.0 Request processed in 307us (543us total) trans 124554051722 rc 0/0 00000100:00100000:2.0:1788872975.427436:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 281 00000100:00100000:3.0:1788872975.431989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.432040:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.432768:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.433023:0:66195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311286272 00000100:00100000:3.0:1788872975.433035:0:66195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311286272 00000100:00100000:3.0:1788872975.433093:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 282 00000100:00100000:3.0:1788872975.433103:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+140:73770:x1875765311286272:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:3.0:1788872975.433438:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+141:73770:x1875765311286272:12345-192.168.204.39@tcp:35:dd.0 Request processed in 336us (672us total) trans 124554051723 rc 0/0 00000100:00100000:3.0:1788872975.433446:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 282 00000100:00100000:0.0:1788872975.436474:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311285760 00000100:00100000:0.0:1788872975.436491:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311285760 00000100:00100000:0.0:1788872975.436653:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311286016 00000100:00100000:0.0:1788872975.436658:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311286016 00000100:00100000:0.0:1788872975.436690:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1596 00000100:00100000:0.0:1788872975.436700:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+142:73772:x1875765311285760:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.436722:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.436744:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7a00/0xe4e6e89fb01dc573 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb533 expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.436781:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6000/0xe4e6e89fb01dc57a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.436795:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6000/0xe4e6e89fb01dc57a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.436808:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6000/0xe4e6e89fb01dc57a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.436951:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7a00/0xe4e6e89fb01dc573 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb533 expref: 144 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.436973:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6000/0xe4e6e89fb01dc57a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb533 expref: 143 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.436982:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff98a9faf66700) 00010000:00010000:0.0:1788872975.436985:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788872975.436989:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e6000, rc 0) 00000100:00100000:0.0:1788872975.437303:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+143:73772:x1875765311285760:12345-192.168.204.39@tcp:101:dd.0 Request processed in 603us (5325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.437320:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1596 00000100:00100000:0.0:1788872975.437341:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1597 00000100:00100000:0.0:1788872975.437348:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+142:73773:x1875765311286016:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.437357:0:83669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.437366:0:83669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01dc581 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb53a expref: -99 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437476:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01dc588 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437486:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01dc588 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437494:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01dc588 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437507:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01dc58f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437514:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01dc58f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437521:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01dc58f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437596:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6a00/0xe4e6e89fb01dc596 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437605:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6a00/0xe4e6e89fb01dc596 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437624:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6a00/0xe4e6e89fb01dc596 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788872975.437635:0:83669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x19:0x0]: returning size 0 00010000:00010000:0.0:1788872975.437716:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01dc588 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437724:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01dc588 lrc: 2/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437731:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01dc588 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437738:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.437741:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01dc588 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437749:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01dc588 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437759:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff98a9c1358c00) 00010000:00010000:0.0:1788872975.437762:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.437766:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01dc588 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437773:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7600/0xe4e6e89fb01dc588 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437783:0:83669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01dc58f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437798:0:83669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01dc58f lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437803:0:83669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01dc58f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437808:0:83669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e7e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:0.0:1788872975.437811:0:83669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01dc58f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437818:0:83669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01dc58f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437826:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff98a9c2bf9800) 00010000:00010000:0.0:1788872975.437829:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788872975.437831:0:83669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01dc58f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437838:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7e00/0xe4e6e89fb01dc58f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437871:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e7400/0xe4e6e89fb01dc581 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb53a expref: 145 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437882:0:83669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6a00/0xe4e6e89fb01dc596 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb53a expref: 144 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.437890:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff98a9faf66000) 00010000:00010000:0.0:1788872975.437892:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788872975.437899:0:83669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e6a00, rc 0) 00000100:00100000:0.0:1788872975.437933:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+144:73773:x1875765311286016:12345-192.168.204.39@tcp:101:dd.0 Request processed in 585us (5893us total) trans 124554051724 rc 0/0 00000100:00100000:0.0:1788872975.437940:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1597 00000100:00100000:3.0:1788872975.442387:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.442497:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311286400 00000100:00100000:2.0:1788872975.442508:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311286400 00000100:00100000:2.0:1788872975.442604:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1598 00000100:00100000:2.0:1788872975.442720:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+144:73773:x1875765311286400:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:2.0:1788872975.442745:0:66192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788872975.442770:0:66192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839e00/0xe4e6e89fb01dc5a4 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb541 expref: -99 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.442807:0:66192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838400/0xe4e6e89fb01dc5ab lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.442821:0:66192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838400/0xe4e6e89fb01dc5ab lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.442832:0:66192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838400/0xe4e6e89fb01dc5ab lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.442947:0:66192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839e00/0xe4e6e89fb01dc5a4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb541 expref: 146 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.442971:0:66192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4838400/0xe4e6e89fb01dc5ab lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb541 expref: 145 pid: 66192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.442981:0:66192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff98a9faf66000) 00010000:00010000:2.0:1788872975.442984:0:66192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788872975.442988:0:66192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4838400, rc 0) 00000100:00100000:2.0:1788872975.443062:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+145:73773:x1875765311286400:12345-192.168.204.39@tcp:101:dd.0 Request processed in 345us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.445363:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.445593:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311286656 00000100:00100000:1.0:1788872975.445603:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311286656 00000100:00100000:1.0:1788872975.445652:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1599 00000100:00100000:1.0:1788872975.445662:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+146:73772:x1875765311286656:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:1.0:1788872975.445738:0:83669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872975.445770:0:83669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6800/0xe4e6e89fb01dc550 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb51e expref: 146 pid: 68674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.445789:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff98a9faf66700) 00010000:00010000:1.0:1788872975.445794:0:83669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788872975.445982:0:83669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc5b2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.445997:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc5b2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.446007:0:83669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc5b2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788872975.446071:0:83669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051725 00000004:00010000:1.0:1788872975.446099:0:83669:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000081c7563 reply state 00000000e90e5387 transno 124554051726 ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc5b2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.446110:0:83669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc5b2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872975.446117:0:83669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff98a9faf66700) 00010000:00010000:1.0:1788872975.446120:0:83669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788872975.446122:0:83669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788872975.446231:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+148:73772:x1875765311286656:12345-192.168.204.39@tcp:36:dd.0 Request processed in 568us (877us total) trans 124554051726 rc 0/0 00000100:00100000:1.0:1788872975.446240:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1599 00000020:00080000:1.0:1788872975.446245:0:83669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788872975.446851:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1598 00000100:00100000:3.0:1788872975.448675:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.448829:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311286912 00000100:00100000:2.0:1788872975.448840:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311286912 00000100:00100000:2.0:1788872975.448903:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1600 00000100:00100000:2.0:1788872975.448929:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+147:73773:x1875765311286912:12345-192.168.204.39@tcp:36:dd.0 00010000:00010000:2.0:1788872975.448987:0:66979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788872975.449018:0:66979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8cc3e6a00/0xe4e6e89fb01dc596 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb53a expref: 147 pid: 83669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.449038:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff98a9faf66000) 00010000:00010000:2.0:1788872975.449042:0:66979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788872975.449227:0:66979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc5b9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.449241:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc5b9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.449251:0:66979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc5b9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788872975.449297:0:66979:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051727 00000004:00010000:2.0:1788872975.449323:0:66979:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d53d5790 reply state 000000006bca521d transno 124554051728 ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc5b9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.449335:0:66979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc5b9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872975.449341:0:66979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff98a9faf66000) 00010000:00010000:2.0:1788872975.449344:0:66979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788872975.449347:0:66979:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788872975.449464:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+149:73773:x1875765311286912:12345-192.168.204.39@tcp:36:dd.0 Request processed in 535us (797us total) trans 124554051728 rc 0/0 00000100:00100000:2.0:1788872975.449471:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1600 00000020:00080000:2.0:1788872975.449475:0:66979:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788872975.450339:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.450410:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311287040 00000100:00100000:0.0:1788872975.450417:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311287040 00000100:00100000:0.0:1788872975.450460:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6052 00000100:00100000:0.0:1788872975.450468:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+41:73772:x1875765311287040:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.450483:0:26182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.450500:0:26182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01dc5c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb548 expref: -99 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872975.450523:0:26182:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x394:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:0.0:1788872975.450544:0:26182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x394:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1788872975.450575:0:26182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x394:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872975.450584:0:26182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01dc5c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb548 expref: 42 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.450600:0:26182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01dc5c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb548 expref: 42 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.450613:0:26182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e7800, rc 0) 00010000:00000080:0.0:1788872975.450620:0:26182:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738fb80 x1875765311287040/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.450671:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+42:73772:x1875765311287040:12345-192.168.204.39@tcp:101:dd.0 Request processed in 204us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.450690:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6052 00000100:00100000:0.0:1788872975.453003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.453285:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311287168 00000100:00100000:2.0:1788872975.453295:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311287168 00002000:00010000:2.0:1788872975.453340:0:24865:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/916 (0->18446744073709551615) 00002000:00100000:2.0:1788872975.453345:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecc700 with x1875765311287168 ext(0->18446744073709551615) 00002000:00010000:2.0:1788872975.453357:0:24865:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecc700. 00000100:00100000:2.0:1788872975.453408:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1026 00000100:00100000:2.0:1788872975.453418:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+42:2405:x1875765311287168:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:2.0:1788872975.453608:0:24865:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788872975.453612:0:24865:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:2.0:1788872975.453614:0:24865:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:2.0:1788872975.453616:0:24865:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:2.0:1788872975.453618:0:24865:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788872975.453627:0:24865:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9ecc700 x1875765311287168/t4294969496(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872975.453696:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+43:2405:x1875765311287168:12345-192.168.204.39@tcp:10:dd.0 Request processed in 279us (713us total) trans 4294969496 rc 0/0 00000100:00100000:2.0:1788872975.453703:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1026 00002000:00010000:2.0:1788872975.453707:0:24865:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/916 (0->18446744073709551615) 00002000:00100000:2.0:1788872975.453710:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecc700 with x1875765311287168 ext(0->18446744073709551615) 00002000:00010000:2.0:1788872975.453715:0:24865:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecc700. 00000100:00100000:2.0:1788872975.457138:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.457268:0:80566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311287424 00000100:00100000:3.0:1788872975.457279:0:80566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311287424 00000100:00100000:3.0:1788872975.457339:0:80566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 283 00000100:00100000:3.0:1788872975.457366:0:80566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+149:73772:x1875765311287424:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:3.0:1788872975.457725:0:80566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+150:73772:x1875765311287424:12345-192.168.204.39@tcp:35:dd.0 Request processed in 361us (596us total) trans 124554051729 rc 0/0 00000100:00100000:3.0:1788872975.457733:0:80566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 283 00000100:00100000:1.0:1788872975.461229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.461335:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311287552 00000100:00100000:0.0:1788872975.461346:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311287552 00000100:00100000:0.0:1788872975.461398:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6053 00000100:00100000:0.0:1788872975.461417:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+43:73773:x1875765311287552:12345-192.168.204.39@tcp:101:dd.0 00010000:00010000:0.0:1788872975.461436:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788872975.461459:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01dc5c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb54f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872975.461487:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x395:0x0] initial LVB size: 0, mtime: 0x6aa00901, atime: 0x6aa00901, ctime: 0x6aa00901, blocks: 0x0 00010000:00010000:0.0:1788872975.461513:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x395:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1788872975.461519:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x395:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788872975.461528:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01dc5c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb54f expref: 44 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.461545:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01dc5c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb54f expref: 44 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872975.461596:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e7e00, rc 0) 00010000:00000080:0.0:1788872975.461605:0:8437:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738df80 x1875765311287552/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 328/400 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.461670:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+44:73773:x1875765311287552:12345-192.168.204.39@tcp:101:dd.0 Request processed in 254us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.461678:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6053 00000100:00100000:0.0:1788872975.466123:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.466244:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311287680 00000100:00100000:1.0:1788872975.466256:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311287680 00002000:00010000:1.0:1788872975.466326:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/917 (0->18446744073709551615) 00002000:00100000:1.0:1788872975.466334:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecd880 with x1875765311287680 ext(0->18446744073709551615) 00002000:00010000:1.0:1788872975.466353:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecd880. 00000100:00100000:1.0:1788872975.466398:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1027 00000100:00100000:1.0:1788872975.466421:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+44:2407:x1875765311287680:12345-192.168.204.39@tcp:10:dd.0 00002000:00010000:1.0:1788872975.466626:0:24869:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788872975.466631:0:24869:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb mtime from disk: 1788872961 -> 1788872975 00002000:00010000:1.0:1788872975.466633:0:24869:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb atime from disk: 1788872961 -> 1788872961 00002000:00010000:1.0:1788872975.466636:0:24869:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb ctime from disk: 1788872961 -> 1788872975 00002000:00010000:1.0:1788872975.466654:0:24869:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788872975.466665:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9ecd880 x1875765311287680/t4294969497(0) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.466743:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+45:2407:x1875765311287680:12345-192.168.204.39@tcp:10:dd.0 Request processed in 324us (635us total) trans 4294969497 rc 0/0 00000100:00100000:1.0:1788872975.466751:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1027 00002000:00010000:1.0:1788872975.466755:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/917 (0->18446744073709551615) 00002000:00100000:1.0:1788872975.466758:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecd880 with x1875765311287680 ext(0->18446744073709551615) 00002000:00010000:1.0:1788872975.466763:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecd880. 00000100:00100000:2.0:1788872975.474484:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.474601:0:66194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311287936 00000100:00100000:1.0:1788872975.474611:0:66194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311287936 00000100:00100000:1.0:1788872975.474710:0:66194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 284 00000100:00100000:1.0:1788872975.474720:0:66194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+150:73773:x1875765311287936:12345-192.168.204.39@tcp:35:dd.0 00000100:00100000:1.0:1788872975.475053:0:66194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+151:73773:x1875765311287936:12345-192.168.204.39@tcp:35:dd.0 Request processed in 333us (578us total) trans 124554051730 rc 0/0 00000100:00100000:1.0:1788872975.475061:0:66194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 284 00000100:00100000:3.0:1788872975.626141:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.626198:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.626230:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311288064 00000100:00100000:3.0:1788872975.626241:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311288064 00002000:00100000:3.0:1788872975.626292:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x382:0x0] (0->1023) req@ffff98a8c5a41f80 x1875765311288064/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872975.626303:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a41f80 with x1875765311288064 ext(0->1023) 00002000:00010000:3.0:1788872975.626309:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a41f80 00000100:00100000:3.0:1788872975.626337:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1028 00000100:00100000:3.0:1788872975.626347:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+45:2405:x1875765311288064:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:3.0:1788872975.626847:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a41f80 x1875765311288064/t4294969498(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.626904:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+47:2405:x1875765311288064:12345-192.168.204.39@tcp:4:dd.0 Request processed in 558us (706us total) trans 4294969498 rc 0/0 00000100:00100000:3.0:1788872975.626913:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1028 00002000:00100000:3.0:1788872975.626920:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x382:0x0] (0->1023) req@ffff98a8c5a41f80 x1875765311288064/t4294969498(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872975.626928:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a41f80 with x1875765311288064 ext(0->1023) 00002000:00010000:3.0:1788872975.626932:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a41f80 00000100:00100000:1.0:1788872975.627135:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311288192 00000100:00100000:1.0:1788872975.627140:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311288192 00000100:00100000:1.0:1788872975.627188:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6054 00000100:00100000:1.0:1788872975.627196:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+47:2405:x1875765311288192:12345-192.168.204.39@tcp:16:kworker.0 00000001:00080000:1.0:1788872975.627456:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969498 is committed 00010000:00000080:1.0:1788872975.627525:0:8438:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a43800 x1875765311288192/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.627581:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311288192:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 386us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872975.627598:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6054 00000100:00100000:3.0:1788872975.633358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.633519:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.633703:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311288320 00000100:00100000:1.0:1788872975.633713:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311288320 00002000:00100000:1.0:1788872975.633759:0:24867:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x383:0x0] (0->1023) req@ffff98a8c9ecfb80 x1875765311288320/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872975.633770:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecfb80 with x1875765311288320 ext(0->1023) 00002000:00010000:1.0:1788872975.633776:0:24867:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecfb80 00000100:00100000:1.0:1788872975.633807:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1029 00000100:00100000:1.0:1788872975.633817:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2406:x1875765311288320:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:1.0:1788872975.634310:0:24867:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9ecfb80 x1875765311288320/t4294969499(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.634373:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2406:x1875765311288320:12345-192.168.204.39@tcp:4:dd.0 Request processed in 558us (854us total) trans 4294969499 rc 0/0 00000100:00100000:1.0:1788872975.634999:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1029 00002000:00100000:1.0:1788872975.635009:0:24867:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x383:0x0] (0->1023) req@ffff98a8c9ecfb80 x1875765311288320/t4294969499(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872975.635018:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecfb80 with x1875765311288320 ext(0->1023) 00002000:00010000:1.0:1788872975.635023:0:24867:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecfb80 00000100:00100000:0.0:1788872975.639432:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311288448 00000100:00100000:0.0:1788872975.639452:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311288448 00000100:00100000:0.0:1788872975.639525:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6055 00000100:00100000:0.0:1788872975.639535:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2406:x1875765311288448:12345-192.168.204.39@tcp:16:kworker.0 00000001:00080000:0.0:1788872975.639831:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969499 is committed 00010000:00000080:0.0:1788872975.639871:0:26184:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a42300 x1875765311288448/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.639953:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2406:x1875765311288448:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 419us (6607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.639961:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6055 00000100:00100000:3.0:1788872975.645688:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.645943:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311288704 00000100:00100000:0.0:1788872975.645955:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311288704 00000100:00100000:0.0:1788872975.646003:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6056 00000100:00100000:0.0:1788872975.646014:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311288704:12345-192.168.204.39@tcp:16:kworker.0 00010000:00000080:0.0:1788872975.646076:0:14545:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a42680 x1875765311288704/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.646149:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311288704:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 136us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.646157:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6056 00000100:00100000:3.0:1788872975.651244:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.651374:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311288576 00000100:00100000:1.0:1788872975.651409:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311288576 00002000:00100000:1.0:1788872975.651468:0:24855:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x384:0x0] (0->1023) req@ffff98a8c5a40700 x1875765311288576/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872975.651480:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a40700 with x1875765311288576 ext(0->1023) 00002000:00010000:1.0:1788872975.651486:0:24855:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a40700 00000100:00100000:1.0:1788872975.651544:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1030 00000100:00100000:1.0:1788872975.651577:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311288576:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:1.0:1788872975.652018:0:24855:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a40700 x1875765311288576/t4294969500(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.652092:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2405:x1875765311288576:12345-192.168.204.39@tcp:4:dd.0 Request processed in 517us (858us total) trans 4294969500 rc 0/0 00000100:00100000:1.0:1788872975.652100:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1030 00002000:00100000:1.0:1788872975.652108:0:24855:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x384:0x0] (0->1023) req@ffff98a8c5a40700 x1875765311288576/t4294969500(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872975.652115:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a40700 with x1875765311288576 ext(0->1023) 00002000:00010000:1.0:1788872975.652119:0:24855:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a40700 00000100:00100000:1.0:1788872975.663052:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.663149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.664848:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311288832 00000100:00100000:0.0:1788872975.664862:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311288832 00002000:00100000:0.0:1788872975.664927:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x385:0x0] (0->1023) req@ffff98a8c738d500 x1875765311288832/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.664939:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738d500 with x1875765311288832 ext(0->1023) 00002000:00010000:0.0:1788872975.664954:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738d500 00000100:00100000:0.0:1788872975.664986:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1031 00000100:00100000:0.0:1788872975.664996:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2405:x1875765311288832:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:0.0:1788872975.665415:0:8443:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738d500 x1875765311288832/t4294969501(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.665480:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2405:x1875765311288832:12345-192.168.204.39@tcp:4:dd.0 Request processed in 485us (2331us total) trans 4294969501 rc 0/0 00000100:00100000:0.0:1788872975.665488:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1031 00002000:00100000:0.0:1788872975.665495:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x385:0x0] (0->1023) req@ffff98a8c738d500 x1875765311288832/t4294969501(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.665503:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738d500 with x1875765311288832 ext(0->1023) 00002000:00010000:0.0:1788872975.665506:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738d500 00000100:00100000:2.0:1788872975.668318:0:26190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311288960 00000100:00100000:2.0:1788872975.668331:0:26190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311288960 00000100:00100000:2.0:1788872975.668413:0:26190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6057 00000100:00100000:2.0:1788872975.668423:0:26190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2405:x1875765311288960:12345-192.168.204.39@tcp:16:kworker.0 00000001:00080000:0.0:1788872975.668853:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969501 is committed 00010000:00010000:0.0:1788872975.672744:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:2.0:1788872975.675506:0:26190:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738e300 x1875765311288960/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872975.675612:0:26190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311288960:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 7190us (12570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.675623:0:26190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6057 00000100:00100000:0.0:1788872975.682150:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.682350:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311289088 00000100:00100000:1.0:1788872975.682362:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311289088 00002000:00100000:1.0:1788872975.682432:0:24865:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x386:0x0] (0->1023) req@ffff98a8c9ecf800 x1875765311289088/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872975.682442:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecf800 with x1875765311289088 ext(0->1023) 00002000:00010000:1.0:1788872975.682448:0:24865:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecf800 00000100:00100000:1.0:1788872975.682484:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1032 00000100:00100000:1.0:1788872975.682495:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2404:x1875765311289088:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:1.0:1788872975.682894:0:24865:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9ecf800 x1875765311289088/t4294969502(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.682957:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2404:x1875765311289088:12345-192.168.204.39@tcp:4:dd.0 Request processed in 464us (816us total) trans 4294969502 rc 0/0 00000100:00100000:1.0:1788872975.682972:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1032 00002000:00100000:1.0:1788872975.682979:0:24865:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x386:0x0] (0->1023) req@ffff98a8c9ecf800 x1875765311289088/t4294969502(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872975.682987:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecf800 with x1875765311289088 ext(0->1023) 00002000:00010000:1.0:1788872975.682990:0:24865:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecf800 00000100:00100000:0.0:1788872975.695737:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.695833:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311289216 00000100:00100000:2.0:1788872975.695849:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311289216 00000100:00100000:2.0:1788872975.695924:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6058 00000100:00100000:2.0:1788872975.695935:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2405:x1875765311289216:12345-192.168.204.39@tcp:16:kworker.0 00000001:00080000:2.0:1788872975.696442:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969502 is committed 00010000:00000080:0.0:1788872975.696531:0:26187:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f6a9c850 x1875765311289216/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.696630:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311289216:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 697us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.696638:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6058 00000100:00100000:3.0:1788872975.709695:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.709738:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.709774:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311289344 00000100:00100000:3.0:1788872975.709784:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311289344 00002000:00100000:3.0:1788872975.709830:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x387:0x0] (0->1023) req@ffff98a8c5a43800 x1875765311289344/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872975.709840:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a43800 with x1875765311289344 ext(0->1023) 00002000:00010000:3.0:1788872975.709846:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a43800 00000100:00100000:3.0:1788872975.709875:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1033 00000100:00100000:3.0:1788872975.709896:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311289344:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:3.0:1788872975.710310:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a43800 x1875765311289344/t4294969503(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.710377:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2405:x1875765311289344:12345-192.168.204.39@tcp:4:dd.0 Request processed in 493us (638us total) trans 4294969503 rc 0/0 00000100:00100000:3.0:1788872975.710384:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1033 00002000:00100000:3.0:1788872975.710392:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x387:0x0] (0->1023) req@ffff98a8c5a43800 x1875765311289344/t4294969503(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872975.710411:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a43800 with x1875765311289344 ext(0->1023) 00002000:00010000:3.0:1788872975.710415:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a43800 00000100:00100000:2.0:1788872975.711059:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311289472 00000100:00100000:2.0:1788872975.711069:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311289472 00000100:00100000:2.0:1788872975.711117:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6059 00000100:00100000:2.0:1788872975.711126:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2405:x1875765311289472:12345-192.168.204.39@tcp:16:kworker.0 00000001:00080000:2.0:1788872975.711375:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969503 is committed 00010000:00000080:2.0:1788872975.711426:0:26196:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a43b80 x1875765311289472/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872975.711478:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311289472:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 353us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.711488:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6059 00000100:00100000:3.0:1788872975.720072:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.720155:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311289600 00000100:00100000:1.0:1788872975.720168:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311289600 00002000:00100000:1.0:1788872975.720233:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x388:0x0] (0->1023) req@ffff98a8c5a42300 x1875765311289600/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872975.720243:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a42300 with x1875765311289600 ext(0->1023) 00002000:00010000:1.0:1788872975.720249:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a42300 00000100:00100000:1.0:1788872975.720285:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1034 00000100:00100000:1.0:1788872975.720295:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311289600:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:1.0:1788872975.720825:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a42300 x1875765311289600/t4294969504(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.720905:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2405:x1875765311289600:12345-192.168.204.39@tcp:4:dd.0 Request processed in 611us (843us total) trans 4294969504 rc 0/0 00000100:00100000:1.0:1788872975.720914:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1034 00002000:00100000:1.0:1788872975.720921:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x388:0x0] (0->1023) req@ffff98a8c5a42300 x1875765311289600/t4294969504(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872975.720930:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a42300 with x1875765311289600 ext(0->1023) 00002000:00010000:1.0:1788872975.720934:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a42300 00000100:00100000:3.0:1788872975.722533:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.722681:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311289728 00000100:00100000:2.0:1788872975.722691:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311289728 00000100:00100000:2.0:1788872975.722741:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6060 00000100:00100000:2.0:1788872975.722750:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2405:x1875765311289728:12345-192.168.204.39@tcp:16:kworker.0 00000001:00080000:1.0:1788872975.723455:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969504 is committed 00010000:00000080:2.0:1788872975.733540:0:26199:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a42680 x1875765311289728/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872975.733661:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311289728:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 10910us (11137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.733672:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6060 00000100:00100000:2.0:1788872975.737237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.737276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.737435:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311289984 00000100:00100000:3.0:1788872975.737447:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311289984 00000100:00100000:3.0:1788872975.737520:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6061 00000100:00100000:3.0:1788872975.737531:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311289984:12345-192.168.204.39@tcp:16:kworker.0 00010000:00000080:3.0:1788872975.737611:0:26189:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe5500 x1875765311289984/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.737668:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311289984:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 138us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.737676:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6061 00000100:00100000:3.0:1788872975.737699:0:25436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311289856 00000100:00100000:3.0:1788872975.737703:0:25436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311289856 00002000:00100000:3.0:1788872975.737724:0:25436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x389:0x0] (0->1023) req@ffff98a9f6981850 x1875765311289856/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872975.737733:0:25436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9f6981850 with x1875765311289856 ext(0->1023) 00002000:00010000:3.0:1788872975.737740:0:25436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9f6981850 00000100:00100000:3.0:1788872975.737757:0:25436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1035 00000100:00100000:3.0:1788872975.737764:0:25436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6981850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311289856:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:3.0:1788872975.738334:0:25436:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f6981850 x1875765311289856/t4294969505(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.738365:0:25436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6981850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2405:x1875765311289856:12345-192.168.204.39@tcp:4:dd.0 Request processed in 602us (1089us total) trans 4294969505 rc 0/0 00000100:00100000:3.0:1788872975.738372:0:25436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1035 00002000:00100000:3.0:1788872975.738379:0:25436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x389:0x0] (0->1023) req@ffff98a9f6981850 x1875765311289856/t4294969505(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872975.738388:0:25436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9f6981850 with x1875765311289856 ext(0->1023) 00002000:00010000:3.0:1788872975.738391:0:25436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9f6981850 00000100:00100000:1.0:1788872975.745877:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.745918:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.746001:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311290112 00000100:00100000:0.0:1788872975.746010:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311290112 00002000:00100000:0.0:1788872975.746065:0:24855:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x38a:0x0] (0->1023) req@ffff98a8c738c000 x1875765311290112/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.746095:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738c000 with x1875765311290112 ext(0->1023) 00002000:00010000:0.0:1788872975.746101:0:24855:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738c000 00000100:00100000:0.0:1788872975.746135:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1036 00000100:00100000:0.0:1788872975.746143:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2404:x1875765311290112:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:0.0:1788872975.746768:0:24855:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738c000 x1875765311290112/t4294969506(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.746825:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2404:x1875765311290112:12345-192.168.204.39@tcp:4:dd.0 Request processed in 682us (958us total) trans 4294969506 rc 0/0 00000100:00100000:0.0:1788872975.746834:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1036 00002000:00100000:0.0:1788872975.746841:0:24855:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x38a:0x0] (0->1023) req@ffff98a8c738c000 x1875765311290112/t4294969506(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.746849:0:24855:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738c000 with x1875765311290112 ext(0->1023) 00002000:00010000:0.0:1788872975.746853:0:24855:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738c000 00000100:00100000:3.0:1788872975.747850:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311290240 00000100:00100000:3.0:1788872975.747859:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311290240 00000100:00100000:3.0:1788872975.747916:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6062 00000100:00100000:3.0:1788872975.747924:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2405:x1875765311290240:12345-192.168.204.39@tcp:16:kworker.0 00000001:00080000:2.0:1788872975.748222:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969506 is committed 00010000:00000080:3.0:1788872975.748460:0:26182:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738f800 x1875765311290240/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.748519:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311290240:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 595us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.748526:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6062 00000100:00100000:2.0:1788872975.751725:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.751767:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.751848:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311290496 00000100:00100000:3.0:1788872975.751858:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311290496 00000100:00100000:3.0:1788872975.751914:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6063 00000100:00100000:3.0:1788872975.751923:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2407:x1875765311290496:12345-192.168.204.39@tcp:16:kworker.0 00010000:00000080:3.0:1788872975.751975:0:8437:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe6d80 x1875765311290496/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.752023:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2407:x1875765311290496:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 102us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.752040:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6063 00000100:00100000:0.0:1788872975.752375:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311290368 00000100:00100000:0.0:1788872975.752381:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311290368 00002000:00100000:0.0:1788872975.752417:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x38b:0x0] (0->1023) req@ffff98a8c9fe4000 x1875765311290368/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.752428:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe4000 with x1875765311290368 ext(0->1023) 00002000:00010000:0.0:1788872975.752434:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe4000 00000100:00100000:0.0:1788872975.752460:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1037 00000100:00100000:0.0:1788872975.752468:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2407:x1875765311290368:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:0.0:1788872975.752853:0:8443:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe4000 x1875765311290368/t4294969507(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.752892:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2407:x1875765311290368:12345-192.168.204.39@tcp:4:dd.0 Request processed in 426us (1176us total) trans 4294969507 rc 0/0 00000100:00100000:0.0:1788872975.752899:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1037 00002000:00100000:0.0:1788872975.752905:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x38b:0x0] (0->1023) req@ffff98a8c9fe4000 x1875765311290368/t4294969507(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.752913:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe4000 with x1875765311290368 ext(0->1023) 00002000:00010000:0.0:1788872975.752917:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe4000 00000100:00100000:3.0:1788872975.761665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.761736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.762048:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311290624 00000100:00100000:1.0:1788872975.762058:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311290624 00002000:00100000:1.0:1788872975.762109:0:24865:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x38c:0x0] (0->1023) req@ffff98a8c5a43100 x1875765311290624/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872975.762119:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a43100 with x1875765311290624 ext(0->1023) 00002000:00010000:1.0:1788872975.762124:0:24865:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a43100 00000100:00100000:1.0:1788872975.762159:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1038 00000100:00100000:1.0:1788872975.762170:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2405:x1875765311290624:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:1.0:1788872975.762750:0:24865:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a43100 x1875765311290624/t4294969508(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.762809:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2405:x1875765311290624:12345-192.168.204.39@tcp:4:dd.0 Request processed in 641us (1071us total) trans 4294969508 rc 0/0 00000100:00100000:1.0:1788872975.762817:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1038 00002000:00100000:1.0:1788872975.762824:0:24865:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x38c:0x0] (0->1023) req@ffff98a8c5a43100 x1875765311290624/t4294969508(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872975.762832:0:24865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a43100 with x1875765311290624 ext(0->1023) 00002000:00010000:1.0:1788872975.762835:0:24865:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a43100 00000100:00100000:2.0:1788872975.763197:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311290752 00000100:00100000:2.0:1788872975.763203:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311290752 00000100:00100000:2.0:1788872975.763249:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6064 00000100:00100000:2.0:1788872975.763257:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2405:x1875765311290752:12345-192.168.204.39@tcp:16:kworker.0 00000001:00080000:1.0:1788872975.763654:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969508 is committed 00010000:00000080:2.0:1788872975.763768:0:8438:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a41180 x1875765311290752/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872975.763813:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311290752:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 557us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.763821:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6064 00000100:00100000:1.0:1788872975.766959:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.767048:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311291008 00000100:00100000:3.0:1788872975.767058:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311291008 00000100:00100000:3.0:1788872975.767118:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6065 00000100:00100000:3.0:1788872975.767128:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311291008:12345-192.168.204.39@tcp:16:kworker.0 00010000:00000080:3.0:1788872975.767348:0:26184:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738ce00 x1875765311291008/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.767430:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311291008:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 303us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.767437:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6065 00000100:00100000:1.0:1788872975.769624:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.769813:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311290880 00000100:00100000:3.0:1788872975.769822:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311290880 00002000:00100000:3.0:1788872975.769866:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x38d:0x0] (0->1023) req@ffff98a8c738c700 x1875765311290880/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872975.769876:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738c700 with x1875765311290880 ext(0->1023) 00002000:00010000:3.0:1788872975.769881:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738c700 00000100:00100000:3.0:1788872975.771631:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1039 00000100:00100000:3.0:1788872975.771646:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311290880:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:3.0:1788872975.776790:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738c700 x1875765311290880/t4294969509(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.776875:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2405:x1875765311290880:12345-192.168.204.39@tcp:4:dd.0 Request processed in 5232us (7260us total) trans 4294969509 rc 0/0 00000100:00100000:3.0:1788872975.776886:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1039 00002000:00100000:3.0:1788872975.776897:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x38d:0x0] (0->1023) req@ffff98a8c738c700 x1875765311290880/t4294969509(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872975.776907:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738c700 with x1875765311290880 ext(0->1023) 00002000:00010000:3.0:1788872975.776912:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738c700 00000100:00100000:3.0:1788872975.781657:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.781702:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.781828:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311291136 00000100:00100000:0.0:1788872975.781838:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311291136 00002000:00100000:0.0:1788872975.781885:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x38e:0x0] (0->1023) req@ffff98a8c5a42a00 x1875765311291136/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.781896:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a42a00 with x1875765311291136 ext(0->1023) 00002000:00010000:0.0:1788872975.781901:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a42a00 00000100:00100000:0.0:1788872975.781932:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1040 00000100:00100000:0.0:1788872975.781941:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2407:x1875765311291136:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:0.0:1788872975.782311:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a42a00 x1875765311291136/t4294969510(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.782366:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2407:x1875765311291136:12345-192.168.204.39@tcp:4:dd.0 Request processed in 426us (718us total) trans 4294969510 rc 0/0 00000100:00100000:0.0:1788872975.782500:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1040 00002000:00100000:0.0:1788872975.782510:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x38e:0x0] (0->1023) req@ffff98a8c5a42a00 x1875765311291136/t4294969510(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.782519:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a42a00 with x1875765311291136 ext(0->1023) 00002000:00010000:0.0:1788872975.782530:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a42a00 00000100:00100000:0.0:1788872975.782581:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311291264 00000100:00100000:0.0:1788872975.782586:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311291264 00000100:00100000:0.0:1788872975.782611:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6066 00000100:00100000:0.0:1788872975.782617:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2407:x1875765311291264:12345-192.168.204.39@tcp:16:kworker.0 00000001:00080000:1.0:1788872975.782997:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969510 is committed 00010000:00000080:0.0:1788872975.783139:0:14545:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a41f80 x1875765311291264/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.783252:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2407:x1875765311291264:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 634us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.783260:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6066 00000100:00100000:3.0:1788872975.794007:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.794159:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.794196:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311291520 00000100:00100000:3.0:1788872975.794208:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311291520 00000100:00100000:3.0:1788872975.794259:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6067 00000100:00100000:3.0:1788872975.794271:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2407:x1875765311291520:12345-192.168.204.39@tcp:16:kworker.0 00010000:00000080:3.0:1788872975.794324:0:8436:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a43800 x1875765311291520/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.796752:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2407:x1875765311291520:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 2471us (2592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.796766:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6067 00000100:00100000:0.0:1788872975.801276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.801301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.801415:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311291776 00000100:00100000:1.0:1788872975.801427:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311291776 00000100:00100000:1.0:1788872975.801496:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6068 00000100:00100000:1.0:1788872975.801515:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2406:x1875765311291776:12345-192.168.204.39@tcp:16:kworker.0 00010000:00000080:1.0:1788872975.801593:0:26185:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a42300 x1875765311291776/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.801650:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2406:x1875765311291776:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 138us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872975.801657:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6068 00000100:00100000:3.0:1788872975.808304:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.808421:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311292032 00000100:00100000:1.0:1788872975.808433:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311292032 00000100:00100000:1.0:1788872975.808491:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6069 00000100:00100000:1.0:1788872975.808502:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311292032:12345-192.168.204.39@tcp:16:kworker.0 00010000:00000080:1.0:1788872975.808589:0:26196:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f5c1c000 x1875765311292032/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.808650:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2405:x1875765311292032:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 149us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872975.808658:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6069 00000100:00100000:1.0:1788872975.810701:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.810767:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311291392 00000100:00100000:2.0:1788872975.810776:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311291392 00002000:00100000:0.0:1788872975.811370:0:24867:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x38f:0x0] (0->1023) req@ffff98a8c5a40700 x1875765311291392/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.811401:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a40700 with x1875765311291392 ext(0->1023) 00002000:00010000:0.0:1788872975.811407:0:24867:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a40700 00000100:00100000:0.0:1788872975.811442:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311291648 00000100:00100000:0.0:1788872975.811446:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311291648 00002000:00100000:0.0:1788872975.811462:0:24867:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x390:0x0] (0->1023) req@ffff98a8c9ecf100 x1875765311291648/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.811469:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecf100 with x1875765311291648 ext(0->1023) 00002000:00010000:0.0:1788872975.811472:0:24867:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecf100 00000100:00100000:0.0:1788872975.811491:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1041 00000100:00100000:0.0:1788872975.811500:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+26:2407:x1875765311291392:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:0.0:1788872975.811929:0:24867:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c5a40700 x1875765311291392/t4294969511(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.812001:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+28:2407:x1875765311291392:12345-192.168.204.39@tcp:4:dd.0 Request processed in 502us (18003us total) trans 4294969511 rc 0/0 00000100:00100000:0.0:1788872975.812009:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1041 00002000:00100000:0.0:1788872975.812015:0:24867:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x38f:0x0] (0->1023) req@ffff98a8c5a40700 x1875765311291392/t4294969511(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.812023:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c5a40700 with x1875765311291392 ext(0->1023) 00002000:00010000:0.0:1788872975.812027:0:24867:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c5a40700 00000100:00100000:0.0:1788872975.812044:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1042 00000100:00100000:0.0:1788872975.812051:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2406:x1875765311291648:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:0.0:1788872975.812191:0:24867:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9ecf100 x1875765311291648/t4294969512(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.812217:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2406:x1875765311291648:12345-192.168.204.39@tcp:4:dd.0 Request processed in 166us (10946us total) trans 4294969512 rc 0/0 00000100:00100000:0.0:1788872975.812225:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1042 00002000:00100000:0.0:1788872975.812231:0:24867:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x390:0x0] (0->1023) req@ffff98a8c9ecf100 x1875765311291648/t4294969512(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.812238:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9ecf100 with x1875765311291648 ext(0->1023) 00002000:00010000:0.0:1788872975.812241:0:24867:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9ecf100 00000100:00100000:2.0:1788872975.817714:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.817848:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311292288 00000100:00100000:0.0:1788872975.817859:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311292288 00000100:00100000:0.0:1788872975.817912:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6070 00000100:00100000:0.0:1788872975.817922:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2407:x1875765311292288:12345-192.168.204.39@tcp:16:kworker.0 00010000:00000080:0.0:1788872975.817980:0:26192:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe6a00 x1875765311292288/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.818052:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2407:x1875765311292288:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 132us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872975.818060:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6070 00000100:00100000:1.0:1788872975.822141:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.822261:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311291904 00000100:00100000:3.0:1788872975.822271:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311291904 00002000:00100000:3.0:1788872975.822320:0:24856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x391:0x0] (0->1023) req@ffff98a8c738f100 x1875765311291904/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872975.822331:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738f100 with x1875765311291904 ext(0->1023) 00002000:00010000:3.0:1788872975.822336:0:24856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738f100 00000100:00100000:3.0:1788872975.822364:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311292160 00000100:00100000:3.0:1788872975.822368:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311292160 00002000:00100000:3.0:1788872975.822400:0:24856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x392:0x0] (0->1023) req@ffff98a8c738d880 x1875765311292160/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872975.822408:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738d880 with x1875765311292160 ext(0->1023) 00002000:00010000:3.0:1788872975.822411:0:24856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738d880 00000100:00100000:3.0:1788872975.822429:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1043 00000100:00100000:3.0:1788872975.822439:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+30:2405:x1875765311291904:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:3.0:1788872975.822833:0:24856:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738f100 x1875765311291904/t4294969513(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.822890:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+32:2405:x1875765311291904:12345-192.168.204.39@tcp:4:dd.0 Request processed in 452us (12199us total) trans 4294969513 rc 0/0 00000100:00100000:3.0:1788872975.822898:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1043 00002000:00100000:3.0:1788872975.822905:0:24856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x391:0x0] (0->1023) req@ffff98a8c738f100 x1875765311291904/t4294969513(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872975.822912:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738f100 with x1875765311291904 ext(0->1023) 00002000:00010000:3.0:1788872975.822916:0:24856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738f100 00000100:00100000:3.0:1788872975.822932:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1044 00000100:00100000:3.0:1788872975.822939:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+31:2407:x1875765311292160:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:3.0:1788872975.823079:0:24856:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738d880 x1875765311292160/t4294969514(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.823105:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+33:2407:x1875765311292160:12345-192.168.204.39@tcp:4:dd.0 Request processed in 166us (975us total) trans 4294969514 rc 0/0 00000100:00100000:3.0:1788872975.823111:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1044 00002000:00100000:3.0:1788872975.823116:0:24856:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x392:0x0] (0->1023) req@ffff98a8c738d880 x1875765311292160/t4294969514(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788872975.823123:0:24856:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738d880 with x1875765311292160 ext(0->1023) 00002000:00010000:3.0:1788872975.823127:0:24856:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738d880 00000100:00100000:1.0:1788872975.824195:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.824233:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872975.824262:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311292416 00000100:00100000:1.0:1788872975.824270:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311292416 00002000:00100000:1.0:1788872975.824302:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x393:0x0] (0->1023) req@ffff98a8c738e680 x1875765311292416/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872975.824313:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738e680 with x1875765311292416 ext(0->1023) 00002000:00010000:1.0:1788872975.824317:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738e680 00000100:00100000:1.0:1788872975.824353:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1045 00000100:00100000:1.0:1788872975.824363:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+33:2406:x1875765311292416:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:1.0:1788872975.824706:0:8441:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738e680 x1875765311292416/t4294969515(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872975.824753:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+35:2406:x1875765311292416:12345-192.168.204.39@tcp:4:dd.0 Request processed in 391us (518us total) trans 4294969515 rc 0/0 00000100:00100000:1.0:1788872975.824760:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1045 00002000:00100000:1.0:1788872975.824767:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x393:0x0] (0->1023) req@ffff98a8c738e680 x1875765311292416/t4294969515(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788872975.824775:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c738e680 with x1875765311292416 ext(0->1023) 00002000:00010000:1.0:1788872975.824779:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c738e680 00000100:00100000:3.0:1788872975.825371:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311292544 00000100:00100000:3.0:1788872975.825388:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311292544 00000100:00100000:3.0:1788872975.825438:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6071 00000100:00100000:3.0:1788872975.825457:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+35:2406:x1875765311292544:12345-192.168.204.39@tcp:16:kworker.0 00000001:00080000:1.0:1788872975.825841:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969515 is committed 00010000:00000080:3.0:1788872975.825936:0:26189:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738dc00 x1875765311292544/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.825988:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2406:x1875765311292544:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 533us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.826005:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6071 00000100:00100000:2.0:1788872975.834726:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872975.834874:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311292672 00000100:00100000:0.0:1788872975.834885:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311292672 00002000:00100000:0.0:1788872975.834934:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x394:0x0] (0->1023) req@ffff98a8c9fe7480 x1875765311292672/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.834944:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe7480 with x1875765311292672 ext(0->1023) 00002000:00010000:0.0:1788872975.834950:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe7480 00000100:00100000:0.0:1788872975.834973:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1046 00000100:00100000:0.0:1788872975.834983:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2404:x1875765311292672:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:0.0:1788872975.835404:0:8442:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9fe7480 x1875765311292672/t4294969516(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.835467:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2404:x1875765311292672:12345-192.168.204.39@tcp:4:dd.0 Request processed in 485us (750us total) trans 4294969516 rc 0/0 00000100:00100000:0.0:1788872975.835476:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1046 00002000:00100000:0.0:1788872975.835482:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x394:0x0] (0->1023) req@ffff98a8c9fe7480 x1875765311292672/t4294969516(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.835489:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a8c9fe7480 with x1875765311292672 ext(0->1023) 00002000:00010000:0.0:1788872975.835492:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a8c9fe7480 00000100:00100000:1.0:1788872975.844162:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872975.844258:0:26194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311292800 00000100:00100000:2.0:1788872975.844268:0:26194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311292800 00000100:00100000:2.0:1788872975.844324:0:26194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6072 00000100:00100000:2.0:1788872975.844334:0:26194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2404:x1875765311292800:12345-192.168.204.39@tcp:16:kworker.0 00000001:00080000:1.0:1788872975.844924:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969516 is committed 00010000:00000080:2.0:1788872975.845183:0:26194:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c738ca80 x1875765311292800/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872975.845465:0:26194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2404:x1875765311292800:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 1131us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872975.845475:0:26194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6072 00000100:00100000:3.0:1788872975.852463:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.852504:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872975.852542:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311293056 00000100:00100000:3.0:1788872975.852573:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311293056 00000100:00100000:3.0:1788872975.852625:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6073 00000100:00100000:3.0:1788872975.852634:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2404:x1875765311293056:12345-192.168.204.39@tcp:16:kworker.0 00010000:00000080:3.0:1788872975.852687:0:8437:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f5c1ed80 x1875765311293056/t0(0) o16->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 440/432 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872975.852739:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2404:x1875765311293056:12345-192.168.204.39@tcp:16:kworker.0 Request processed in 106us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872975.852746:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6073 00000100:00100000:0.0:1788872975.853052:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311292928 00000100:00100000:0.0:1788872975.853057:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311292928 00002000:00100000:0.0:1788872975.853082:0:24867:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x395:0x0] (0->1023) req@ffff98a9f5c1f480 x1875765311292928/t0(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/0 e 0 to 0 dl 1788872986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.853102:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9f5c1f480 with x1875765311292928 ext(0->1023) 00002000:00010000:0.0:1788872975.853108:0:24867:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9f5c1f480 00000100:00100000:0.0:1788872975.853127:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1047 00000100:00100000:0.0:1788872975.853134:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2404:x1875765311292928:12345-192.168.204.39@tcp:4:dd.0 00010000:00000080:0.0:1788872975.853499:0:24867:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a9f5c1f480 x1875765311292928/t4294969517(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872975.853569:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2404:x1875765311292928:12345-192.168.204.39@tcp:4:dd.0 Request processed in 415us (1097us total) trans 4294969517 rc 0/0 00000100:00100000:0.0:1788872975.853576:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1047 00002000:00100000:0.0:1788872975.853582:0:24867:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x395:0x0] (0->1023) req@ffff98a9f5c1f480 x1875765311292928/t4294969517(0) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:146/0 lens 1512/448 e 0 to 0 dl 1788872986 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788872975.853590:0:24867:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98a9f5c1f480 with x1875765311292928 ext(0->1023) 00002000:00010000:0.0:1788872975.853594:0:24867:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98a9f5c1f480 00010000:00010000:3.0:1788872976.699627:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872977.081047:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327882880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788872977.081130:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872977.081260:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327882880 00000100:00100000:3.0:1788872977.081268:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327882880 00000100:00100000:3.0:1788872977.081335:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247 00000100:00100000:3.0:1788872977.081345:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327882880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788872977.081390:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 176828736 pending 28672 free 3923447808 avail 3691925504 00010000:00000080:3.0:1788872977.081406:0:8440:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff98a8c9eced80 x1875765327882880/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:148/0 lens 224/368 e 0 to 0 dl 1788872988 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872977.081475:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327882880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872977.081484:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247 00000100:00100000:3.0:1788872977.081530:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327882880:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788872977.082209:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788872977.083166:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788872977.083183:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c738c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327883008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788872977.083235:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872977.083536:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327883008 00000100:00100000:2.0:1788872977.083544:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327883008 00000100:00100000:2.0:1788872977.083622:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248 00000100:00100000:2.0:1788872977.083632:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327883008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872977.083657:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00080000:0.0:1788872977.083808:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872977.084027:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c738c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327883008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872977.084069:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327883008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 279us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872977.084078:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248 00000020:01000004:2.0:1788872977.673754:0:96007:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788872977.673820:0:96007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.673835:0:96007:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.673843:0:96007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.673851:0:96007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.673873:0:96007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788872977.673892:0:96007:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788872977.673923:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788872977.673929:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.673937:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c52ae000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1788872977.673941:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.673950:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788872977.673958:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872977.673969:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788872977.673971:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788872977.674025:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788872977.674064:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.674076:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788872977.674167:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.674176:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae000/0xe4e6e89fb01dbbc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dbbcc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872977.674217:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327883136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788872977.674255:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872977.674259:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872977.674262:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788872977.674287:0:96007:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788872977.674298:0:96007:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788872977.674305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788872977.674307:0:96007:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788872977.674323:0:96007:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788872977.674388:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327883136 00000100:00100000:1.0:1788872977.674396:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327883136 00000100:00100000:1.0:1788872977.674539:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1788872977.674570:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327883136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872977.674586:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872977.674606:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9caa1a800/0xe4e6e89fb01dbbcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbc5 expref: 24 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872977.674623:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872977.674673:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3646:x1875765327883136:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872977.674680:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1788872977.674730:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327883136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788872977.675604:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327883264:0@lo:39:umount.0 00000100:00100000:2.0:1788872977.675656:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872977.676132:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327883264 00000100:00100000:1.0:1788872977.676195:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327883264 00000100:00100000:1.0:1788872977.676248:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:1.0:1788872977.676257:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875765327883264:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788872977.676287:0:66193:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01db7ff 00000100:00080000:1.0:1788872977.676302:0:66193:0:(import.c:65:import_set_state_nolock()) ffff98a9f0830000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788872977.676376:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+1:3643:x1875765327883264:12345-0@lo:39:umount.0 Request processed in 120us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872977.676384:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000020:00000080:1.0:1788872977.676392:0:66193:0:(genops.c:906:class_export_put()) final put ffff98a9f0833800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1788872977.676597:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788872977.677230:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1788872977.677247:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9f0833800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788872977.677308:0:30879:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9f0830000 for lustre-MDT0000 00000100:00080000:1.0:1788872977.677389:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788872977.677508:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327883264:0@lo:39:umount.0 00000100:00080000:2.0:1788872977.681840:0:96007:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788872977.681852:0:96007:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788872977.681861:0:96007:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788872977.685642:0:96007:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788872977.685651:0:96007:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788872977.685657:0:96007:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788872977.685681:0:96007:0:(import.c:65:import_set_state_nolock()) ffff98a9ef237000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788872977.686156:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875765327883392:0@lo:39:umount.0 00000100:00100000:1.0:1788872977.686232:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872977.686295:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327883392 00000100:00100000:1.0:1788872977.686305:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327883392 00000100:00100000:1.0:1788872977.686380:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602 00000100:00100000:1.0:1788872977.686393:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875765327883392:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788872977.686536:0:66190:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d55c0 00000100:00080000:1.0:1788872977.686588:0:66190:0:(import.c:65:import_set_state_nolock()) ffff98a9dfe92800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788872977.686661:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+1:3643:x1875765327883392:12345-0@lo:39:umount.0 Request processed in 270us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872977.686669:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602 00000020:00000080:1.0:1788872977.686681:0:66190:0:(genops.c:906:class_export_put()) final put ffff98a9dfe93800/lustre-MDT0001-lwp-OST0000_UUID 00000100:00080000:1.0:1788872977.686708:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:1.0:1788872977.686720:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9dfe93800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788872977.686774:0:30879:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9dfe92800 for lustre-MDT0001 00000100:00080000:1.0:1788872977.686808:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ef237000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788872977.686818:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875765327883392:0@lo:39:umount.0 00010000:00010000:2.0:1788872977.687144:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788872977.687157:0:96007:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788872977.687160:0:96007:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788872977.687164:0:96007:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788872977.691721:0:96007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.691743:0:96007:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.691753:0:96007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.691761:0:96007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.691792:0:96007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788872977.691814:0:96007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.691821:0:96007:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.691827:0:96007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.691833:0:96007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.692818:0:96007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788872977.692828:0:96007:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788872977.692999:0:96007:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788872977.693005:0:96007:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00010000:00010000:3.0:1788872977.694060:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872977.694073:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872977.694086:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9caa1ac00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872977.694098:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872977.694110:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872977.694117:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872977.694123:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788872977.694126:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788872977.694129:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788872977.694176:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872977.694195:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872977.694236:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872977.694243:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9caa1ac00/0xe4e6e89fb01dbbd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01dbbda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872977.694258:0:20230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872977.694262:0:20230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872977.694268:0:20230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa899000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872977.694271:0:20230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872977.694279:0:20230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872977.694287:0:20230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872977.694293:0:20230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788872977.695160:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788872977.695207:0:96007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788872977.695223:0:96007:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00002000:00000080:2.0:1788872977.697424:0:96007:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:2.0:1788872977.697492:0:96007:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 10000000:01000000:3.0:1788872977.697714:0:20230:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788872977.697720:0:20230:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788872977.698898:0:20230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872977.698912:0:20230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788872977.698948:0:20230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872977.698977:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a9fa899000/0xe4e6e89fb01db7ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe4e6e89fb01db7d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872977.698995:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872977.698997:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872977.698999:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872977.699024:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327883520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788872977.699186:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327883648:0@lo:103:ldlm_bl.0 00000001:00080000:1.0:1788872977.699994:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969517 is committed 00000100:00100000:0.0:1788872977.703185:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872977.703679:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327883648 00000100:00100000:1.0:1788872977.703694:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327883648 00000100:00100000:1.0:1788872977.703769:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1788872977.703781:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3644:x1875765327883648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872977.703798:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872977.703824:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac5400/0xe4e6e89fb01db7d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01db7ce expref: 23 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872977.703842:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872977.703967:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3644:x1875765327883648:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872977.703975:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1788872977.704758:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327883648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788872977.705611:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872977.705657:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327883520 00000100:00100000:1.0:1788872977.705664:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327883520 00000100:00100000:1.0:1788872977.705760:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1788872977.705770:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3647:x1875765327883520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788872977.705804:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788872977.705822:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8c449be00/0xe4e6e89fb01dbbda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbd3 expref: 22 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872977.705836:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788872977.705883:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3647:x1875765327883520:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872977.705890:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1788872977.706049:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327883520:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788872977.708294:0:96007:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1788872977.708311:0:96007:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff98a8c2794800 0804304d-5904-48ad-87f2-bcbc7642a62a 192.168.204.39@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294969517 stale:0 00000020:00080000:2.0:1788872977.708319:0:96007:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff98a9e021d000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969473 stale:0 00000020:00080000:2.0:1788872977.708328:0:96007:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff98a9c45cd800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969455 stale:0 00000020:00080000:2.0:1788872977.708334:0:96007:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff98a8c1cfb380) has exports, disconnecting them 00000020:00080000:2.0:1788872977.708340:0:96007:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.204.39@tcp (ffff98a8c2794800), last request at 1788872975 00000020:00000080:2.0:1788872977.708349:0:96007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01dbcba 00000020:00010000:2.0:1788872977.708370:0:96007:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98a8c2794800: total 0 00000100:00080000:2.0:1788872977.708390:0:96007:0:(import.c:65:import_set_state_nolock()) ffff98a9c5f16800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788872977.708416:0:96007:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.39@tcp (ffff98a8c2794800): rc 0 00000020:00080000:2.0:1788872977.708419:0:96007:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff98a9e021d000), last request at 1788872974 00000020:00000080:2.0:1788872977.708422:0:96007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01db6e0 00000100:00080000:2.0:1788872977.708427:0:96007:0:(import.c:65:import_set_state_nolock()) ffff98a9e0219000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1788872977.708448:0:14981:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98a8c2794800: total 0 00010000:00010000:2.0:1788872977.708452:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872977.708453:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788872977.708464:0:96007:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9e021d000): rc 0 00000020:00000080:2.0:1788872977.708467:0:96007:0:(genops.c:906:class_export_put()) final put ffff98a9e021d000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1788872977.708477:0:96007:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff98a9c45cd800), last request at 1788872977 00000020:00000080:2.0:1788872977.708480:0:96007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb01d552d 00000100:00080000:2.0:1788872977.708484:0:96007:0:(import.c:65:import_set_state_nolock()) ffff98a9c45cf000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788872977.708496:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788872977.708504:0:96007:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a9c45cd800): rc 0 00000020:00000080:2.0:1788872977.708506:0:96007:0:(genops.c:906:class_export_put()) final put ffff98a9c45cd800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1788872977.708511:0:14981:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98a8c2794800, canceled 0 locks, left on hash table 20. 00000020:00080000:2.0:1788872977.708535:0:96007:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff98a8c1cfb380) has no exports 00000020:00000080:3.0:1788872977.708612:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9e021d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00002000:00010000:0.0:1788872977.708613:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.708619:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788872977.708626:0:96007:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01dc1f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb40d expref: 21 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.708656:0:96007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf1844de/0xe4e6e89fb01dc1f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb40d expref: 21 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872977.708658:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6ece204/0xe4e6e89fb01dc423 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4ae expref: 21 pid: 26191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788872977.708663:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c45cd800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788872977.708695:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9e0219000 for lustre-OST0000 00002000:00010000:0.0:1788872977.708702:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb size from disk: 0 -> 1024 00000020:00000080:3.0:1788872977.708703:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c45cf000 for lustre-OST0000 00002000:00010000:0.0:1788872977.708707:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.708719:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c839135/0xe4e6e89fb01dc56c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb52c expref: 19 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.708736:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.708739:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.708747:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e348c4f2/0xe4e6e89fb01dc2b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb43e expref: 18 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.708761:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.708764:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.708770:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e83d969/0xe4e6e89fb01dc366 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb47d expref: 17 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.708800:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.708802:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.708810:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026b3c73f/0xe4e6e89fb01dc5c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb548 expref: 16 pid: 26182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.708824:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.708826:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.708832:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000744aef61/0xe4e6e89fb01dc470 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4d8 expref: 15 pid: 9961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.708854:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.708856:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.708864:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006049be13/0xe4e6e89fb01dc26a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb429 expref: 14 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.708879:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.708881:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.708887:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000455c80f6/0xe4e6e89fb01dc35f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb468 expref: 13 pid: 26189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.708901:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.708903:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.709073:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000068f9c74/0xe4e6e89fb01dc3eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4a7 expref: 12 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.709096:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.709099:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.709107:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e74ba2b4/0xe4e6e89fb01dc1c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3f8 expref: 11 pid: 26191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.709152:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.709155:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.709165:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089041800/0xe4e6e89fb01dc4a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4e6 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.709933:0:96007:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01dc255 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb422 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.709965:0:96007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005818d696/0xe4e6e89fb01dc255 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb422 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.709979:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.709985:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.710004:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a054b5bf/0xe4e6e89fb01dc565 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb525 expref: 8 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.710029:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.710032:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.710039:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004834c92d/0xe4e6e89fb01dc4af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb4f4 expref: 7 pid: 26187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872977.710050:0:96007:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000218b0421/0xe4e6e89fb01dc16e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3e3 expref: 6 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.710059:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.710063:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788872977.710067:0:96007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000218b0421/0xe4e6e89fb01dc16e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb3e3 expref: 6 pid: 26188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872977.710074:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fae93f37/0xe4e6e89fb01dc4ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb502 expref: 6 pid: 26183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.710095:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.710098:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.710105:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c5ab107/0xe4e6e89fb01dc2e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb453 expref: 4 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.710121:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.710124:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.710130:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023d002f5/0xe4e6e89fb01dc3b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb492 expref: 3 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788872977.710158:0:14981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788872977.710161:0:14981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788872977.710170:0:14981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0292e32/0xe4e6e89fb01dc5c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb54f expref: 2 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872977.710185:0:14981:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98a8c2794800, canceled 17 locks, left on hash table 0. 00000020:00000080:0.0:1788872977.718126:0:14981:0:(genops.c:906:class_export_put()) final put ffff98a8c2794800/0804304d-5904-48ad-87f2-bcbc7642a62a 00010000:00010000:1.0:1788872977.718970:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872977.718975:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788872977.718978:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788872977.719215:0:30879:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c2794800/0804304d-5904-48ad-87f2-bcbc7642a62a for lustre-OST0000 00000020:00000080:3.0:1788872977.719287:0:30879:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9c5f16800 for lustre-OST0000 00000020:01000000:1.0:1788872977.720215:0:96007:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a8c30ee900 - data ffff98a8c20fdbd0/ffff98a8c3778c00 00000020:01000000:1.0:1788872977.720406:0:96007:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98a8c1e74a80 - data ffff98a9c6eb7000/ffff98a8c24ae000 00010000:00010000:3.0:1788872977.733196:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788872977.742233:0:96007:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788872977.757723:0:96007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb018e8bc 00000020:00000080:1.0:1788872977.757737:0:96007:0:(genops.c:906:class_export_put()) final put ffff98a9fbfad000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788872977.757751:0:96007:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9ef97c000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788872977.757755:0:96007:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9ef97c000 2 00000020:01000004:1.0:1788872977.757758:0:96007:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98a9ef97c000 from lustre-OST0000 00000020:00000080:1.0:1788872977.757782:0:96007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788872977.757794:0:96007:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788872977.757797:0:96007:0:(genops.c:906:class_export_put()) final put ffff98a9efc04800/lustre-OST0000_UUID 00000020:00000080:1.0:1788872977.757800:0:96007:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9efc04800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788872977.757806:0:96007:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788872977.757862:0:96007:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1788872977.757867:0:96007:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788872977.757870:0:96007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788872977.757877:0:96007:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788872977.757883:0:96007:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98a8c1f5e800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788872977.757889:0:96007:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff98a8c1cfcd40) has exports, disconnecting them 00000020:00080000:1.0:1788872977.757907:0:96007:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98a8c1f5e800), last request at 1788869351 00000020:00000080:1.0:1788872977.757911:0:96007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb018e8e6 00000020:00080000:1.0:1788872977.757921:0:96007:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a8c1f5e800): rc 0 00000020:00000080:1.0:1788872977.757925:0:96007:0:(genops.c:906:class_export_put()) final put ffff98a8c1f5e800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788872977.758622:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9fbfad000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788872977.758631:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c1f5e800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788872977.765621:0:96007:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788872977.765631:0:96007:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788872977.765635:0:96007:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788872977.765642:0:96007:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788872977.765792:0:96007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788872977.765807:0:96007:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788872977.765815:0:96007:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788872977.765820:0:96007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788872977.765825:0:96007:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788872977.765833:0:96007:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff98a8c1f5c800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788872977.765841:0:96007:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff98a9e9b9b380) has exports, disconnecting them 00000020:00080000:2.0:1788872977.765845:0:96007:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff98a8c1f5c800), last request at 1788869351 00000020:00000080:2.0:1788872977.765850:0:96007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb018e8fb 00000020:00080000:2.0:1788872977.765867:0:96007:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98a8c1f5c800): rc 0 00000020:00000080:2.0:1788872977.765872:0:96007:0:(genops.c:906:class_export_put()) final put ffff98a8c1f5c800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788872977.766579:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a8c1f5a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788872977.766587:0:86506:0:(genops.c:906:class_export_put()) final put ffff98a8c1f59000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788872977.766590:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c1f59000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788872977.766602:0:86506:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788872977.766692:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a8c1f5c800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788872977.769464:0:96007:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788872977.769474:0:96007:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788872977.769499:0:96007:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788872977.769508:0:96007:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788872977.769543:0:86506:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98a9ef237000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788872977.769737:0:96007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872977.769750:0:96007:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788872977.769755:0:96007:0:(genops.c:906:class_export_put()) final put ffff98a9cb580000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788872977.769759:0:96007:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9cb580000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788872977.769765:0:96007:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788872977.769851:0:96007:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9ef97c000 1 00000020:00000080:3.0:1788872977.769857:0:96007:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe4e6e89fb018e884 00000020:00000080:3.0:1788872977.769864:0:96007:0:(genops.c:906:class_export_put()) final put ffff98a9c73c0000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788872977.769873:0:96007:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788872977.769880:0:86506:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9c73c0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788872977.769888:0:96007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788872977.769894:0:96007:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788872977.769898:0:96007:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff98a9efa7cd40) has no exports 00000020:00000080:3.0:1788872977.955716:0:96007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788872977.955737:0:96007:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788872977.955744:0:96007:0:(genops.c:906:class_export_put()) final put ffff98a9ef97a000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788872977.955749:0:96007:0:(genops.c:865:class_export_destroy()) destroying export ffff98a9ef97a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788872977.955759:0:96007:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788872977.956523:0:96007:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98a9ef97a800 00000020:02000400:3.0:1788872977.957212:0:96007:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:0.0:1788872978.616801:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327883776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872978.616880:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872978.617042:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327883776 00000100:00100000:2.0:1788872978.617049:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327883776 00000100:00100000:2.0:1788872978.617104:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4072 00000100:00100000:2.0:1788872978.617114:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327883776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788872978.617830:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1788872978.617884:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327883776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 770us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872978.617892:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4072 00000100:00100000:1.0:1788872978.618146:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327883776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788872978.618247:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872978.618256:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c738df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327884160:0@lo:400:kworker.0 00000100:00100000:1.0:1788872978.618308:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872978.618365:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c738c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327884288:0@lo:400:kworker.0 00000100:00100000:1.0:1788872978.618392:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872978.618420:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327884288 00000100:00100000:1.0:1788872978.618425:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327884288 00000100:00100000:1.0:1788872978.618458:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4073 00000100:00100000:1.0:1788872978.618467:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327884288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872978.618506:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327884288:12345-0@lo:400:kworker.0 Request processed in 41us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872978.618511:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4073 00000100:00100000:1.0:1788872978.618595:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c738c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327884288:0@lo:400:kworker.0 00000100:00100000:1.0:1788872978.618647:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788872978.618654:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327884672:0@lo:400:kworker.0 00000100:00100000:1.0:1788872978.618733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872978.618771:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327884800:0@lo:400:kworker.0 00000100:00100000:1.0:1788872978.618797:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872978.618828:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327884800 00000100:00100000:1.0:1788872978.618831:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327884800 00000100:00100000:1.0:1788872978.618853:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6074 00000100:00100000:1.0:1788872978.618869:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3645:x1875765327884800:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788872978.618876:0:26188:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788872978.618914:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3645:x1875765327884800:12345-0@lo:400:kworker.0 Request processed in 43us (116us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788872978.618919:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6074 00000100:00080000:1.0:1788872978.618956:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788872978.618960:0:3645:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788872978.618964:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1788872978.618974:0:3645:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000100:00080000:1.0:1788872978.618977:0:3645:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872978.618981:0:3645:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3854 00000100:00080000:1.0:1788872978.618987:0:3645:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98a8c37f1000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:1.0:1788872978.619007:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9df456680 x1875765327884928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872978.619024:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327884800:0@lo:400:kworker.0 00000100:00100000:1.0:1788872978.619042:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327884928:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1788872978.619066:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872978.619094:0:26191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327884928 00000100:00100000:1.0:1788872978.619098:0:26191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327884928 00000100:00100000:1.0:1788872978.619118:0:26191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6075 00000100:00100000:1.0:1788872978.619122:0:26191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3643:x1875765327884928:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:1.0:1788872978.619141:0:26191:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872978.619171:0:26191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3643:x1875765327884928:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 47us (104us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872978.619178:0:26191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6075 00000100:00080000:1.0:1788872978.619211:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872978.619215:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872978.619706:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c738fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327884032:0@lo:400:kworker.0 00000100:00100000:3.0:1788872978.619735:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872978.619754:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327884544:0@lo:400:kworker.0 00000100:00100000:3.0:1788872978.619771:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872978.619788:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788872978.619793:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c738d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327883904:0@lo:400:kworker.0 00000100:00100000:3.0:1788872978.619826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872978.619845:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327884416:0@lo:400:kworker.0 00000100:00100000:3.0:1788872978.619860:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872978.619881:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327884544 00000100:00100000:3.0:1788872978.619884:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327884544 00000100:00100000:3.0:1788872978.619908:0:9961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327884416 00000100:00100000:3.0:1788872978.619910:0:9961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327884416 00000100:00100000:3.0:1788872978.619923:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782 00000100:00100000:3.0:1788872978.619928:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327884544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872978.619979:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327884544:12345-0@lo:400:kworker.0 Request processed in 50us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872978.619985:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782 00000100:00100000:3.0:1788872978.620000:0:9961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6076 00000100:00100000:3.0:1788872978.620004:0:9961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875765327884416:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788872978.620009:0:9961:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788872978.620033:0:9961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875765327884416:12345-0@lo:400:kworker.0 Request processed in 27us (171us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788872978.620038:0:9961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6076 00000100:00080000:3.0:1788872978.620067:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788872978.620071:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788872978.620074:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1788872978.620085:0:3647:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000100:00080000:3.0:1788872978.620099:0:3647:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872978.620103:0:3647:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2961 00000100:00080000:3.0:1788872978.620107:0:3647:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98a9e7bf8800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872978.620125:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f5c1d180 x1875765327885056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872978.620145:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327884416:0@lo:400:kworker.0 00000100:00100000:3.0:1788872978.620159:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327884544:0@lo:400:kworker.0 00000100:00100000:0.0:1788872978.621135:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327884160 00000100:00100000:0.0:1788872978.621143:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327884160 00000100:00100000:0.0:1788872978.621210:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327884672 00000100:00100000:0.0:1788872978.621214:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327884672 00000100:00100000:0.0:1788872978.621238:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327884032 00000100:00100000:0.0:1788872978.621240:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327884032 00000100:00100000:0.0:1788872978.621287:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:0.0:1788872978.621294:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c738e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327884160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872978.621381:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c738e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327884160:12345-0@lo:400:kworker.0 Request processed in 88us (3072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872978.621387:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:0.0:1788872978.621401:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519 00000100:00100000:0.0:1788872978.621406:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327884672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872978.621437:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875765327884672:12345-0@lo:400:kworker.0 Request processed in 31us (2704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872978.621448:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519 00000100:00100000:0.0:1788872978.621470:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1788872978.621476:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327884032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872978.621507:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765327884032:12345-0@lo:400:kworker.0 Request processed in 32us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872978.621512:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1788872978.621533:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327883904 00000100:00100000:0.0:1788872978.621535:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327883904 00000100:00100000:0.0:1788872978.621749:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788872978.621756:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3647:x1875765327883904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872978.621791:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3647:x1875765327883904:12345-0@lo:400:kworker.0 Request processed in 36us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872978.621796:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788872978.621938:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c738d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327883904:0@lo:400:kworker.0 00000100:00100000:0.0:1788872978.621963:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c738fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765327884032:0@lo:400:kworker.0 00000100:00100000:0.0:1788872978.622003:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875765327884672:0@lo:400:kworker.0 00000100:00100000:1.0:1788872978.622925:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327884928:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1788872978.623173:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327885056:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:1.0:1788872978.623226:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872978.623273:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327885056 00000100:00100000:1.0:1788872978.623290:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327885056 00000100:00100000:1.0:1788872978.623321:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6077 00000100:00100000:1.0:1788872978.623326:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3643:x1875765327885056:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:1.0:1788872978.623358:0:26185:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872978.623395:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3643:x1875765327885056:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 68us (170us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872978.623402:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6077 00000100:00080000:1.0:1788872978.623435:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872978.623440:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788872978.623443:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327885056:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:1.0:1788872978.623491:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788872978.623499:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327885184:0@lo:400:kworker.0 00000100:00100000:1.0:1788872978.623523:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872978.623569:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327885184 00000100:00100000:1.0:1788872978.623572:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327885184 00000100:00100000:1.0:1788872978.623624:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783 00000100:00100000:1.0:1788872978.623632:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327885184:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788872978.624127:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788872978.624133:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788872978.624136:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788872978.624614:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c738df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327884160:0@lo:400:kworker.0 00000100:00100000:3.0:1788872978.625429:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327885312:0@lo:400:kworker.0 00000100:00100000:3.0:1788872978.625494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872978.625588:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327885312 00000100:00100000:0.0:1788872978.625594:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327885312 00000100:00100000:0.0:1788872978.625638:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:0.0:1788872978.625647:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327885312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788872978.625711:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327885312:12345-0@lo:400:kworker.0 Request processed in 64us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872978.625717:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:1.0:1788872978.625911:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327885184:12345-0@lo:400:kworker.0 Request processed in 2279us (2385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872978.625936:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783 00000100:00100000:3.0:1788872978.626362:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327885312:0@lo:400:kworker.0 00000100:00100000:3.0:1788872978.626381:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327885184:0@lo:400:kworker.0 00010000:00010000:2.0:1788872978.750004:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872979.130025:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327885440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872979.130094:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872979.130156:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327885440 00000100:00100000:2.0:1788872979.130163:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327885440 00000100:00100000:2.0:1788872979.130208:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2249 00000100:00100000:2.0:1788872979.130216:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327885440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788872979.130249:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872979.130292:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327885440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872979.130299:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2249 00000100:00100000:2.0:1788872979.130363:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327885440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788872979.131736:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788872979.131753:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327885568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788872979.131801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872979.131910:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327885568 00000100:00100000:2.0:1788872979.131916:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327885568 00000100:00100000:2.0:1788872979.131952:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4074 00000100:00100000:2.0:1788872979.131960:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327885568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788872979.131988:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:2.0:1788872979.132099:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327885568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872979.132116:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4074 00000100:00100000:2.0:1788872979.132163:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327885568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788872979.217451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872979.217631:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872979.217668:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872979.217696:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311293184 00000100:00100000:2.0:1788872979.217706:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311293184 00000100:00100000:2.0:1788872979.217757:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 188 00000100:00100000:2.0:1788872979.217767:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311293184:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872979.217839:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311293184:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 73us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872979.217847:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 188 00000100:00100000:2.0:1788872979.217881:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311293312 00000100:00100000:2.0:1788872979.217885:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311293312 00000100:00100000:2.0:1788872979.217929:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311293440 00000100:00100000:2.0:1788872979.217932:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311293440 00000100:00100000:2.0:1788872979.217955:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1522 00000100:00100000:2.0:1788872979.217962:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+151:2407:x1875765311293312:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872979.217995:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+151:2407:x1875765311293312:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 34us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872979.218002:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1522 00000100:00100000:2.0:1788872979.218015:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1523 00000100:00100000:2.0:1788872979.218021:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2407:x1875765311293440:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788872979.218043:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2407:x1875765311293440:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 23us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872979.218063:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1523 00000100:00080000:2.0:1788872979.218085:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788872979.218089:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872979.218483:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872979.218574:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311293568 00000100:00100000:3.0:1788872979.218580:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311293568 00000100:00100000:0.0:1788872979.218603:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872979.218611:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311293696 00000100:00100000:3.0:1788872979.218616:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311293696 00000100:00100000:3.0:1788872979.218667:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2784 00000100:00100000:3.0:1788872979.218676:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2407:x1875765311293696:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788872979.218722:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2407:x1875765311293696:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 47us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872979.218729:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2784 00000100:00100000:3.0:1788872979.218743:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6078 00000100:00100000:3.0:1788872979.218747:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2406:x1875765311293568:12345-192.168.204.39@tcp:400:kworker.0 00000020:00080000:3.0:1788872979.218753:0:26192:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.39@tcp 00000100:00100000:3.0:1788872979.218777:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2406:x1875765311293568:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 29us (297us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788872979.218790:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6078 00000100:00080000:3.0:1788872979.218811:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872979.222535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872979.222919:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311293824 00000100:00100000:1.0:1788872979.222931:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311293824 00000100:00100000:1.0:1788872979.222993:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6079 00000100:00100000:1.0:1788872979.223004:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2403:x1875765311293824:12345-192.168.204.39@tcp:8:ptlrpcd_01_00.0 00010000:00020000:1.0:1788872979.223027:0:26182:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872979.223406:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2403:x1875765311293824:12345-192.168.204.39@tcp:8:ptlrpcd_01_00.0 Request processed in 401us (879us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872979.223414:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6079 00010000:00010000:1.0:1788872979.773415:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788872980.676750:0:94370:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051730 is committed 00010000:00010000:3.0:1788872980.678598:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc167 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678616:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc167 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678625:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc167 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678632:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.678637:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc167 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678646:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc167 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678667:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff98a9c1358200) 00010000:00010000:3.0:1788872980.678670:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.678674:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc167 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678681:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3600/0xe4e6e89fb01dc167 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678707:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc1a6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678713:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc1a6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678728:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc1a6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678734:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4499600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.678738:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc1a6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678756:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc1a6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678766:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff98a9f016a300) 00010000:00010000:3.0:1788872980.678769:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.678771:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc1a6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678777:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499600/0xe4e6e89fb01dc1a6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678794:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc1e5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678800:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc1e5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678805:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc1e5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678811:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4499200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.678814:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc1e5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678830:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc1e5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678840:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff98a9f016a800) 00010000:00010000:3.0:1788872980.678843:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.678847:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc1e5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678853:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499200/0xe4e6e89fb01dc1e5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678869:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01dc224 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678885:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01dc224 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678892:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01dc224 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678899:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3e00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.678902:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01dc224 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678909:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01dc224 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678916:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff98a9f016a700) 00010000:00010000:3.0:1788872980.678919:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.678922:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01dc224 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678937:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3e00/0xe4e6e89fb01dc224 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678978:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dc239 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678987:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dc239 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.678994:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dc239 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679000:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679003:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dc239 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679010:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dc239 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679018:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff98a9e1f8f400) 00010000:00010000:3.0:1788872980.679020:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679023:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dc239 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679030:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2c00/0xe4e6e89fb01dc239 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679041:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc271 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679047:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc271 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679058:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc271 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679063:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4499c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679067:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc271 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679079:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc271 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679087:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff98a9f016a000) 00010000:00010000:3.0:1788872980.679089:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679092:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc271 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679098:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4499c00/0xe4e6e89fb01dc271 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679110:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc2a9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679116:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc2a9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679122:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc2a9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679127:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679129:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc2a9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679143:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc2a9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679150:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff98a9f016ab00) 00010000:00010000:3.0:1788872980.679153:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679156:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc2a9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679162:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2400/0xe4e6e89fb01dc2a9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679182:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc2ef lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679189:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc2ef lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679196:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc2ef lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679201:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4498200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679204:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc2ef lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679210:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc2ef lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679218:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff98a9f016ad00) 00010000:00010000:3.0:1788872980.679220:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679223:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc2ef lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679238:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4498200/0xe4e6e89fb01dc2ef lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679256:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dc327 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679263:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dc327 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679269:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dc327 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679274:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9fa898a00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679278:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dc327 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679285:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dc327 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679294:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff98a9f016aa00) 00010000:00010000:3.0:1788872980.679308:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679312:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dc327 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679318:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9fa898a00/0xe4e6e89fb01dc327 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679335:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc36d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679342:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc36d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679355:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc36d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679361:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9efac4000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679365:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc36d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679372:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc36d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679383:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff98a9e1f8fb00) 00010000:00010000:3.0:1788872980.679386:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679389:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc36d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679396:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9efac4000/0xe4e6e89fb01dc36d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679414:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc3dd lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679421:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc3dd lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679428:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc3dd lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679434:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679437:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc3dd lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679453:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc3dd lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679461:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff98a9e1f8f100) 00010000:00010000:3.0:1788872980.679464:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679468:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc3dd lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679475:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2200/0xe4e6e89fb01dc3dd lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679491:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dc3e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679497:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dc3e4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679504:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dc3e4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679510:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c58af200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679514:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dc3e4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679520:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dc3e4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679527:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff98a9e1f8f600) 00010000:00010000:3.0:1788872980.679529:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679532:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dc3e4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679545:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c58af200/0xe4e6e89fb01dc3e4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679595:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839000/0xe4e6e89fb01dc438 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679602:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839000/0xe4e6e89fb01dc438 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679608:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839000/0xe4e6e89fb01dc438 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679614:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4839000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679617:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839000/0xe4e6e89fb01dc438 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679624:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839000/0xe4e6e89fb01dc438 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679633:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff98a9c5d04c00) 00010000:00010000:3.0:1788872980.679637:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679641:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839000/0xe4e6e89fb01dc438 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679647:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839000/0xe4e6e89fb01dc438 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679662:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc477 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679668:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc477 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679681:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc477 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679686:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4839c00 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679690:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc477 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679697:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc477 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679705:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff98a9c1358f00) 00010000:00010000:3.0:1788872980.679708:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679712:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc477 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679719:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839c00/0xe4e6e89fb01dc477 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679732:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc4a1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679738:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc4a1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679744:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc4a1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679750:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4839200 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679752:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc4a1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679766:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc4a1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679774:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff98a9c1358d00) 00010000:00010000:3.0:1788872980.679777:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679780:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc4a1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679786:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839200/0xe4e6e89fb01dc4a1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679799:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc4e7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679805:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc4e7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679811:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc4e7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679816:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d2000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679819:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc4e7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679825:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc4e7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679832:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff98a9f016ae00) 00010000:00010000:3.0:1788872980.679835:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679838:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc4e7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679852:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d2000/0xe4e6e89fb01dc4e7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679864:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc526 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679871:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc526 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679877:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc526 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679882:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3000 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679885:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc526 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679891:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc526 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679898:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff98a9f016a400) 00010000:00010000:3.0:1788872980.679901:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679904:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc526 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679910:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3000/0xe4e6e89fb01dc526 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679921:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc55e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679928:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc55e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679939:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc55e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679945:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9c56c9600 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.679948:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc55e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679955:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc55e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679963:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff98a9c5daa000) 00010000:00010000:3.0:1788872980.679965:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.679968:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc55e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679974:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9c56c9600/0xe4e6e89fb01dc55e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679986:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc5b2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679992:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc5b2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.679998:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc5b2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.680003:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a9df4d3800 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.680007:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc5b2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.680021:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc5b2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.680030:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff98a9faf66700) 00010000:00010000:3.0:1788872980.680032:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.680035:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc5b2 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.680042:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a9df4d3800/0xe4e6e89fb01dc5b2 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.680053:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc5b9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.680060:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc5b9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.680066:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc5b9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.680072:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4839400 already unused, calling callback (ffffffffc19d74f0) 00010000:00010000:3.0:1788872980.680075:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc5b9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.680081:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc5b9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.680089:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff98a9faf66000) 00010000:00010000:3.0:1788872980.680091:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788872980.680094:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc5b9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872980.680108:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98a8c4839400/0xe4e6e89fb01dc5b9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872980.792969:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872981.816972:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788872982.203368:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327885696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788872982.203457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872982.204511:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327885696 00000100:00100000:2.0:1788872982.204522:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327885696 00000100:00100000:2.0:1788872982.204646:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2250 00000100:00100000:2.0:1788872982.204657:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327885696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788872982.204692:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788872982.205150:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327885696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 493us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872982.205158:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2250 00000100:00100000:2.0:1788872982.205221:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327885696:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788872982.206818:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788872982.840816:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788872983.736969:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872983.736977:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788872983.736982:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872983.736993:0:30879:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3915 00000100:00080000:3.0:1788872983.737000:0:30879:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788872983.737009:0:30879:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98a9e7bf8800 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872983.737037:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f5c1c700 x1875765327886336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788872983.737134:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872983.737138:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788872983.737140:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872983.737144:0:30879:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3915 00000100:00080000:3.0:1788872983.737147:0:30879:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788872983.737151:0:30879:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98a8c37f1000 using connection 192.168.204.139@tcp/0@lo 00000100:00100000:3.0:1788872983.737163:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f4936680 x1875765327886848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872983.737208:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327885952:0@lo:400:kworker.0 00000100:00100000:3.0:1788872983.737289:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872983.737327:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327886592:0@lo:400:kworker.0 00000100:00100000:3.0:1788872983.737351:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872983.737386:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788872983.737393:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327886080:0@lo:400:kworker.0 00000100:00100000:3.0:1788872983.737415:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872983.737434:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327886720:0@lo:400:kworker.0 00000100:00100000:3.0:1788872983.737457:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872983.737488:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327886336:0@lo:8:kworker.0 00000100:00100000:3.0:1788872983.737513:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872983.737532:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327886848:0@lo:8:kworker.0 00000100:00100000:3.0:1788872983.737573:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872983.737604:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327885952 00000100:00100000:3.0:1788872983.737611:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327885952 00000100:00100000:3.0:1788872983.737665:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327886592 00000100:00100000:3.0:1788872983.737668:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327886592 00000100:00100000:3.0:1788872983.737687:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327886080 00000100:00100000:3.0:1788872983.737690:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327886080 00000100:00100000:3.0:1788872983.737715:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:3.0:1788872983.737723:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327885952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872983.737775:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327885952:12345-0@lo:400:kworker.0 Request processed in 52us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872983.737783:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:3.0:1788872983.737801:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:3.0:1788872983.737807:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327886592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872983.737836:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327886592:12345-0@lo:400:kworker.0 Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872983.737843:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:3.0:1788872983.737854:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:3.0:1788872983.737861:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327886080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872983.737896:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327886080:12345-0@lo:400:kworker.0 Request processed in 36us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872983.737902:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00100000:3.0:1788872983.737927:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327886336 00000100:00100000:3.0:1788872983.737931:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327886336 00000100:00100000:3.0:1788872983.737946:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327886848 00000100:00100000:3.0:1788872983.737948:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327886848 00000100:00100000:3.0:1788872983.737963:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6080 00000100:00100000:3.0:1788872983.737968:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875765327886336:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788872983.737988:0:8437:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872983.738028:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875765327886336:12345-0@lo:8:kworker.0 Request processed in 59us (514us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872983.738035:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6080 00000100:00100000:3.0:1788872983.738047:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6081 00000100:00100000:3.0:1788872983.738050:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875765327886848:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788872983.738059:0:8437:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788872983.738082:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1875765327886848:12345-0@lo:8:kworker.0 Request processed in 30us (509us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872983.738087:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6081 00000100:00080000:3.0:1788872983.738130:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872983.738136:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872983.738139:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327886336:0@lo:8:kworker.0 00000100:00080000:3.0:1788872983.738146:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872983.738148:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788872983.738151:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327886848:0@lo:8:kworker.0 00000100:00100000:3.0:1788872983.738190:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327886080:0@lo:400:kworker.0 00000100:00100000:3.0:1788872983.738199:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327885952:0@lo:400:kworker.0 00000100:00100000:3.0:1788872983.738207:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327886592:0@lo:400:kworker.0 00000100:00100000:0.0:1788872983.741756:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327885824:0@lo:400:kworker.0 00000100:00100000:0.0:1788872983.741874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872983.742093:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327886464:0@lo:400:kworker.0 00000100:00100000:0.0:1788872983.742126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872983.742157:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327887104:0@lo:400:kworker.0 00000100:00100000:0.0:1788872983.742184:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872983.742214:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788872983.742222:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327886208:0@lo:400:kworker.0 00000100:00100000:0.0:1788872983.742259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788872983.742330:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327886976:0@lo:400:kworker.0 00000100:00100000:0.0:1788872983.742355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788872983.742389:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872983.742395:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788872983.742409:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327886464 00000100:00100000:0.0:1788872983.742417:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327886464 00000100:00100000:0.0:1788872983.742461:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327886976 00000100:00100000:0.0:1788872983.742464:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327886976 00000100:00100000:0.0:1788872983.742495:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785 00000100:00100000:0.0:1788872983.742503:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327886464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872983.742755:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327886720 00000100:00100000:1.0:1788872983.742760:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327886720 00000100:00100000:1.0:1788872983.742791:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327886208 00000100:00100000:1.0:1788872983.742794:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327886208 00000100:00100000:1.0:1788872983.742825:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4075 00000100:00100000:1.0:1788872983.742833:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327886720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872983.742879:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327886720:12345-0@lo:400:kworker.0 Request processed in 46us (5420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872983.742886:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4075 00000100:00100000:1.0:1788872983.742903:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4076 00000100:00100000:1.0:1788872983.744850:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327886208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872983.745024:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327886208:12345-0@lo:400:kworker.0 Request processed in 190us (2762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872983.745032:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4076 00000100:00100000:1.0:1788872983.745086:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786 00000100:00100000:1.0:1788872983.745095:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327886976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872983.745130:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327886976:12345-0@lo:400:kworker.0 Request processed in 38us (2774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872983.745137:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786 00000100:00100000:0.0:1788872983.746575:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327886464:12345-0@lo:400:kworker.0 Request processed in 83us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872983.746597:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785 00000100:00080000:0.0:1788872983.746648:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788872983.746810:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327885824 00000100:00100000:3.0:1788872983.746830:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327885824 00000100:00100000:3.0:1788872983.746875:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788872983.746883:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3647:x1875765327885824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788872983.747065:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3647:x1875765327885824:12345-0@lo:400:kworker.0 Request processed in 183us (5190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872983.747071:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788872983.747103:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788872983.747117:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327887232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788872983.747149:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872983.747199:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327886720:0@lo:400:kworker.0 00000100:00100000:3.0:1788872983.747224:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327887232 00000100:00100000:3.0:1788872983.747227:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327887232 00000100:00100000:3.0:1788872983.747264:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4077 00000100:00100000:3.0:1788872983.747271:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327887232:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788872983.748132:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327886208:0@lo:400:kworker.0 00000100:00100000:0.0:1788872983.748155:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327886976:0@lo:400:kworker.0 00000100:00100000:0.0:1788872983.748163:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327885824:0@lo:400:kworker.0 00000100:00100000:0.0:1788872983.748174:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327886464:0@lo:400:kworker.0 00000100:00100000:1.0:1788872983.748357:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327887104 00000100:00100000:1.0:1788872983.748363:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327887104 00000100:00100000:1.0:1788872983.748411:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:1.0:1788872983.748418:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327887104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788872983.748474:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327887104:12345-0@lo:400:kworker.0 Request processed in 57us (6290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872983.748480:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:1.0:1788872983.748510:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327887104:0@lo:400:kworker.0 00000004:00000024:3.0:1788872983.748805:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:3.0:1788872983.748844:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327887232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1573us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872983.748850:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4077 00000100:00100000:1.0:1788872983.749192:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327887232:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788872983.864659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788872984.250762:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327887360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788872984.251090:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872984.251241:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327887488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788872984.251274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872984.255218:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327887360 00000100:00100000:1.0:1788872984.255245:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327887360 00000100:00100000:1.0:1788872984.255310:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251 00000100:00100000:1.0:1788872984.255320:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327887360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872984.255364:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788872984.255449:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327887360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (4360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872984.255467:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251 00000100:00100000:1.0:1788872984.255529:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327887360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788872984.260139:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327887488 00000100:00100000:3.0:1788872984.260158:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327887488 00000100:00100000:3.0:1788872984.260259:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4078 00000100:00100000:3.0:1788872984.260270:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327887488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872984.260316:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:3.0:1788872984.260415:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327887488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (9139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872984.260422:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4078 00000100:00100000:3.0:1788872984.260503:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327887488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788872984.333101:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872984.334144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872984.334182:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872984.334203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872984.334224:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872984.337523:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311293952 00000100:00100000:0.0:1788872984.337540:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311293952 00000100:00100000:0.0:1788872984.337619:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 190 00000100:00100000:0.0:1788872984.337630:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311293952:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872984.338285:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311293952:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 654us (4141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872984.338295:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 190 00000100:00100000:3.0:1788872984.338412:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311294464 00000100:00100000:3.0:1788872984.338418:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311294464 00000100:00100000:0.0:1788872984.338442:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311294208 00000100:00100000:0.0:1788872984.338448:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311294208 00000100:00100000:3.0:1788872984.338474:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2787 00000100:00100000:3.0:1788872984.338484:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311294464:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872984.338490:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311294080 00000100:00100000:0.0:1788872984.338494:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311294080 00000100:00100000:3.0:1788872984.338520:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311294464:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 39us (4294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872984.338526:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1528 00000100:00100000:3.0:1788872984.338534:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2787 00000100:00100000:0.0:1788872984.338539:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2404:x1875765311294208:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872984.338596:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2404:x1875765311294208:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 59us (4411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872984.338618:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1528 00000100:00100000:0.0:1788872984.338636:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1529 00000100:00100000:0.0:1788872984.338644:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2404:x1875765311294080:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788872984.338671:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2404:x1875765311294080:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 29us (4466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872984.338677:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1529 00000100:00080000:0.0:1788872984.338702:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788872984.338707:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788872984.338710:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788872984.338789:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311294336 00000100:00100000:1.0:1788872984.338795:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311294336 00000100:00100000:1.0:1788872984.338829:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6082 00000100:00100000:1.0:1788872984.338834:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2403:x1875765311294336:12345-192.168.204.39@tcp:8:kworker.0 00010000:00020000:1.0:1788872984.338858:0:14545:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788872984.338901:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2403:x1875765311294336:12345-192.168.204.39@tcp:8:kworker.0 Request processed in 65us (5812us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872984.338908:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6082 00010000:00010000:3.0:1788872984.890765:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872985.919751:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788872986.350476:0:96352:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00010000:00010000:3.0:1788872986.936886:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788872987.320726:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788872987.320752:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327887616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788872987.320880:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788872987.321023:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327887616 00000100:00100000:3.0:1788872987.321032:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327887616 00000100:00100000:3.0:1788872987.321147:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252 00000100:00100000:3.0:1788872987.321157:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327887616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872987.321193:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788872987.321238:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327887616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872987.321245:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252 00000100:00100000:2.0:1788872987.321817:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327887616:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788872987.322095:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788872987.961186:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1788872988.857198:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872988.857277:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000100:00000040:3.0:1788872988.857320:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS req@ffff98a9f4934000 x1875765327887744/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872988.857341:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000361c0605] to pc [ptlrpcd_00_00+0] req@ffff98a9f4934000 x1875765327887744/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.857373:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872988.857380:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9efadc000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1788872988.857388:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff98a9f4936300 x1875765327887872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872988.857399:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009e0e41bd] to pc [ptlrpcd_00_01+1] req@ffff98a9f4936300 x1875765327887872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.857408:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872988.857413:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a8c2644800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1788872988.857421:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff98a9f4935f80 x1875765327888000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872988.857431:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000062e6ac85] to pc [ptlrpcd_00_02+2] req@ffff98a9f4935f80 x1875765327888000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.857452:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872988.857458:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9df8c9800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1788872988.857465:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff98a9f4936d80 x1875765327888128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872988.857475:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000032269c55] to pc [ptlrpcd_00_03+3] req@ffff98a9f4936d80 x1875765327888128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872988.857483:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872988.857487:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788872988.857496:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872988.857503:0:30879:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3920 00000100:00080000:3.0:1788872988.857510:0:30879:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00000040:3.0:1788872988.857513:0:30879:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 50 to 0@lo 00000100:00000040:3.0:1788872988.857516:0:30879:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000020:00000040:3.0:1788872988.857519:0:30879:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d5518 00000020:00000040:3.0:1788872988.857524:0:30879:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c5646000 refcount=4 00000100:00000040:3.0:1788872988.857528:0:30879:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 50 to 0@lo 00000100:00000040:3.0:1788872988.857530:0:30879:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000020:00000040:3.0:1788872988.857533:0:30879:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c5646000 : new refcount 3 00000100:00080000:3.0:1788872988.857537:0:30879:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98a9e7bf8800 using connection 192.168.204.139@tcp/0@lo 00000020:00000040:3.0:1788872988.857566:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9e7bf8800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1788872988.857579:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f4937480 x1875765327888256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872988.857589:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e3ce665e] to pc [ptlrpcd_rcv+-1] req@ffff98a9f4937480 x1875765327888256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.857603:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872988.857608:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9dfe90800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1788872988.857614:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff98a9f4934e00 x1875765327888384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872988.857637:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000aa0521e] to pc [ptlrpcd_00_00+0] req@ffff98a9f4934e00 x1875765327888384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.857645:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872988.857650:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9dfe96800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1788872988.857657:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff98a9f4935880 x1875765327888512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872988.857678:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000fc87e109] to pc [ptlrpcd_00_01+1] req@ffff98a9f4935880 x1875765327888512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.857687:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872988.857692:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a8c9e82800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1788872988.857699:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff98a9f4934700 x1875765327888640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872988.857707:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a0fbc1fe] to pc [ptlrpcd_00_02+2] req@ffff98a9f4934700 x1875765327888640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872988.857715:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872988.857718:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788872988.857720:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872988.857725:0:30879:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3920 00000100:00080000:3.0:1788872988.857728:0:30879:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:3.0:1788872988.857730:0:30879:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 50 to 0@lo 00000100:00000040:3.0:1788872988.857733:0:30879:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000020:00000040:3.0:1788872988.857735:0:30879:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6cb 00000020:00000040:3.0:1788872988.857738:0:30879:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ef0af000 refcount=4 00000100:00000040:3.0:1788872988.857741:0:30879:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 50 to 0@lo 00000100:00000040:3.0:1788872988.857743:0:30879:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000020:00000040:3.0:1788872988.857746:0:30879:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ef0af000 : new refcount 3 00000100:00080000:3.0:1788872988.857748:0:30879:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98a8c37f1000 using connection 192.168.204.139@tcp/0@lo 00000020:00000040:3.0:1788872988.857754:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a8c37f1000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1788872988.857763:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f4935c00 x1875765327888768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872988.857772:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007a614721] to pc [ptlrpcd_rcv+-1] req@ffff98a9f4935c00 x1875765327888768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.857786:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872988.857791:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9e021b000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1788872988.857798:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff98a9f4934380 x1875765327888896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872988.857808:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b833aeb6] to pc [ptlrpcd_00_03+3] req@ffff98a9f4934380 x1875765327888896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.857816:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872988.857822:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a8ca9bc000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1788872988.857829:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff98a9f4934a80 x1875765327889024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872988.857838:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001d35666a] to pc [ptlrpcd_00_00+0] req@ffff98a9f4934a80 x1875765327889024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.857849:0:30879:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3930) 00000100:00000040:3.0:1788872988.857873:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4935f80 x1875765327888000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.857886:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327888000:0@lo:400:kworker.0 00000100:00000040:3.0:1788872988.857919:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4935f80 x1875765327888000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.857929:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872988.857977:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1e680 x1875765327888000 msgsize 224 00000100:00100000:3.0:1788872988.857983:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872988.858005:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4935f80 x1875765327888000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858033:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8791 usecs (9 jiffies) 00000100:00000040:3.0:1788872988.858048:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4934700 x1875765327888640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.858057:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327888640:0@lo:400:kworker.0 00000100:00000040:3.0:1788872988.858071:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4934700 x1875765327888640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858078:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872988.858119:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1f100 x1875765327888640 msgsize 224 00000100:00100000:3.0:1788872988.858124:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872988.858150:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4934700 x1875765327888640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858161:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5387 usecs (6 jiffies) 00000100:00100000:3.0:1788872988.858174:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:3.0:1788872988.858179:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4936d80 x1875765327888128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.858188:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327888128:0@lo:400:kworker.0 00000100:00000040:3.0:1788872988.858201:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4936d80 x1875765327888128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858208:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872988.858220:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1ca80 x1875765327888128 msgsize 224 00000100:00100000:3.0:1788872988.858224:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872988.858237:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4936d80 x1875765327888128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858247:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1555241 usecs (1556 jiffies) 00000100:00000040:3.0:1788872988.858252:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4934380 x1875765327888896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.858261:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327888896:0@lo:400:kworker.0 00000100:00000040:3.0:1788872988.858272:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4934380 x1875765327888896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858284:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872988.858299:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1f800 x1875765327888896 msgsize 224 00000100:00100000:3.0:1788872988.858303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872988.858315:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4934380 x1875765327888896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858324:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6216 usecs (7 jiffies) 00000100:00000040:3.0:1788872988.858347:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4937480 x1875765327888256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.858356:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327888256:0@lo:8:kworker.0 00000100:00000040:3.0:1788872988.858370:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4937480 x1875765327888256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873008 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858377:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872988.858389:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1d180 x1875765327888256 msgsize 520 00000100:00100000:3.0:1788872988.858393:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872988.858403:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4937480 x1875765327888256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873008 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858412:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 6673 usecs (7 jiffies) 00000100:00000040:3.0:1788872988.858418:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4935c00 x1875765327888768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.858427:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327888768:0@lo:8:kworker.0 00000100:00000040:3.0:1788872988.858438:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4935c00 x1875765327888768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873008 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858445:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872988.858455:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1d880 x1875765327888768 msgsize 520 00000100:00100000:3.0:1788872988.858459:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872988.858470:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4935c00 x1875765327888768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873008 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858491:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8432 usecs (9 jiffies) 00000100:00100000:3.0:1788872988.858514:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327888640 00000100:00100000:3.0:1788872988.858522:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327888640 00000020:00000040:3.0:1788872988.858524:0:8447:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6b6 00000020:00000040:3.0:1788872988.858527:0:8447:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ff63e800 refcount=5 00000100:00000040:3.0:1788872988.858585:0:8447:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1788872988.858607:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327888128 00000100:00100000:3.0:1788872988.858610:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327888128 00000020:00000040:3.0:1788872988.858612:0:8447:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db67e 00000020:00000040:3.0:1788872988.858615:0:8447:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9cb5ec800 refcount=7 00000100:00100000:3.0:1788872988.858637:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4079 00000100:00000040:3.0:1788872988.858641:0:8447:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9ff63e800 : new rpc_count 1 00000100:00000040:3.0:1788872988.858646:0:8447:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1f100 x1875765327888640/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:159/0 lens 224/0 e 0 to 0 dl 1788872999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.858656:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327888640:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788872988.858679:0:8447:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327888640 00000100:00000040:3.0:1788872988.858687:0:8447:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872988.858692:0:8447:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872988.858709:0:8447:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4934700 x1875765327888640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858728:0:8447:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:3.0:1788872988.858732:0:8447:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1f100 x1875765327888640/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:159/0 lens 224/224 e 0 to 0 dl 1788872999 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.858739:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327888640:12345-0@lo:400:kworker.0 Request processed in 84us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872988.858745:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4079 00000100:00000040:3.0:1788872988.858748:0:8447:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9ff63e800 : new rpc_count 0 00000020:00000040:3.0:1788872988.858757:0:8447:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ff63e800 : new refcount 4 00000100:00100000:3.0:1788872988.858772:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4080 00000100:00000040:3.0:1788872988.858775:0:8447:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9cb5ec800 : new rpc_count 1 00000100:00000040:3.0:1788872988.858779:0:8447:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1ca80 x1875765327888128/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:159/0 lens 224/0 e 0 to 0 dl 1788872999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.858789:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327888128:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788872988.858799:0:8447:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1875765327888128 00000100:00000040:3.0:1788872988.858803:0:8447:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872988.858806:0:8447:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872988.858823:0:8447:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4936d80 x1875765327888128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.858835:0:8447:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:3.0:1788872988.858839:0:8447:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1ca80 x1875765327888128/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:159/0 lens 224/224 e 0 to 0 dl 1788872999 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.858845:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327888128:12345-0@lo:400:kworker.0 Request processed in 58us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872988.858851:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4080 00000100:00000040:3.0:1788872988.858853:0:8447:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9cb5ec800 : new rpc_count 0 00000020:00000040:3.0:1788872988.858858:0:8447:0:(genops.c:900:class_export_put()) PUTting export ffff98a9cb5ec800 : new refcount 6 00000100:00100000:3.0:1788872988.858878:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327888896 00000100:00100000:3.0:1788872988.858881:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327888896 00000020:00000040:3.0:1788872988.858883:0:26192:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6ee 00000020:00000040:3.0:1788872988.858885:0:26192:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9dfe94000 refcount=5 00000020:00000040:3.0:1788872988.858896:0:26192:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:3.0:1788872988.858908:0:26192:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1788872988.858922:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327888256 00000100:00100000:3.0:1788872988.858926:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327888256 00000020:00000040:3.0:1788872988.858927:0:26192:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d552d 00000100:00100000:3.0:1788872988.858940:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327888768 00000100:00100000:3.0:1788872988.858942:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327888768 00000020:00000040:3.0:1788872988.858949:0:26192:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6e0 00000100:00100000:3.0:1788872988.858968:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00000040:3.0:1788872988.858971:0:26192:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9dfe94000 : new rpc_count 1 00000100:00000040:3.0:1788872988.858975:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1f800 x1875765327888896/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:159/0 lens 224/0 e 0 to 0 dl 1788872999 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.858985:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327888896:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788872988.858996:0:26192:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875765327888896 00000100:00000040:3.0:1788872988.859001:0:26192:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872988.859004:0:26192:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872988.859039:0:26192:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4934380 x1875765327888896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.859051:0:26192:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:3.0:1788872988.859055:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1f800 x1875765327888896/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:159/0 lens 224/224 e 0 to 0 dl 1788872999 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.859062:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327888896:12345-0@lo:400:kworker.0 Request processed in 79us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872988.859226:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00000100:00000040:3.0:1788872988.859229:0:26192:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9dfe94000 : new rpc_count 0 00000020:00000040:3.0:1788872988.859236:0:26192:0:(genops.c:900:class_export_put()) PUTting export ffff98a9dfe94000 : new refcount 4 00000100:00100000:3.0:1788872988.859246:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6083 00000100:00000040:3.0:1788872988.859251:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1d180 x1875765327888256/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788873008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.859259:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3643:x1875765327888256:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788872988.859279:0:26192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1788872988.859289:0:26192:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872988.859292:0:26192:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872988.859301:0:26192:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872988.859316:0:26192:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff98a9f4937480 x1875765327888256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873008 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.859334:0:26192:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:3.0:1788872988.859338:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1d180 x1875765327888256/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788873008 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.859346:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3643:x1875765327888256:12345-0@lo:8:kworker.0 Request processed in 87us (956us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872988.859352:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6083 00000100:00100000:3.0:1788872988.859363:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6084 00000100:00000040:3.0:1788872988.859367:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1d880 x1875765327888768/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788873008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.859375:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3643:x1875765327888768:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788872988.859385:0:26192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1788872988.859392:0:26192:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872988.859395:0:26192:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872988.859398:0:26192:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872988.859411:0:26192:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff98a9f4935c00 x1875765327888768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873008 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.859424:0:26192:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:3.0:1788872988.859428:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1d880 x1875765327888768/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788873008 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.859436:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3643:x1875765327888768:12345-0@lo:8:kworker.0 Request processed in 60us (979us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872988.859442:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6084 00000100:00000040:3.0:1788872988.859477:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00000040:3.0:1788872988.859484:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4936d80 x1875765327888128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.859500:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4936d80 x1875765327888128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.859509:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327888128:0@lo:400:kworker.0 00000100:00000040:3.0:1788872988.859522:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:3.0:1788872988.859527:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4934380 x1875765327888896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.859535:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934380 x1875765327888896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.859543:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327888896:0@lo:400:kworker.0 00000100:00000040:3.0:1788872988.859571:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1788872988.859575:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4934700 x1875765327888640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.859583:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934700 x1875765327888640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.859590:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327888640:0@lo:400:kworker.0 00000100:00000040:3.0:1788872988.859596:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4936d80 x1875765327888128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872988.859605:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a9df8c9800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1788872988.859615:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4934380 x1875765327888896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872988.859623:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a9e021b000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1788872988.859627:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4934700 x1875765327888640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872988.859644:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a8c9e82800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1788872988.859674:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4937480 x1875765327888256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873008 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872988.859685:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872988.859689:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1788872988.859693:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4937480 x1875765327888256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873008 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.859701:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327888256:0@lo:8:kworker.0 00000100:00000040:3.0:1788872988.859709:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4935c00 x1875765327888768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873008 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872988.859716:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788872988.859719:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1788872988.859723:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4935c00 x1875765327888768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873008 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.859730:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327888768:0@lo:8:kworker.0 00000100:00000040:3.0:1788872988.859735:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4937480 x1875765327888256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873008 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872988.859743:0:3643:0:(genops.c:1244:class_import_put()) import ffff98a9e7bf8800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1788872988.859747:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4935c00 x1875765327888768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873008 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872988.859754:0:3643:0:(genops.c:1244:class_import_put()) import ffff98a8c37f1000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788872988.860411:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4934000 x1875765327887744/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.860424:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327887744:0@lo:400:kworker.0 00000100:00000040:1.0:1788872988.860448:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4934000 x1875765327887744/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.860455:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872988.860480:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c3865850 x1875765327887744 msgsize 224 00000100:00100000:1.0:1788872988.860484:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872988.860486:0:3644:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788872988.860508:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4934000 x1875765327887744/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.860543:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4934e00 x1875765327888384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.860577:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327888384:0@lo:400:kworker.0 00000100:00000040:1.0:1788872988.860608:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4934e00 x1875765327888384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.860615:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872988.860645:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df455880 x1875765327888384 msgsize 224 00000100:00100000:1.0:1788872988.860649:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872988.860665:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4934e00 x1875765327888384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.860675:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 7115 usecs (8 jiffies) 00000100:00000040:1.0:1788872988.860682:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4934a80 x1875765327889024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.860689:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327889024:0@lo:400:kworker.0 00000100:00000040:1.0:1788872988.860701:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4934a80 x1875765327889024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.860708:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872988.860719:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df454380 x1875765327889024 msgsize 224 00000100:00100000:1.0:1788872988.860722:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872988.860734:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4934a80 x1875765327889024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.860742:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8933 usecs (9 jiffies) 00000100:00100000:1.0:1788872988.860752:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:1.0:1788872988.860757:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4936300 x1875765327887872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.860766:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327887872:0@lo:400:kworker.0 00000100:00000040:1.0:1788872988.860777:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4936300 x1875765327887872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.860793:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872988.860804:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df455500 x1875765327887872 msgsize 224 00000100:00100000:1.0:1788872988.860807:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872988.860822:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4936300 x1875765327887872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.860831:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8833 usecs (9 jiffies) 00000100:00000040:1.0:1788872988.860837:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4935880 x1875765327888512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.860845:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327888512:0@lo:400:kworker.0 00000100:00000040:1.0:1788872988.860871:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4935880 x1875765327888512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.860877:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872988.860890:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df457b80 x1875765327888512 msgsize 224 00000100:00100000:1.0:1788872988.860893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872988.860905:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4935880 x1875765327888512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.860914:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 131335 usecs (132 jiffies) 00000100:00100000:1.0:1788872988.860937:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327888000 00000100:00100000:1.0:1788872988.860942:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327888000 00000020:00000040:1.0:1788872988.860945:0:68674:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d55b9 00000020:00000040:1.0:1788872988.860948:0:68674:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c37f4800 refcount=5 00000020:00000040:1.0:1788872988.860959:0:68674:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff98a9f9df99c0) now 10 - evictor 00000100:00000040:1.0:1788872988.860973:0:68674:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1788872988.860993:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327889024 00000100:00100000:1.0:1788872988.860996:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327889024 00000020:00000040:1.0:1788872988.860998:0:68674:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db814 00000020:00000040:1.0:1788872988.861001:0:68674:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9df96b800 refcount=5 00000100:00100000:1.0:1788872988.861031:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327887872 00000100:00100000:1.0:1788872988.861035:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327887872 00000020:00000040:1.0:1788872988.861043:0:68674:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db806 00000020:00000040:1.0:1788872988.861045:0:68674:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9f0834000 refcount=5 00000020:00000040:1.0:1788872988.861052:0:68674:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff98a9e99999c0) now 14 - evictor 00000100:00100000:1.0:1788872988.861065:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327888512 00000100:00100000:1.0:1788872988.861068:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327888512 00000020:00000040:1.0:1788872988.861069:0:68674:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db80d 00000020:00000040:1.0:1788872988.861071:0:68674:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9f0835000 refcount=5 00000100:00100000:1.0:1788872988.861085:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00000040:1.0:1788872988.861089:0:68674:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c37f4800 : new rpc_count 1 00000100:00000040:1.0:1788872988.861093:0:68674:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1e680 x1875765327888000/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:159/0 lens 224/0 e 0 to 0 dl 1788872999 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.861103:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327888000:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788872988.861305:0:68674:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327888000 00000100:00000040:1.0:1788872988.861314:0:68674:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872988.861318:0:68674:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872988.861338:0:68674:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4935f80 x1875765327888000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.861359:0:68674:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872988.861363:0:68674:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1e680 x1875765327888000/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:159/0 lens 224/224 e 0 to 0 dl 1788872999 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.861372:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327888000:12345-0@lo:400:kworker.0 Request processed in 270us (3392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872988.861379:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00000040:1.0:1788872988.861382:0:68674:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c37f4800 : new rpc_count 0 00000020:00000040:1.0:1788872988.861390:0:68674:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c37f4800 : new refcount 4 00000100:00100000:1.0:1788872988.861399:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00000040:1.0:1788872988.861401:0:68674:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9df96b800 : new rpc_count 1 00000100:00000040:1.0:1788872988.861405:0:68674:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df454380 x1875765327889024/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:159/0 lens 224/0 e 0 to 0 dl 1788872999 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.861421:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327889024:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788872988.861432:0:68674:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327889024 00000100:00000040:1.0:1788872988.861436:0:68674:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872988.861439:0:68674:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872988.861453:0:68674:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4934a80 x1875765327889024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.861469:0:68674:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872988.861474:0:68674:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df454380 x1875765327889024/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:159/0 lens 224/224 e 0 to 0 dl 1788872999 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.861482:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327889024:12345-0@lo:400:kworker.0 Request processed in 63us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872988.861488:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00000040:1.0:1788872988.861490:0:68674:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9df96b800 : new rpc_count 0 00000020:00000040:1.0:1788872988.861496:0:68674:0:(genops.c:900:class_export_put()) PUTting export ffff98a9df96b800 : new refcount 4 00000100:00100000:1.0:1788872988.861505:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00000040:1.0:1788872988.861508:0:68674:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9f0834000 : new rpc_count 1 00000100:00000040:1.0:1788872988.861511:0:68674:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df455500 x1875765327887872/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:159/0 lens 224/0 e 0 to 0 dl 1788872999 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.861521:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327887872:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788872988.861530:0:68674:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327887872 00000100:00000040:1.0:1788872988.861534:0:68674:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872988.861537:0:68674:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872988.861571:0:68674:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4936300 x1875765327887872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.861584:0:68674:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872988.861595:0:68674:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df455500 x1875765327887872/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:159/0 lens 224/224 e 0 to 0 dl 1788872999 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.861602:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327887872:12345-0@lo:400:kworker.0 Request processed in 84us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872988.861608:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00000040:1.0:1788872988.861610:0:68674:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9f0834000 : new rpc_count 0 00000020:00000040:1.0:1788872988.861615:0:68674:0:(genops.c:900:class_export_put()) PUTting export ffff98a9f0834000 : new refcount 4 00000100:00100000:1.0:1788872988.861783:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00000040:1.0:1788872988.861787:0:68674:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9f0835000 : new rpc_count 1 00000100:00000040:1.0:1788872988.861791:0:68674:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df457b80 x1875765327888512/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:159/0 lens 224/0 e 0 to 0 dl 1788872999 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.861802:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327888512:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788872988.861811:0:68674:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327888512 00000100:00000040:1.0:1788872988.861816:0:68674:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872988.861819:0:68674:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872988.861834:0:68674:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4935880 x1875765327888512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.861845:0:68674:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872988.861849:0:68674:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df457b80 x1875765327888512/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:159/0 lens 224/224 e 0 to 0 dl 1788872999 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.861855:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327888512:12345-0@lo:400:kworker.0 Request processed in 56us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872988.861860:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00000040:1.0:1788872988.861863:0:68674:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9f0835000 : new rpc_count 0 00000020:00000040:1.0:1788872988.861868:0:68674:0:(genops.c:900:class_export_put()) PUTting export ffff98a9f0835000 : new refcount 4 00000100:00100000:1.0:1788872988.861888:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327888384 00000100:00100000:1.0:1788872988.861892:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327888384 00000020:00000040:1.0:1788872988.861901:0:26196:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d553b 00000020:00000040:1.0:1788872988.861904:0:26196:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c45cb000 refcount=5 00000100:00000040:1.0:1788872988.861917:0:26196:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1788872988.861934:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00000040:1.0:1788872988.861936:0:26196:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9c45cb000 : new rpc_count 1 00000100:00000040:1.0:1788872988.861941:0:26196:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df455880 x1875765327888384/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:159/0 lens 224/0 e 0 to 0 dl 1788872999 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.861952:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327888384:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788872988.861961:0:26196:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875765327888384 00000100:00000040:1.0:1788872988.861965:0:26196:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872988.861968:0:26196:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872988.861983:0:26196:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4934e00 x1875765327888384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.861996:0:26196:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872988.862000:0:26196:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df455880 x1875765327888384/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:159/0 lens 224/224 e 0 to 0 dl 1788872999 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.862533:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327888384:12345-0@lo:400:kworker.0 Request processed in 58us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872988.862545:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000100:00000040:1.0:1788872988.862570:0:26196:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9c45cb000 : new rpc_count 0 00000020:00000040:1.0:1788872988.862578:0:26196:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c45cb000 : new refcount 4 00000100:00080000:1.0:1788872988.862604:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1788872988.862608:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff98a9e99999c0) now 14 - evictor 00000100:00080000:1.0:1788872988.862611:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1788872988.862613:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff98a9f9df99c0) now 10 - evictor 00000100:00080000:1.0:1788872988.862616:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1788872988.862619:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00100000:1.0:1788872988.862630:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327887744 00000100:00100000:1.0:1788872988.862635:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327887744 00000020:00000040:1.0:1788872988.862645:0:94377:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:1.0:1788872988.862647:0:94377:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=21 00000100:00000040:1.0:1788872988.862660:0:94377:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788872988.862679:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00000040:1.0:1788872988.862681:0:94377:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:1.0:1788872988.862685:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c3865850 x1875765327887744/t0(0) o400->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:159/0 lens 224/0 e 0 to 0 dl 1788872999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.862697:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c3865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3644:x1875765327887744:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788872988.862706:0:94377:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327887744 00000100:00000040:1.0:1788872988.862710:0:94377:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872988.862714:0:94377:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872988.862734:0:94377:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4934000 x1875765327887744/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.862747:0:94377:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872988.862751:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c3865850 x1875765327887744/t0(0) o400->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:159/0 lens 224/224 e 0 to 0 dl 1788872999 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.862759:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c3865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3644:x1875765327887744:12345-0@lo:400:kworker.0 Request processed in 65us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872988.862764:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00000040:1.0:1788872988.862767:0:94377:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:1.0:1788872988.862772:0:94377:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 20 00000100:00000040:1.0:1788872988.862834:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788872988.862841:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4935f80 x1875765327888000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.862852:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4935f80 x1875765327888000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.862860:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327888000:0@lo:400:kworker.0 00000100:00000040:1.0:1788872988.862873:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4935f80 x1875765327888000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872988.862883:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a8c2644800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1788872988.862919:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788872988.862924:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4936300 x1875765327887872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.862932:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4936300 x1875765327887872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.862938:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327887872:0@lo:400:kworker.0 00000100:00000040:1.0:1788872988.862948:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788872988.862953:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4935880 x1875765327888512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.862959:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4935880 x1875765327888512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.862965:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327888512:0@lo:400:kworker.0 00000100:00000040:1.0:1788872988.862974:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4934000 x1875765327887744/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.862980:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934000 x1875765327887744/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.862986:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327887744:0@lo:400:kworker.0 00000100:00000040:1.0:1788872988.862996:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:1.0:1788872988.863001:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4934e00 x1875765327888384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.863020:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934e00 x1875765327888384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.863027:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327888384:0@lo:400:kworker.0 00000100:00000040:1.0:1788872988.863040:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788872988.863044:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4934a80 x1875765327889024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.863053:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934a80 x1875765327889024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.863060:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327889024:0@lo:400:kworker.0 00000100:00000040:1.0:1788872988.863065:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4936300 x1875765327887872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872988.863073:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9efadc000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1788872988.863078:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4935880 x1875765327888512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872988.863085:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9dfe96800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1788872988.863090:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4934000 x1875765327887744/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872988.863097:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000100:00000040:1.0:1788872988.863101:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4934e00 x1875765327888384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872988.863108:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9dfe90800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1788872988.863112:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4934a80 x1875765327889024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872988.863118:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a8ca9bc000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000040:3.0:1788872988.866228:0:94388:0:(genops.c:1231:class_import_get()) import ffff98a8c9e82800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1788872988.866587:0:94388:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000028d55f1e] to pc [ptlrpcd_00_01+1] req@ffff98a9f5c1d500 x1875765327889152/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.866712:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1d500 x1875765327889152/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.866728:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327889152:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788872988.866767:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1d500 x1875765327889152/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873004 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.866777:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872988.866830:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df455f80 x1875765327889152 msgsize 224 00000100:00100000:1.0:1788872988.866836:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872988.866941:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1d500 x1875765327889152/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873004 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872988.866957:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5273 usecs (6 jiffies) 00000100:00100000:3.0:1788872988.868893:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327889152 00000100:00100000:3.0:1788872988.868909:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327889152 00000020:00000040:3.0:1788872988.868912:0:8447:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6b6 00000020:00000040:3.0:1788872988.868928:0:8447:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ff63e800 refcount=5 00000100:00000040:3.0:1788872988.868958:0:8447:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1788872988.869002:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4081 00000100:00000040:3.0:1788872988.869007:0:8447:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9ff63e800 : new rpc_count 1 00000100:00000040:3.0:1788872988.869025:0:8447:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df455f80 x1875765327889152/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:159/0 lens 224/0 e 0 to 0 dl 1788872999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.869038:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327889152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788872988.869079:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00010000:00000040:3.0:1788872988.869093:0:8447:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327889152 00000100:00000040:3.0:1788872988.869105:0:8447:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872988.869113:0:8447:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872988.869302:0:8447:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9f5c1d500 x1875765327889152/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872988.869343:0:8447:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:3.0:1788872988.869348:0:8447:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df455f80 x1875765327889152/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:159/0 lens 224/368 e 0 to 0 dl 1788872999 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872988.869357:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327889152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 321us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872988.869365:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4081 00000100:00000040:3.0:1788872988.869369:0:8447:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9ff63e800 : new rpc_count 0 00000020:00000040:3.0:1788872988.869381:0:8447:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ff63e800 : new refcount 4 00000100:00000040:1.0:1788872988.869512:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788872988.869520:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1d500 x1875765327889152/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788872988.869533:0:3645:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352901 avail=317198 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023685 state=0: rc = 0 00000100:00000040:1.0:1788872988.869541:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1d500 x1875765327889152/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873004 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872988.869584:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327889152:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788872988.869592:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1d500 x1875765327889152/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873004 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872988.869603:0:3645:0:(genops.c:1244:class_import_put()) import ffff98a8c9e82800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00010000:00010000:2.0:1788872988.984789:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1788872989.371304:0:94392:0:(genops.c:1231:class_import_get()) import ffff98a9e021b000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788872989.371370:0:94392:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d4a21c5a] to pc [ptlrpcd_00_02+2] req@ffff98a9df454a80 x1875765327889280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872989.371415:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:1.0:1788872989.371438:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df454a80 x1875765327889280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872989.371451:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327889280:0@lo:13:osp-pre-1-0.0 00000100:00000040:1.0:1788872989.371479:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df454a80 x1875765327889280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873005 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872989.371487:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872989.371526:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df454700 x1875765327889280 msgsize 224 00000100:00100000:1.0:1788872989.371532:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872989.371585:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df454a80 x1875765327889280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873005 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872989.371601:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6083 usecs (7 jiffies) 00000100:00100000:1.0:1788872989.371626:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327889280 00000100:00100000:1.0:1788872989.371633:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327889280 00000020:00000040:1.0:1788872989.371635:0:8440:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6ee 00000020:00000040:1.0:1788872989.371640:0:8440:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9dfe94000 refcount=5 00000100:00000040:1.0:1788872989.371662:0:8440:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1788872989.371690:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253 00000100:00000040:1.0:1788872989.371695:0:8440:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9dfe94000 : new rpc_count 1 00000100:00000040:1.0:1788872989.371701:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df454700 x1875765327889280/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:160/0 lens 224/0 e 0 to 0 dl 1788873000 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872989.371715:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327889280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872989.371744:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00010000:00000040:1.0:1788872989.371754:0:8440:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875765327889280 00000100:00000040:1.0:1788872989.371765:0:8440:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872989.371770:0:8440:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872989.371786:0:8440:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9df454a80 x1875765327889280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873005 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872989.371805:0:8440:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872989.371817:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df454700 x1875765327889280/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:160/0 lens 224/368 e 0 to 0 dl 1788873000 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872989.371826:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327889280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872989.371834:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253 00000100:00000040:1.0:1788872989.371837:0:8440:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9dfe94000 : new rpc_count 0 00000020:00000040:1.0:1788872989.371847:0:8440:0:(genops.c:900:class_export_put()) PUTting export ffff98a9dfe94000 : new refcount 4 00000100:00000040:1.0:1788872989.371881:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:1.0:1788872989.371887:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df454a80 x1875765327889280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788872989.371897:0:3647:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:1.0:1788872989.371900:0:3647:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:1.0:1788872989.371907:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df454a80 x1875765327889280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873005 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872989.371925:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327889280:0@lo:13:osp-pre-1-0.0 00000100:00000040:1.0:1788872989.371931:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df454a80 x1875765327889280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873005 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872989.371940:0:3647:0:(genops.c:1244:class_import_put()) import ffff98a9e021b000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000020:00000040:1.0:1788872989.376042:0:75626:0:(genops.c:1231:class_import_get()) import ffff98a9df8c9800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1788872989.376098:0:75626:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d4a21c5a] to pc [ptlrpcd_00_03+3] req@ffff98a9df454a80 x1875765327889408/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.376191:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:0.0:1788872989.376210:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df454a80 x1875765327889408/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.376224:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327889408:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788872989.376255:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df454a80 x1875765327889408/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873005 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872989.376265:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872989.376306:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5ac000 x1875765327889408 msgsize 224 00000100:00100000:0.0:1788872989.376311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872989.376349:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df454a80 x1875765327889408/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873005 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872989.376367:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327889408 00000100:00000040:0.0:1788872989.376372:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1550766 usecs (1551 jiffies) 00000100:00100000:3.0:1788872989.376377:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327889408 00000020:00000040:3.0:1788872989.376381:0:30614:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db67e 00000020:00000040:3.0:1788872989.376776:0:30614:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9cb5ec800 refcount=7 00000100:00000040:3.0:1788872989.376798:0:30614:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1788872989.376841:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4082 00000100:00000040:3.0:1788872989.376846:0:30614:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9cb5ec800 : new rpc_count 1 00000100:00000040:3.0:1788872989.376852:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5ac000 x1875765327889408/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:160/0 lens 224/0 e 0 to 0 dl 1788873000 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872989.376865:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327889408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788872989.376900:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00010000:00000040:3.0:1788872989.376914:0:30614:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1875765327889408 00000100:00000040:3.0:1788872989.376924:0:30614:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872989.376929:0:30614:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872989.376952:0:30614:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9df454a80 x1875765327889408/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873005 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872989.376974:0:30614:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:3.0:1788872989.376980:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ac000 x1875765327889408/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:160/0 lens 224/368 e 0 to 0 dl 1788873000 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872989.376989:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327889408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872989.376996:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4082 00000100:00000040:3.0:1788872989.376999:0:30614:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9cb5ec800 : new rpc_count 0 00000020:00000040:3.0:1788872989.377007:0:30614:0:(genops.c:900:class_export_put()) PUTting export ffff98a9cb5ec800 : new refcount 6 00000100:00000040:0.0:1788872989.377161:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00000040:0.0:1788872989.377169:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df454a80 x1875765327889408/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788872989.377180:0:3646:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352801 avail=317098 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023574 state=0: rc = 0 00000100:00000040:0.0:1788872989.377203:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df454a80 x1875765327889408/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873005 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.377211:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327889408:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788872989.377217:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df454a80 x1875765327889408/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873005 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872989.377228:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a9df8c9800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1788872989.458530:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5ae300 x1875765311294720 msgsize 224 00000100:00100000:0.0:1788872989.458546:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:0.0:1788872989.458609:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5aed80 x1875765311295104 msgsize 224 00000100:00100000:0.0:1788872989.458615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:0.0:1788872989.458650:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9dfb88850 x1875765311294592 msgsize 224 00000100:00100000:0.0:1788872989.458656:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:0.0:1788872989.458658:0:3638:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788872989.458676:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5af800 x1875765311294848 msgsize 224 00000100:00100000:0.0:1788872989.458681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:0.0:1788872989.458706:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5af480 x1875765311294976 msgsize 520 00000100:00100000:0.0:1788872989.458711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872989.458745:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311295104 00000100:00100000:0.0:1788872989.458756:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311295104 00000020:00000040:0.0:1788872989.458760:0:8437:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dba1a 00000020:00000040:0.0:1788872989.458765:0:8437:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c2a7b000 refcount=7 00000020:00000040:0.0:1788872989.458779:0:8437:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:0.0:1788872989.458803:0:8437:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1788872989.458824:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311294976 00000100:00100000:0.0:1788872989.458827:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311294976 00000020:00000040:0.0:1788872989.458829:0:8437:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dbcba 00000100:00100000:0.0:1788872989.458848:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2790 00000100:00000040:0.0:1788872989.458853:0:8437:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9c2a7b000 : new rpc_count 1 00000100:00000040:0.0:1788872989.458870:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5aed80 x1875765311295104/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:160/0 lens 224/0 e 0 to 0 dl 1788873000 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.458885:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2407:x1875765311295104:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000040:0.0:1788872989.458929:0:8437:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765311295104 00000100:00000040:0.0:1788872989.458942:0:8437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872989.458949:0:8437:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788872989.458995:0:8437:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459002:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5aed80 x1875765311295104/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:160/0 lens 224/224 e 0 to 0 dl 1788873000 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.459026:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2407:x1875765311295104:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 144us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872989.459034:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2790 00000100:00000040:0.0:1788872989.459037:0:8437:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9c2a7b000 : new rpc_count 0 00000020:00000040:0.0:1788872989.459047:0:8437:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c2a7b000 : new refcount 6 00000100:00100000:0.0:1788872989.459056:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6085 00000100:00000040:0.0:1788872989.459060:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5af480 x1875765311294976/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.459069:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875765311294976:12345-192.168.204.39@tcp:8:kworker.0 00010000:00020000:0.0:1788872989.459088:0:8437:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1788872989.459100:0:8437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459103:0:8437:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459107:0:8437:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459328:0:8437:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459334:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5af480 x1875765311294976/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.459354:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875765311294976:12345-192.168.204.39@tcp:8:kworker.0 Request processed in 284us (645us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788872989.459361:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6085 00000100:00100000:0.0:1788872989.459384:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311294592 00000100:00100000:0.0:1788872989.459388:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311294592 00000020:00000040:0.0:1788872989.459390:0:94382:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db5f9 00000020:00000040:0.0:1788872989.459393:0:94382:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8ca9be000 refcount=10 00000100:00000040:0.0:1788872989.459404:0:94382:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788872989.459423:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 192 00000100:00000040:0.0:1788872989.459425:0:94382:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8ca9be000 : new rpc_count 1 00000100:00000040:0.0:1788872989.459430:0:94382:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9dfb88850 x1875765311294592/t0(0) o400->c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp:160/0 lens 224/0 e 0 to 0 dl 1788873000 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.459441:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311294592:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000040:0.0:1788872989.459450:0:94382:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765311294592 00000100:00000040:0.0:1788872989.459455:0:94382:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459459:0:94382:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459473:0:94382:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459478:0:94382:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9dfb88850 x1875765311294592/t0(0) o400->c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp:160/0 lens 224/224 e 0 to 0 dl 1788873000 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.459488:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311294592:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 49us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872989.459494:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 192 00000100:00000040:0.0:1788872989.459497:0:94382:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8ca9be000 : new rpc_count 0 00000020:00000040:0.0:1788872989.459502:0:94382:0:(genops.c:900:class_export_put()) PUTting export ffff98a8ca9be000 : new refcount 9 00000100:00100000:0.0:1788872989.459527:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311294720 00000100:00100000:0.0:1788872989.459530:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311294720 00000020:00000040:0.0:1788872989.459539:0:66192:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db685 00000020:00000040:0.0:1788872989.459542:0:66192:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9cb5ef800 refcount=51 00000020:00000040:0.0:1788872989.459572:0:66192:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff98a9e99999c0) now 14 - evictor 00000100:00000040:0.0:1788872989.459582:0:66192:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1788872989.459601:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311294848 00000100:00100000:0.0:1788872989.459604:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311294848 00000020:00000040:0.0:1788872989.459606:0:66192:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dac7c 00000020:00000040:0.0:1788872989.459608:0:66192:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c6799800 refcount=11 00000020:00000040:0.0:1788872989.459614:0:66192:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff98a9f9df99c0) now 10 - evictor 00000100:00100000:0.0:1788872989.459632:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1534 00000100:00000040:0.0:1788872989.459634:0:66192:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9cb5ef800 : new rpc_count 1 00000100:00000040:0.0:1788872989.459639:0:66192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5ae300 x1875765311294720/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:160/0 lens 224/0 e 0 to 0 dl 1788873000 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.459650:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2407:x1875765311294720:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000040:0.0:1788872989.459663:0:66192:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1875765311294720 00000100:00000040:0.0:1788872989.459667:0:66192:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459671:0:66192:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459686:0:66192:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459691:0:66192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ae300 x1875765311294720/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:160/0 lens 224/224 e 0 to 0 dl 1788873000 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.459698:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2407:x1875765311294720:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 51us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872989.459705:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1534 00000100:00000040:0.0:1788872989.459707:0:66192:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9cb5ef800 : new rpc_count 0 00000020:00000040:0.0:1788872989.459712:0:66192:0:(genops.c:900:class_export_put()) PUTting export ffff98a9cb5ef800 : new refcount 50 00000100:00100000:0.0:1788872989.459720:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1535 00000100:00000040:0.0:1788872989.459723:0:66192:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c6799800 : new rpc_count 1 00000100:00000040:0.0:1788872989.459727:0:66192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5af800 x1875765311294848/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:160/0 lens 224/0 e 0 to 0 dl 1788873000 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.459743:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2407:x1875765311294848:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000040:0.0:1788872989.459754:0:66192:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 77309411472, transno 0, xid 1875765311294848 00000100:00000040:0.0:1788872989.459759:0:66192:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459763:0:66192:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459776:0:66192:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872989.459781:0:66192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5af800 x1875765311294848/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:160/0 lens 224/224 e 0 to 0 dl 1788873000 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872989.459788:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2407:x1875765311294848:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 48us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872989.459794:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1535 00000100:00000040:0.0:1788872989.459796:0:66192:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c6799800 : new rpc_count 0 00000020:00000040:0.0:1788872989.459802:0:66192:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c6799800 : new refcount 10 00000100:00080000:0.0:1788872989.459820:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1788872989.459825:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff98a9f9df99c0) now 10 - evictor 00000100:00080000:0.0:1788872989.459828:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1788872989.459830:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff98a9e99999c0) now 14 - evictor 00000100:00080000:0.0:1788872989.459833:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788872989.459835:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00010000:00010000:0.0:1788872990.009866:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788872991.033357:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872992.057153:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1788872992.443521:0:75631:0:(genops.c:1231:class_import_get()) import ffff98a9dfe90800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1788872992.443597:0:75631:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d5cb5ec5] to pc [ptlrpcd_00_00+0] req@ffff98a9f5c1c700 x1875765327889536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872992.443698:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1c700 x1875765327889536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872992.443711:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327889536:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1788872992.443741:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1c700 x1875765327889536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873008 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872992.443765:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872992.443806:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5ac380 x1875765327889536 msgsize 224 00000100:00100000:0.0:1788872992.443810:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872992.443857:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1c700 x1875765327889536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873008 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872992.443871:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 7113 usecs (8 jiffies) 00000100:00100000:3.0:1788872992.446703:0:61068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327889536 00000100:00100000:3.0:1788872992.446717:0:61068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327889536 00000020:00000040:3.0:1788872992.446720:0:61068:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d553b 00000020:00000040:3.0:1788872992.446725:0:61068:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c45cb000 refcount=5 00000020:00000040:3.0:1788872992.446758:0:61068:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:3.0:1788872992.446794:0:61068:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1788872992.446837:0:61068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2254 00000100:00000040:3.0:1788872992.446841:0:61068:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9c45cb000 : new rpc_count 1 00000100:00080000:0.0:1788872992.447039:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788872992.447045:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:3.0:1788872992.447062:0:61068:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5ac380 x1875765327889536/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:163/0 lens 224/0 e 0 to 0 dl 1788873003 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872992.447088:0:61068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327889536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788872992.447119:0:61068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00010000:00000040:3.0:1788872992.447129:0:61068:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875765327889536 00000100:00000040:3.0:1788872992.447138:0:61068:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872992.447144:0:61068:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872992.447186:0:61068:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9f5c1c700 x1875765327889536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873008 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872992.447217:0:61068:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:3.0:1788872992.447221:0:61068:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ac380 x1875765327889536/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:163/0 lens 224/368 e 0 to 0 dl 1788873003 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872992.447231:0:61068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327889536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (3423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872992.447245:0:61068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2254 00000100:00000040:3.0:1788872992.447248:0:61068:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9c45cb000 : new rpc_count 0 00000020:00000040:3.0:1788872992.447257:0:61068:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c45cb000 : new refcount 4 00000100:00000040:0.0:1788872992.447378:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:0.0:1788872992.447385:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1c700 x1875765327889536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788872992.447396:0:3644:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1788872992.447399:0:3644:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1788872992.447408:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1c700 x1875765327889536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873008 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872992.447415:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327889536:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1788872992.447422:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1c700 x1875765327889536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873008 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872992.447432:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9dfe90800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:3.0:1788872993.085003:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1788872993.976630:0:94388:0:(genops.c:1231:class_import_get()) import ffff98a8c9e82800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1788872993.976676:0:94388:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000048be7b7a] to pc [ptlrpcd_00_01+1] req@ffff98a9df457100 x1875765327889664/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.976713:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:1.0:1788872993.976737:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df457100 x1875765327889664/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.976751:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327889664:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788872993.976781:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df457100 x1875765327889664/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873009 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.976800:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.976842:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df454a80 x1875765327889664 msgsize 224 00000100:00100000:1.0:1788872993.976847:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872993.976870:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df457100 x1875765327889664/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873009 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.976883:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5215 usecs (6 jiffies) 00000100:00100000:1.0:1788872993.976910:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327889664 00000100:00100000:1.0:1788872993.976917:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327889664 00000020:00000040:1.0:1788872993.976920:0:8447:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6b6 00000020:00000040:1.0:1788872993.976924:0:8447:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ff63e800 refcount=5 00000100:00000040:1.0:1788872993.976946:0:8447:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1788872993.976973:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4083 00000100:00000040:1.0:1788872993.976977:0:8447:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9ff63e800 : new rpc_count 1 00000100:00000040:1.0:1788872993.976981:0:8447:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df454a80 x1875765327889664/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:164/0 lens 224/0 e 0 to 0 dl 1788873004 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.976992:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327889664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872993.977026:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00010000:00000040:1.0:1788872993.977100:0:8447:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327889664 00000100:00000040:1.0:1788872993.977109:0:8447:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872993.977114:0:8447:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.977130:0:8447:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9df457100 x1875765327889664/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.977147:0:8447:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872993.977156:0:8447:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df454a80 x1875765327889664/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:164/0 lens 224/368 e 0 to 0 dl 1788873004 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.977165:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327889664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 174us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872993.977171:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4083 00000100:00000040:1.0:1788872993.977174:0:8447:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9ff63e800 : new rpc_count 0 00000020:00000040:1.0:1788872993.977182:0:8447:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ff63e800 : new refcount 4 00000100:00000040:1.0:1788872993.977216:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788872993.977222:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df457100 x1875765327889664/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788872993.977232:0:3644:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352901 avail=317198 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023685 state=0: rc = 0 00000100:00000040:1.0:1788872993.977239:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df457100 x1875765327889664/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873009 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.977246:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327889664:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788872993.977252:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df457100 x1875765327889664/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873009 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872993.977262:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a8c9e82800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1788872993.979909:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788872993.979925:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000100:00000040:1.0:1788872993.979951:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS req@ffff98a9df457100 x1875765327889792/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872993.979968:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000048be7b7a] to pc [ptlrpcd_00_02+2] req@ffff98a9df457100 x1875765327889792/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.979989:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788872993.979996:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9efadc000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1788872993.980010:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff98a8c738df80 x1875765327889920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872993.980020:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000010c5f8b7] to pc [ptlrpcd_00_03+3] req@ffff98a8c738df80 x1875765327889920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980028:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788872993.980033:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a8c2644800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1788872993.980051:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff98a8c738fb80 x1875765327890048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872993.980060:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bd38298c] to pc [ptlrpcd_00_00+0] req@ffff98a8c738fb80 x1875765327890048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980074:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788872993.980079:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9df8c9800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1788872993.980086:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff98a8c738d500 x1875765327890176/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872993.980093:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000003e07697] to pc [ptlrpcd_00_01+1] req@ffff98a8c738d500 x1875765327890176/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872993.980101:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872993.980104:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788872993.980107:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872993.980112:0:30879:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3925 00000100:00080000:1.0:1788872993.980117:0:30879:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00000040:1.0:1788872993.980120:0:30879:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 50 to 0@lo 00000100:00000040:1.0:1788872993.980123:0:30879:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000020:00000040:1.0:1788872993.980127:0:30879:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d5518 00000020:00000040:1.0:1788872993.980131:0:30879:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c5646000 refcount=4 00000100:00000040:1.0:1788872993.980140:0:30879:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 50 to 0@lo 00000100:00000040:1.0:1788872993.980142:0:30879:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000020:00000040:1.0:1788872993.980146:0:30879:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c5646000 : new refcount 3 00000100:00080000:1.0:1788872993.980149:0:30879:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98a9e7bf8800 using connection 192.168.204.139@tcp/0@lo 00000020:00000040:1.0:1788872993.980159:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9e7bf8800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1788872993.980169:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a8c738c380 x1875765327890304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872993.980179:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000089826dba] to pc [ptlrpcd_rcv+-1] req@ffff98a8c738c380 x1875765327890304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980194:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788872993.980200:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9dfe90800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1788872993.980206:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff98a9ee81c000 x1875765327890432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872993.980215:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003386790f] to pc [ptlrpcd_00_02+2] req@ffff98a9ee81c000 x1875765327890432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980222:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788872993.980226:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9dfe96800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1788872993.980232:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff98a9ee81ed80 x1875765327890560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872993.980239:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e1b3ffd7] to pc [ptlrpcd_00_03+3] req@ffff98a9ee81ed80 x1875765327890560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872993.980246:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788872993.980250:0:30879:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788872993.980251:0:30879:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788872993.980254:0:30879:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3925 00000100:00080000:1.0:1788872993.980262:0:30879:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00000040:1.0:1788872993.980264:0:30879:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 50 to 0@lo 00000100:00000040:1.0:1788872993.980267:0:30879:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000020:00000040:1.0:1788872993.980269:0:30879:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6cb 00000020:00000040:1.0:1788872993.980272:0:30879:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ef0af000 refcount=4 00000100:00000040:1.0:1788872993.980274:0:30879:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 50 to 0@lo 00000100:00000040:1.0:1788872993.980276:0:30879:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000020:00000040:1.0:1788872993.980277:0:30879:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ef0af000 : new refcount 3 00000100:00080000:1.0:1788872993.980279:0:30879:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98a8c37f1000 using connection 192.168.204.139@tcp/0@lo 00000020:00000040:1.0:1788872993.980285:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a8c37f1000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1788872993.980293:0:30879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ee81dc00 x1875765327890688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872993.980302:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a11d64b2] to pc [ptlrpcd_rcv+-1] req@ffff98a9ee81dc00 x1875765327890688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980310:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788872993.980315:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a9e021b000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788872993.980321:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff98a9ee81d500 x1875765327890816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872993.980330:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b8141235] to pc [ptlrpcd_00_00+0] req@ffff98a9ee81d500 x1875765327890816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980338:0:30879:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788872993.980343:0:30879:0:(genops.c:1231:class_import_get()) import ffff98a8ca9bc000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1788872993.980349:0:30879:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff98a9ee81ea00 x1875765327890944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872993.980356:0:30879:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000453ee8f] to pc [ptlrpcd_00_01+1] req@ffff98a9ee81ea00 x1875765327890944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980374:0:30879:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3936) 00000100:00000040:1.0:1788872993.980389:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df457100 x1875765327889792/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.980400:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327889792:0@lo:400:kworker.0 00000100:00000040:1.0:1788872993.980425:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df457100 x1875765327889792/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980433:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.980468:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9dfb8a050 x1875765327889792 msgsize 224 00000100:00100000:1.0:1788872993.980472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872993.980474:0:3646:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788872993.980492:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df457100 x1875765327889792/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980517:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ee81c000 x1875765327890432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.980524:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327890432:0@lo:400:kworker.0 00000100:00000040:1.0:1788872993.980600:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ee81c000 x1875765327890432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980608:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.980623:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81d180 x1875765327890432 msgsize 224 00000100:00100000:1.0:1788872993.980627:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872993.980640:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ee81c000 x1875765327890432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980648:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 7107 usecs (8 jiffies) 00000100:00100000:1.0:1788872993.980661:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:1.0:1788872993.980665:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a8c738df80 x1875765327889920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.980673:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c738df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327889920:0@lo:400:kworker.0 00000100:00000040:1.0:1788872993.980692:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a8c738df80 x1875765327889920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980698:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.980712:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81ca80 x1875765327889920 msgsize 224 00000100:00100000:1.0:1788872993.980715:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872993.980727:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a8c738df80 x1875765327889920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980736:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8831 usecs (9 jiffies) 00000100:00000040:1.0:1788872993.980741:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ee81ed80 x1875765327890560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.980748:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327890560:0@lo:400:kworker.0 00000100:00000040:1.0:1788872993.980758:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ee81ed80 x1875765327890560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.980764:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.980774:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81d880 x1875765327890560 msgsize 224 00000100:00100000:1.0:1788872993.980778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872993.980787:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ee81ed80 x1875765327890560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872993.981266:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327889920 00000100:00100000:2.0:1788872993.981274:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327889920 00000020:00000040:2.0:1788872993.981276:0:83669:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db806 00000020:00000040:2.0:1788872993.981280:0:83669:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9f0834000 refcount=5 00000020:00000040:2.0:1788872993.981293:0:83669:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff98a9e99999c0) now 14 - evictor 00000100:00000040:2.0:1788872993.981321:0:83669:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788872993.981342:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327890560 00000100:00100000:2.0:1788872993.981345:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327890560 00000020:00000040:2.0:1788872993.981346:0:83669:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db80d 00000020:00000040:2.0:1788872993.981355:0:83669:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9f0835000 refcount=5 00000100:00100000:2.0:1788872993.981379:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00000040:2.0:1788872993.981383:0:83669:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9f0834000 : new rpc_count 1 00000100:00000040:2.0:1788872993.981388:0:83669:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81ca80 x1875765327889920/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:164/0 lens 224/0 e 0 to 0 dl 1788873004 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872993.981399:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327889920:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788872993.981420:0:83669:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327889920 00000100:00000040:2.0:1788872993.981428:0:83669:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:2.0:1788872993.981433:0:83669:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872993.981455:0:83669:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a8c738df80 x1875765327889920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.981471:0:83669:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:2.0:1788872993.981475:0:83669:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81ca80 x1875765327889920/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:164/0 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872993.981484:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327889920:12345-0@lo:400:kworker.0 Request processed in 87us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872993.981491:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00000040:2.0:1788872993.981494:0:83669:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9f0834000 : new rpc_count 0 00000020:00000040:2.0:1788872993.981503:0:83669:0:(genops.c:900:class_export_put()) PUTting export ffff98a9f0834000 : new refcount 4 00000100:00100000:2.0:1788872993.981512:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00000040:2.0:1788872993.981514:0:83669:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9f0835000 : new rpc_count 1 00000100:00000040:2.0:1788872993.981518:0:83669:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81d880 x1875765327890560/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:164/0 lens 224/0 e 0 to 0 dl 1788873004 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872993.981527:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327890560:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788872993.981536:0:83669:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327890560 00000100:00000040:2.0:1788872993.981540:0:83669:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:2.0:1788872993.981564:0:83669:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872993.981579:0:83669:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9ee81ed80 x1875765327890560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.981592:0:83669:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:2.0:1788872993.981596:0:83669:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81d880 x1875765327890560/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:164/0 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872993.981615:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875765327890560:12345-0@lo:400:kworker.0 Request processed in 89us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872993.981622:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00000040:2.0:1788872993.981624:0:83669:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9f0835000 : new rpc_count 0 00000020:00000040:2.0:1788872993.981630:0:83669:0:(genops.c:900:class_export_put()) PUTting export ffff98a9f0835000 : new refcount 4 00000100:00000040:2.0:1788872993.981646:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a8c738d500 x1875765327890176/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872993.981655:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c738d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327890176:0@lo:400:kworker.0 00000100:00000040:2.0:1788872993.981694:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a8c738d500 x1875765327890176/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.981702:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872993.981719:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c9fe7800 x1875765327890176 msgsize 224 00000100:00100000:2.0:1788872993.981724:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872993.981744:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a8c738d500 x1875765327890176/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.981755:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1546313 usecs (1547 jiffies) 00000100:00000040:2.0:1788872993.981761:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ee81ea00 x1875765327890944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872993.981769:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327890944:0@lo:400:kworker.0 00000100:00000040:2.0:1788872993.981780:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ee81ea00 x1875765327890944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872993.982231:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1788872993.982236:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff98a9e99999c0) now 14 - evictor 00000100:00000040:1.0:1788872993.982309:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 130750 usecs (131 jiffies) 00000100:00000040:1.0:1788872993.982333:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788872993.982339:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ee81ed80 x1875765327890560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.982347:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81ed80 x1875765327890560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.982353:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875765327890560:0@lo:400:kworker.0 00000100:00000040:1.0:1788872993.982359:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ee81ed80 x1875765327890560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872993.982375:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a9dfe96800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1788872993.982393:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788872993.982398:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a8c738df80 x1875765327889920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.982405:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c738df80 x1875765327889920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.982411:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c738df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327889920:0@lo:400:kworker.0 00000100:00000040:1.0:1788872993.982417:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a8c738df80 x1875765327889920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872993.982423:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a9efadc000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1788872993.982446:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a8c738c380 x1875765327890304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.982455:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c738c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327890304:0@lo:8:kworker.0 00000100:00000040:1.0:1788872993.982468:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a8c738c380 x1875765327890304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873018 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.982475:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.982492:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81ed80 x1875765327890304 msgsize 520 00000100:00100000:1.0:1788872993.982496:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872993.982510:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a8c738c380 x1875765327890304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873018 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.982519:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 6662 usecs (7 jiffies) 00000100:00000040:1.0:1788872993.982524:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ee81dc00 x1875765327890688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.982532:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327890688:0@lo:8:kworker.0 00000100:00000040:1.0:1788872993.982542:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ee81dc00 x1875765327890688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873018 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.982567:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.982580:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81f100 x1875765327890688 msgsize 520 00000100:00100000:1.0:1788872993.982583:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872993.982597:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ee81dc00 x1875765327890688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873018 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.982685:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1788872993.982937:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327890176 00000100:00100000:3.0:1788872993.982943:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327890176 00000020:00000040:3.0:1788872993.982946:0:30614:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db67e 00000020:00000040:3.0:1788872993.982949:0:30614:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9cb5ec800 refcount=7 00000100:00000040:3.0:1788872993.982965:0:30614:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1788872993.983023:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4084 00000100:00000040:3.0:1788872993.983027:0:30614:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9cb5ec800 : new rpc_count 1 00000100:00000040:3.0:1788872993.983048:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c9fe7800 x1875765327890176/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:164/0 lens 224/0 e 0 to 0 dl 1788873004 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872993.983060:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327890176:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788872993.983080:0:30614:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1875765327890176 00000100:00000040:3.0:1788872993.983087:0:30614:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872993.983091:0:30614:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.983328:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8237 usecs (9 jiffies) 00000100:00100000:1.0:1788872993.983355:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327889792 00000100:00100000:1.0:1788872993.983359:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327889792 00000020:00000040:1.0:1788872993.983361:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:1.0:1788872993.983364:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=21 00000100:00000040:1.0:1788872993.983376:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788872993.983392:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:1.0:1788872993.983395:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:1.0:1788872993.983399:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9dfb8a050 x1875765327889792/t0(0) o400->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:164/0 lens 224/0 e 0 to 0 dl 1788873004 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.983409:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3646:x1875765327889792:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788872993.983418:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327889792 00000100:00000040:1.0:1788872993.983423:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 53 to 0@lo 00000100:00000040:1.0:1788872993.983426:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872993.983517:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c9fe5880 x1875765327890944 msgsize 224 00000100:00100000:2.0:1788872993.983521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872993.983543:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ee81ea00 x1875765327890944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872993.983561:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327890944 00000100:00100000:0.0:1788872993.983565:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327890944 00000020:00000040:0.0:1788872993.983567:0:66193:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db814 00000020:00000040:0.0:1788872993.983570:0:66193:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9df96b800 refcount=5 00000100:00000040:2.0:1788872993.983571:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8771 usecs (9 jiffies) 00000100:00100000:2.0:1788872993.983581:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000040:0.0:1788872993.983581:0:66193:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:2.0:1788872993.983587:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a8c738fb80 x1875765327890048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872993.983597:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c738fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327890048:0@lo:400:kworker.0 00000100:00100000:0.0:1788872993.983598:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00000040:0.0:1788872993.983605:0:66193:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9df96b800 : new rpc_count 1 00000100:00000040:0.0:1788872993.983610:0:66193:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c9fe5880 x1875765327890944/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:164/0 lens 224/0 e 0 to 0 dl 1788873004 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872993.983620:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327890944:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1788872993.983623:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a8c738fb80 x1875765327890048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1788872993.983628:0:66193:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327890944 00000100:00000040:2.0:1788872993.983629:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872993.983633:0:66193:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 54 to 0@lo 00000100:00000040:0.0:1788872993.983636:0:66193:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872993.983640:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c9fe4700 x1875765327890048 msgsize 224 00000100:00100000:2.0:1788872993.983644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872993.983650:0:66193:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9ee81ea00 x1875765327890944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.983656:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a8c738fb80 x1875765327890048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.983670:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8788 usecs (9 jiffies) 00000100:00000040:2.0:1788872993.983677:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ee81d500 x1875765327890816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872993.983686:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327890816:0@lo:400:kworker.0 00000100:00000040:2.0:1788872993.983697:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ee81d500 x1875765327890816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.983703:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872993.984116:0:66193:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 53 to 0@lo 00000100:00000040:0.0:1788872993.984123:0:66193:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe5880 x1875765327890944/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:164/0 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872993.984128:0:30614:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a8c738d500 x1875765327890176/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872993.984132:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875765327890944:12345-0@lo:400:kworker.0 Request processed in 513us (614us total) trans 0 rc 0/0 00000100:00000040:3.0:1788872993.984144:0:30614:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872993.984150:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe7800 x1875765327890176/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:164/0 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872993.984157:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327890176:12345-0@lo:400:kworker.0 Request processed in 1100us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872993.984164:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4084 00000100:00000040:3.0:1788872993.984166:0:30614:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9cb5ec800 : new rpc_count 0 00000020:00000040:3.0:1788872993.984177:0:30614:0:(genops.c:900:class_export_put()) PUTting export ffff98a9cb5ec800 : new refcount 6 00000100:00100000:0.0:1788872993.986345:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00000040:0.0:1788872993.986353:0:66193:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9df96b800 : new rpc_count 0 00000020:00000040:0.0:1788872993.986368:0:66193:0:(genops.c:900:class_export_put()) PUTting export ffff98a9df96b800 : new refcount 4 00000100:00100000:0.0:1788872993.986390:0:66193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327890048 00000100:00100000:0.0:1788872993.986397:0:66193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327890048 00000020:00000040:0.0:1788872993.986400:0:66193:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d55b9 00000020:00000040:0.0:1788872993.986404:0:66193:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c37f4800 refcount=5 00000020:00000040:0.0:1788872993.986416:0:66193:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff98a9f9df99c0) now 10 - evictor 00000100:00000040:0.0:1788872993.986436:0:66193:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1788872993.986455:0:66193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00000040:0.0:1788872993.986459:0:66193:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c37f4800 : new rpc_count 1 00000100:00000040:0.0:1788872993.986465:0:66193:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c9fe4700 x1875765327890048/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:164/0 lens 224/0 e 0 to 0 dl 1788873004 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872993.986479:0:66193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327890048:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788872993.986506:0:66193:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327890048 00000100:00000040:0.0:1788872993.986517:0:66193:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 53 to 0@lo 00000100:00000040:0.0:1788872993.986522:0:66193:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872993.986580:0:66193:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a8c738fb80 x1875765327890048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872993.986609:0:66193:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:0.0:1788872993.986614:0:66193:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe4700 x1875765327890048/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:164/0 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872993.986624:0:66193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875765327890048:12345-0@lo:400:kworker.0 Request processed in 146us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872993.986631:0:66193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00000040:0.0:1788872993.986633:0:66193:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c37f4800 : new rpc_count 0 00000020:00000040:0.0:1788872993.986639:0:66193:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c37f4800 : new refcount 4 00000100:00080000:0.0:1788872993.986658:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1788872993.986662:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff98a9f9df99c0) now 10 - evictor 00000100:00000040:1.0:1788872993.987201:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9df457100 x1875765327889792/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.987229:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872993.987236:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9dfb8a050 x1875765327889792/t0(0) o400->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:164/0 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.987245:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:3646:x1875765327889792:12345-0@lo:400:kworker.0 Request processed in 3836us (6775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872993.987255:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:1.0:1788872993.987264:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:1.0:1788872993.987274:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 20 00000100:00100000:1.0:1788872993.987310:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327890432 00000100:00100000:1.0:1788872993.987314:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327890432 00000020:00000040:1.0:1788872993.987316:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d553b 00000020:00000040:1.0:1788872993.987319:0:8436:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c45cb000 refcount=5 00000100:00000040:1.0:1788872993.987335:0:8436:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1788872993.987356:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327890304 00000100:00100000:1.0:1788872993.987359:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327890304 00000020:00000040:1.0:1788872993.987361:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d552d 00000100:00100000:1.0:1788872993.987377:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327890688 00000100:00100000:1.0:1788872993.987380:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327890688 00000020:00000040:1.0:1788872993.987382:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6e0 00000100:00100000:1.0:1788872993.987397:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00000040:1.0:1788872993.987400:0:8436:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9c45cb000 : new rpc_count 1 00000100:00000040:1.0:1788872993.987406:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81d180 x1875765327890432/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:164/0 lens 224/0 e 0 to 0 dl 1788873004 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.987416:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327890432:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788872993.987428:0:8436:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875765327890432 00000100:00000040:1.0:1788872993.987434:0:8436:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872993.987438:0:8436:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.987456:0:8436:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9ee81c000 x1875765327890432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.987467:0:8436:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872993.987471:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81d180 x1875765327890432/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:164/0 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.987478:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327890432:12345-0@lo:400:kworker.0 Request processed in 64us (6853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872993.987483:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00000100:00000040:1.0:1788872993.987492:0:8436:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9c45cb000 : new rpc_count 0 00000020:00000040:1.0:1788872993.987497:0:8436:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c45cb000 : new refcount 4 00000100:00100000:1.0:1788872993.987505:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6086 00000100:00000040:1.0:1788872993.987509:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81ed80 x1875765327890304/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788873013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.987517:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875765327890304:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788872993.987537:0:8436:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1788872993.987563:0:8436:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872993.987566:0:8436:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872993.987570:0:8436:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.987586:0:8436:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff98a8c738c380 x1875765327890304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873018 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.987704:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f6a9e450 x1875765327890816 msgsize 224 00000100:00100000:2.0:1788872993.987710:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872993.987712:0:3645:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788872993.987737:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ee81d500 x1875765327890816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873009 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.987748:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 5912 usecs (6 jiffies) 00000100:00000040:2.0:1788872993.987773:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00000040:2.0:1788872993.987779:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a8c738d500 x1875765327890176/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.987789:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c738d500 x1875765327890176/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872993.987796:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c738d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327890176:0@lo:400:kworker.0 00000100:00000040:2.0:1788872993.987809:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788872993.987813:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ee81ea00 x1875765327890944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.987821:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81ea00 x1875765327890944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872993.987827:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875765327890944:0@lo:400:kworker.0 00000100:00000040:2.0:1788872993.987832:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a8c738d500 x1875765327890176/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872993.987842:0:3645:0:(genops.c:1244:class_import_put()) import ffff98a9df8c9800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788872993.987851:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ee81ea00 x1875765327890944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872993.987857:0:3645:0:(genops.c:1244:class_import_put()) import ffff98a8ca9bc000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1788872993.987871:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788872993.987875:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a8c738fb80 x1875765327890048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872993.987882:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c738fb80 x1875765327890048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872993.987897:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c738fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1875765327890048:0@lo:400:kworker.0 00000100:00000040:2.0:1788872993.987902:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a8c738fb80 x1875765327890048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872993.987911:0:3645:0:(genops.c:1244:class_import_put()) import ffff98a8c2644800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1788872993.988095:0:8436:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872993.988101:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81ed80 x1875765327890304/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788873013 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.988109:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875765327890304:12345-0@lo:8:kworker.0 Request processed in 591us (5615us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872993.988116:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6086 00000100:00100000:1.0:1788872993.988129:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327890816 00000100:00100000:1.0:1788872993.988133:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327890816 00000020:00000040:1.0:1788872993.988135:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6ee 00000020:00000040:1.0:1788872993.988137:0:8436:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9dfe94000 refcount=5 00000020:00000040:1.0:1788872993.988147:0:8436:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:1.0:1788872993.988166:0:8436:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1788872993.988183:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00000040:1.0:1788872993.988185:0:8436:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9dfe94000 : new rpc_count 1 00000100:00000040:1.0:1788872993.988189:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f6a9e450 x1875765327890816/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:164/0 lens 224/0 e 0 to 0 dl 1788873004 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.988209:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f6a9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327890816:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788872993.988219:0:8436:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875765327890816 00000100:00000040:1.0:1788872993.988224:0:8436:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872993.988227:0:8436:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.988244:0:8436:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9ee81d500 x1875765327890816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.988262:0:8436:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872993.988266:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f6a9e450 x1875765327890816/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:164/0 lens 224/224 e 0 to 0 dl 1788873004 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.988273:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f6a9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327890816:12345-0@lo:400:kworker.0 Request processed in 66us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872993.988279:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00000040:1.0:1788872993.988281:0:8436:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9dfe94000 : new rpc_count 0 00000020:00000040:1.0:1788872993.988286:0:8436:0:(genops.c:900:class_export_put()) PUTting export ffff98a9dfe94000 : new refcount 4 00000100:00100000:1.0:1788872993.988294:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6087 00000100:00000040:1.0:1788872993.988298:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81f100 x1875765327890688/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788873013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.988306:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875765327890688:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788872993.988320:0:8436:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1788872993.988328:0:8436:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872993.988330:0:8436:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872993.988333:0:8436:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872993.988349:0:8436:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff98a9ee81dc00 x1875765327890688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873018 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.988361:0:8436:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872993.988370:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81f100 x1875765327890688/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788873013 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.988377:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1875765327890688:12345-0@lo:8:kworker.0 Request processed in 70us (5796us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788872993.988383:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6087 00000100:00000040:1.0:1788872993.988545:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:1.0:1788872993.988590:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ee81d500 x1875765327890816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.988598:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81d500 x1875765327890816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788872993.989168:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1788872993.989174:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00100000:1.0:1788872993.993463:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327890816:0@lo:400:kworker.0 00000100:00000040:1.0:1788872993.993481:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ee81d500 x1875765327890816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872993.993501:0:3645:0:(genops.c:1244:class_import_put()) import ffff98a9e021b000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788872993.993633:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a8c738c380 x1875765327890304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873018 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872993.993646:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872993.993650:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1788872993.993655:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c738c380 x1875765327890304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873018 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.993663:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c738c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327890304:0@lo:8:kworker.0 00000100:00000040:1.0:1788872993.993678:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ee81dc00 x1875765327890688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873018 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872993.993684:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788872993.993688:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1788872993.993704:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81dc00 x1875765327890688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873018 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.993710:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327890688:0@lo:8:kworker.0 00000100:00000040:1.0:1788872993.993715:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a8c738c380 x1875765327890304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873018 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872993.993723:0:3643:0:(genops.c:1244:class_import_put()) import ffff98a9e7bf8800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1788872993.993729:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ee81dc00 x1875765327890688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873018 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872993.993736:0:3643:0:(genops.c:1244:class_import_put()) import ffff98a8c37f1000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788872993.993763:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df457100 x1875765327889792/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.993772:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df457100 x1875765327889792/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.993778:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327889792:0@lo:400:kworker.0 00000100:00000040:1.0:1788872993.993795:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:1.0:1788872993.993800:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ee81c000 x1875765327890432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872993.993807:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81c000 x1875765327890432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872993.993814:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327890432:0@lo:400:kworker.0 00000100:00000040:1.0:1788872993.993819:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df457100 x1875765327889792/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872993.993826:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000100:00000040:1.0:1788872993.993832:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ee81c000 x1875765327890432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872993.993845:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a9dfe90800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:3.0:1788872994.105657:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1788872994.488713:0:94392:0:(genops.c:1231:class_import_get()) import ffff98a9e021b000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788872994.488760:0:94392:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003386790f] to pc [ptlrpcd_00_02+2] req@ffff98a9ee81c000 x1875765327891072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872994.488894:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ee81c000 x1875765327891072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872994.488911:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327891072:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1788872994.488942:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ee81c000 x1875765327891072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873010 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872994.488951:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872994.489006:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c9fe6680 x1875765327891072 msgsize 224 00000100:00100000:2.0:1788872994.489012:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872994.489057:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ee81c000 x1875765327891072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873010 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872994.489144:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6043 usecs (7 jiffies) 00000020:00000040:0.0:1788872994.489290:0:75626:0:(genops.c:1231:class_import_get()) import ffff98a9df8c9800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1788872994.489309:0:75626:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000072bffe32] to pc [ptlrpcd_00_03+3] req@ffff98a9df5ad880 x1875765327891200/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872994.489381:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:2.0:1788872994.489390:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df5ad880 x1875765327891200/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872994.489400:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327891200:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1788872994.489415:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df5ad880 x1875765327891200/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873010 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872994.489422:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872994.489450:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c9fe5f80 x1875765327891200 msgsize 224 00000100:00100000:2.0:1788872994.489467:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872994.489491:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df5ad880 x1875765327891200/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873010 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872994.489501:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1541911 usecs (1542 jiffies) 00000100:00100000:1.0:1788872994.489588:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327891072 00000100:00100000:1.0:1788872994.489597:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327891072 00000020:00000040:1.0:1788872994.489599:0:8440:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6ee 00000020:00000040:1.0:1788872994.489650:0:8440:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9dfe94000 refcount=5 00000100:00000040:1.0:1788872994.489676:0:8440:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1788872994.489700:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2255 00000100:00000040:1.0:1788872994.489711:0:8440:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9dfe94000 : new rpc_count 1 00000100:00000040:1.0:1788872994.489716:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c9fe6680 x1875765327891072/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:165/0 lens 224/0 e 0 to 0 dl 1788873005 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872994.489729:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327891072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872994.489761:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00010000:00000040:1.0:1788872994.489772:0:8440:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875765327891072 00000100:00000040:1.0:1788872994.489781:0:8440:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872994.489786:0:8440:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872994.489805:0:8440:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9ee81c000 x1875765327891072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873010 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872994.489834:0:8440:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872994.489839:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe6680 x1875765327891072/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:165/0 lens 224/368 e 0 to 0 dl 1788873005 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872994.489848:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327891072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872994.489855:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2255 00000100:00000040:1.0:1788872994.489864:0:8440:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9dfe94000 : new rpc_count 0 00000020:00000040:1.0:1788872994.489876:0:8440:0:(genops.c:900:class_export_put()) PUTting export ffff98a9dfe94000 : new refcount 4 00000100:00000040:3.0:1788872994.489891:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:3.0:1788872994.489899:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ee81c000 x1875765327891072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1788872994.489910:0:3646:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:3.0:1788872994.489913:0:3646:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:3.0:1788872994.489920:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81c000 x1875765327891072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873010 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872994.489928:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327891072:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1788872994.489943:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ee81c000 x1875765327891072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873010 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872994.489955:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a9e021b000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00100000:0.0:1788872994.489968:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327891200 00000100:00100000:0.0:1788872994.489973:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327891200 00000020:00000040:0.0:1788872994.489974:0:8447:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db67e 00000020:00000040:0.0:1788872994.489977:0:8447:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9cb5ec800 refcount=7 00000100:00000040:0.0:1788872994.489991:0:8447:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1788872994.490014:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4085 00000100:00000040:0.0:1788872994.490016:0:8447:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9cb5ec800 : new rpc_count 1 00000100:00000040:0.0:1788872994.490021:0:8447:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c9fe5f80 x1875765327891200/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:165/0 lens 224/0 e 0 to 0 dl 1788873005 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872994.490043:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327891200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872994.490099:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00010000:00000040:0.0:1788872994.490109:0:8447:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1875765327891200 00000100:00000040:0.0:1788872994.490114:0:8447:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:0.0:1788872994.490118:0:8447:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872994.490138:0:8447:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9df5ad880 x1875765327891200/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873010 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872994.490169:0:8447:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:0.0:1788872994.490174:0:8447:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe5f80 x1875765327891200/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:165/0 lens 224/368 e 0 to 0 dl 1788873005 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872994.490181:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327891200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872994.490186:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4085 00000100:00000040:0.0:1788872994.490189:0:8447:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9cb5ec800 : new rpc_count 0 00000020:00000040:0.0:1788872994.490195:0:8447:0:(genops.c:900:class_export_put()) PUTting export ffff98a9cb5ec800 : new refcount 6 00000100:00000040:3.0:1788872994.490242:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00000040:3.0:1788872994.490247:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df5ad880 x1875765327891200/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1788872994.490255:0:3646:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352801 avail=317098 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023574 state=0: rc = 0 00000100:00000040:3.0:1788872994.490266:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ad880 x1875765327891200/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873010 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872994.490273:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327891200:0@lo:41:osp-pre-0-1.0 00000100:00000040:3.0:1788872994.490279:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df5ad880 x1875765327891200/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873010 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872994.490292:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a9df8c9800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1788872994.569490:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1c000 x1875765311295360 msgsize 224 00000100:00100000:3.0:1788872994.569506:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:3.0:1788872994.569570:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1ed80 x1875765311295744 msgsize 224 00000100:00100000:3.0:1788872994.569575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:3.0:1788872994.569668:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9dfb89450 x1875765311295232 msgsize 224 00000100:00100000:3.0:1788872994.569674:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:3.0:1788872994.569676:0:3639:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788872994.569698:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1e300 x1875765311295488 msgsize 224 00000100:00100000:3.0:1788872994.569703:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:3.0:1788872994.569767:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1c380 x1875765311295616 msgsize 520 00000100:00100000:3.0:1788872994.569772:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872994.569801:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311295232 00000100:00100000:3.0:1788872994.569809:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311295232 00000020:00000040:3.0:1788872994.569823:0:94381:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db5f9 00000020:00000040:3.0:1788872994.569828:0:94381:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8ca9be000 refcount=10 00000100:00100000:0.0:1788872994.570016:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311295360 00000100:00100000:0.0:1788872994.570021:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311295360 00000020:00000040:0.0:1788872994.570023:0:66979:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db685 00000020:00000040:0.0:1788872994.570037:0:66979:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9cb5ef800 refcount=51 00000020:00000040:0.0:1788872994.570049:0:66979:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff98a9e99999c0) now 14 - evictor 00000100:00000040:0.0:1788872994.570072:0:66979:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1788872994.570095:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311295488 00000100:00100000:0.0:1788872994.570098:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311295488 00000020:00000040:0.0:1788872994.570100:0:66979:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dac7c 00000020:00000040:0.0:1788872994.570102:0:66979:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c6799800 refcount=11 00000020:00000040:0.0:1788872994.570109:0:66979:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff98a9f9df99c0) now 10 - evictor 00000100:00100000:0.0:1788872994.570130:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1540 00000100:00000040:0.0:1788872994.570134:0:66979:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9cb5ef800 : new rpc_count 1 00000100:00000040:0.0:1788872994.570142:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1c000 x1875765311295360/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:165/0 lens 224/0 e 0 to 0 dl 1788873005 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872994.570169:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2407:x1875765311295360:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000040:0.0:1788872994.570195:0:66979:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1875765311295360 00000100:00000040:0.0:1788872994.570206:0:66979:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872994.570211:0:66979:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788872994.570251:0:66979:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872994.570257:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1c000 x1875765311295360/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:165/0 lens 224/224 e 0 to 0 dl 1788873005 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872994.570265:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2407:x1875765311295360:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 100us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872994.570272:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1540 00000100:00000040:0.0:1788872994.570275:0:66979:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9cb5ef800 : new rpc_count 0 00000020:00000040:0.0:1788872994.570285:0:66979:0:(genops.c:900:class_export_put()) PUTting export ffff98a9cb5ef800 : new refcount 50 00000100:00100000:0.0:1788872994.570295:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1541 00000100:00000040:0.0:1788872994.570298:0:66979:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c6799800 : new rpc_count 1 00000100:00000040:0.0:1788872994.570302:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1e300 x1875765311295488/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:165/0 lens 224/0 e 0 to 0 dl 1788873005 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872994.570311:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2407:x1875765311295488:12345-192.168.204.39@tcp:400:kworker.0 00000100:00000040:3.0:1788872994.570409:0:94381:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788872994.570429:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 194 00000100:00000040:3.0:1788872994.570432:0:94381:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8ca9be000 : new rpc_count 1 00000100:00000040:3.0:1788872994.570435:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9dfb89450 x1875765311295232/t0(0) o400->c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp:165/0 lens 224/0 e 0 to 0 dl 1788873005 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872994.570446:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9dfb89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311295232:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000040:3.0:1788872994.570455:0:94381:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765311295232 00000100:00000040:3.0:1788872994.570459:0:94381:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872994.570462:0:94381:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872994.570478:0:94381:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872994.570482:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9dfb89450 x1875765311295232/t0(0) o400->c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp:165/0 lens 224/224 e 0 to 0 dl 1788873005 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872994.570489:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9dfb89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:2407:x1875765311295232:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 45us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872994.570495:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 194 00000100:00000040:3.0:1788872994.570497:0:94381:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8ca9be000 : new rpc_count 0 00000020:00000040:3.0:1788872994.570503:0:94381:0:(genops.c:900:class_export_put()) PUTting export ffff98a8ca9be000 : new refcount 9 00000100:00100000:3.0:1788872994.570531:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311295744 00000100:00100000:3.0:1788872994.570534:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311295744 00000020:00000040:3.0:1788872994.570536:0:26189:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dba1a 00000020:00000040:3.0:1788872994.570539:0:26189:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c2a7b000 refcount=7 00000020:00000040:3.0:1788872994.570569:0:26189:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:3.0:1788872994.570578:0:26189:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1788872994.570593:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311295616 00000100:00100000:3.0:1788872994.570596:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311295616 00000020:00000040:3.0:1788872994.570598:0:26189:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dbcba 00000100:00100000:3.0:1788872994.570628:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2793 00000100:00000040:3.0:1788872994.570636:0:26189:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9c2a7b000 : new rpc_count 1 00000100:00000040:3.0:1788872994.570642:0:26189:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1ed80 x1875765311295744/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:165/0 lens 224/0 e 0 to 0 dl 1788873005 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872994.570653:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2407:x1875765311295744:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000040:3.0:1788872994.570664:0:26189:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765311295744 00000100:00000040:3.0:1788872994.570669:0:26189:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872994.570673:0:26189:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872994.570687:0:26189:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872994.570692:0:26189:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1ed80 x1875765311295744/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:165/0 lens 224/224 e 0 to 0 dl 1788873005 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872994.570699:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2407:x1875765311295744:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 48us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872994.570705:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2793 00000100:00000040:3.0:1788872994.570707:0:26189:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9c2a7b000 : new rpc_count 0 00000020:00000040:3.0:1788872994.570713:0:26189:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c2a7b000 : new refcount 6 00000100:00100000:3.0:1788872994.570721:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6088 00000100:00000040:3.0:1788872994.570725:0:26189:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1c380 x1875765311295616/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788873014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872994.570732:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2403:x1875765311295616:12345-192.168.204.39@tcp:8:kworker.0 00010000:00020000:3.0:1788872994.570751:0:26189:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.39@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1788872994.570763:0:26189:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872994.570766:0:26189:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872994.570769:0:26189:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872994.570781:0:26189:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872994.570785:0:26189:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1c380 x1875765311295616/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872994.570799:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2403:x1875765311295616:12345-192.168.204.39@tcp:8:kworker.0 Request processed in 66us (1030us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788872994.570805:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6088 00010000:00000040:0.0:1788872994.571494:0:66979:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 77309411472, transno 0, xid 1875765311295488 00000100:00000040:0.0:1788872994.571504:0:66979:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872994.571508:0:66979:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788872994.571527:0:66979:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872994.571533:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1e300 x1875765311295488/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:165/0 lens 224/224 e 0 to 0 dl 1788873005 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872994.571541:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2407:x1875765311295488:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 1231us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872994.571576:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1541 00000100:00000040:0.0:1788872994.571578:0:66979:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c6799800 : new rpc_count 0 00000020:00000040:0.0:1788872994.571585:0:66979:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c6799800 : new refcount 10 00000100:00080000:0.0:1788872994.571607:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788872994.571612:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00080000:0.0:1788872994.571615:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1788872994.571617:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff98a9f9df99c0) now 10 - evictor 00000100:00080000:0.0:1788872994.571619:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1788872994.571621:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff98a9e99999c0) now 14 - evictor 00010000:00010000:3.0:1788872995.134159:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788872996.154349:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872997.181895:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788872997.544922:0:96948:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788872997.544927:0:96948:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788872997.544928:0:96948:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788872997.545064:0:96948:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98a9fbfad000 00000020:01000004:2.0:1788872997.545082:0:96948:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788872997.545100:0:96948:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788872997.545115:0:96948:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98a9e9b0cd40) 00000020:00000040:2.0:1788872997.545123:0:96948:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a9e7bfb000 with handle 0xe4e6e89fb01dc5ce to hash 00000020:00000040:2.0:1788872997.545130:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff98a9e7bfb000 : new refcount 1 00000020:00000040:2.0:1788872997.545139:0:96948:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff98a9e9b0cd40) now 2 - obd_device_list 00000020:00000080:2.0:1788872997.545143:0:96948:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000020:00000040:0.0:1788872997.561245:0:75631:0:(genops.c:1231:class_import_get()) import ffff98a9dfe90800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1788872997.561293:0:75631:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000406a2dd7] to pc [ptlrpcd_00_00+0] req@ffff98a9df5aea00 x1875765327891328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872997.561337:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:0.0:1788872997.561353:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df5aea00 x1875765327891328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872997.561373:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327891328:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1788872997.561406:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df5aea00 x1875765327891328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873013 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872997.561414:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872997.561494:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5af100 x1875765327891328 msgsize 224 00000100:00100000:0.0:1788872997.561499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872997.561529:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df5aea00 x1875765327891328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873013 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872997.561542:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 7133 usecs (8 jiffies) 00000100:00100000:0.0:1788872997.561588:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327891328 00000100:00100000:0.0:1788872997.561596:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327891328 00000020:00000040:0.0:1788872997.561599:0:8439:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d553b 00000020:00000040:0.0:1788872997.561603:0:8439:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c45cb000 refcount=5 00000020:00000040:0.0:1788872997.561626:0:8439:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:0.0:1788872997.561658:0:8439:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1788872997.561687:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2256 00000100:00000040:0.0:1788872997.561692:0:8439:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9c45cb000 : new rpc_count 1 00000100:00000040:0.0:1788872997.561697:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5af100 x1875765327891328/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:168/0 lens 224/0 e 0 to 0 dl 1788873008 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872997.561710:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327891328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788872997.561742:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00010000:00000040:0.0:1788872997.561766:0:8439:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875765327891328 00000100:00000040:0.0:1788872997.561776:0:8439:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:0.0:1788872997.561782:0:8439:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872997.561802:0:8439:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9df5aea00 x1875765327891328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873013 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872997.561821:0:8439:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:0.0:1788872997.561826:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5af100 x1875765327891328/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:168/0 lens 224/368 e 0 to 0 dl 1788873008 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872997.561834:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875765327891328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872997.561840:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2256 00000100:00000040:0.0:1788872997.561843:0:8439:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9c45cb000 : new rpc_count 0 00000020:00000040:0.0:1788872997.561851:0:8439:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c45cb000 : new refcount 4 00000100:00080000:0.0:1788872997.561865:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788872997.561868:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:0.0:1788872997.561897:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:0.0:1788872997.561902:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df5aea00 x1875765327891328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788872997.561912:0:3645:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1788872997.561922:0:3645:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1788872997.561930:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5aea00 x1875765327891328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873013 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872997.561938:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327891328:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1788872997.561944:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df5aea00 x1875765327891328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873013 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872997.561954:0:3645:0:(genops.c:1244:class_import_put()) import ffff98a9dfe90800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000001:00000040:1.0:1788872998.191371:0:96948:0:(osd_compat.c:233:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:1.0:1788872998.199623:0:96948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788872998.202193:0:96948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788872998.202233:0:96948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788872998.202262:0:96948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788872998.202289:0:96948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788872998.202316:0:96948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00010000:00010000:3.0:1788872998.202340:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788872998.202343:0:96948:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1788872998.202757:0:96948:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:1.0:1788872998.203385:0:96948:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff98a9e9b0cd40) now 3 - setup 00000020:00000080:1.0:1788872998.203390:0:96948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788872998.203402:0:96948:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000040:1.0:1788872998.203408:0:96948:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a9e99a3000 with handle 0xe4e6e89fb01dc5d5 to hash 00000020:00000040:1.0:1788872998.203415:0:96948:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff98a9e9b0cd40) now 4 - export 00000020:00000040:1.0:1788872998.203419:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff98a9e99a3000 : new refcount 1 00000020:00000080:1.0:1788872998.203421:0:96948:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe4e6e89fb01dc5d5 00000020:00000040:1.0:1788872998.203424:0:96948:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc5d5 00000020:00000040:1.0:1788872998.203427:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9e99a3000 refcount=2 00000020:01000004:1.0:1788872998.203432:0:96948:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788872998.203455:0:96948:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.139@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788872998.203458:0:96948:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788872998.203464:0:96948:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788872998.203493:0:96948:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788872998.203497:0:96948:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:1.0:1788872998.206292:0:96948:0:(genops.c:889:class_export_get()) GET export ffff98a9e7bfb000 refcount=2 00000040:00000040:1.0:1788872998.206302:0:96948:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a9ef3e2180 : new refcount 2 00000040:00000040:1.0:1788872998.208749:0:96948:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a9ef3e2180 : new refcount 1 00000040:01000000:1.0:1788872998.208756:0:96948:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.139@tcp ctxt 0 is initialized 10000000:00000040:1.0:1788872998.208765:0:96948:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a9ef3e2180 : new refcount 2 10000000:00000040:1.0:1788872998.208767:0:96948:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a9ef3e2180 : new refcount 1 00000020:00000040:1.0:1788872998.208770:0:96948:0:(obd_config.c:994:class_incref()) incref MGC192.168.204.139@tcp (ffff98a9e9b999c0) now 6 - mgc_fs 00000020:01000004:1.0:1788872998.210116:0:96948:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.139@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788872998.210123:0:96948:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788872998.210125:0:96948:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788872998.210126:0:96948:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872998.210127:0:96948:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872998.210129:0:96948:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872998.210130:0:96948:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872998.210132:0:96948:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788872998.210134:0:96948:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872998.210318:0:96948:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788872998.210323:0:96948:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788872998.210326:0:96948:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788872998.210327:0:96948:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788872998.210328:0:96948:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788872998.210329:0:96948:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788872998.210331:0:96948:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788872998.210332:0:96948:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788872998.210333:0:96948:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788872998.210334:0:96948:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788872998.210336:0:96948:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:1.0:1788872998.210345:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 10000000:01000000:1.0:1788872998.210374:0:96948:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:1.0:1788872998.210394:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ee81dc00 x1875765327891456/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.210409:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327891456:0@lo:253:mount.lustre.0 00000100:00000040:1.0:1788872998.210441:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ee81dc00 x1875765327891456/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.210450:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.210492:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f67cd050 x1875765327891456 msgsize 4848 00000100:00100000:1.0:1788872998.210497:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872998.210499:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788872998.210622:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9ee81dc00 x1875765327891456/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.210652:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872998.212978:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327891456 00000100:00100000:0.0:1788872998.212995:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327891456 00000020:00000040:0.0:1788872998.212999:0:94376:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:0.0:1788872998.213005:0:94376:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=21 00000100:00000040:0.0:1788872998.213044:0:94376:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788872998.213116:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:0.0:1788872998.213122:0:94376:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:0.0:1788872998.213129:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f67cd050 x1875765327891456/t0(0) o253->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 4848/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.213144:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:96948:x1875765327891456:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788872998.213182:0:94376:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788872998.213185:0:94376:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788872998.213190:0:94376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:0.0:1788872998.216004:0:94376:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327891456 00000100:00000040:0.0:1788872998.216025:0:94376:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:0.0:1788872998.216034:0:94376:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.216095:0:94376:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff98a9ee81dc00 x1875765327891456/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.216360:0:94376:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:0.0:1788872998.216367:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f67cd050 x1875765327891456/t0(0) o253->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 4848/4768 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.216396:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:96948:x1875765327891456:12345-0@lo:253:mount.lustre.0 Request processed in 3255us (5902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872998.216407:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:0.0:1788872998.216411:0:94376:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:0.0:1788872998.216423:0:94376:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 20 00000100:00000040:2.0:1788872998.219022:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ee81dc00 x1875765327891456/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.219039:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81dc00 x1875765327891456/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.219047:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327891456:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1788872998.219057:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ee81dc00 x1875765327891456/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788872998.219072:0:96948:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788872998.219076:0:96948:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788872998.219078:0:96948:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788872998.219079:0:96948:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872998.219080:0:96948:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872998.219081:0:96948:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872998.219083:0:96948:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872998.219100:0:96948:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788872998.219102:0:96948:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872998.219104:0:96948:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:2.0:1788872998.219108:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ee81dc00 x1875765327891456/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.219119:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000020:01000004:3.0:1788872998.221970:0:96948:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98a9fbfad000 from lustre-OST0000 10000000:01000000:3.0:1788872998.222013:0:96948:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788872998.222016:0:96948:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:3.0:1788872998.222026:0:96948:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff98a9c568a000) refs 5 10000000:01000000:3.0:1788872998.222029:0:96948:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98a9e9b999c0 local copy 00000020:00000040:3.0:1788872998.222035:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8c52ae400 refcount=2 00010000:00010000:3.0:1788872998.222044:0:96948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01dbbe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbe8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1788872998.222070:0:96948:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a9ca25d240 : new refcount 2 10000000:00000040:3.0:1788872998.222073:0:96948:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a9ef3e2180 : new refcount 2 10000000:00000040:3.0:1788872998.222075:0:96948:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.139@tcp: copy local log lustre-sptlrpc 00000020:00000040:3.0:1788872998.222118:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:3.0:1788872998.222124:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:3.0:1788872998.222159:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1dc00 x1875765327891584/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.222172:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327891584:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788872998.222198:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1dc00 x1875765327891584/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.222206:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.222250:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f67cc850 x1875765327891584 msgsize 512 00000100:00100000:3.0:1788872998.222254:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872998.222268:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788872998.222291:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9f5c1dc00 x1875765327891584/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.222319:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d0d95900 going to sleep for 11 seconds 00000100:00100000:1.0:1788872998.222503:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327891584 00000100:00100000:1.0:1788872998.222511:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327891584 00000020:00000040:1.0:1788872998.222514:0:94377:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:1.0:1788872998.222518:0:94377:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=21 00000100:00000040:1.0:1788872998.222536:0:94377:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788872998.222581:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:1.0:1788872998.222586:0:94377:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:1.0:1788872998.222591:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f67cc850 x1875765327891584/t0(0) o501->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 512/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.222604:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:96948:x1875765327891584:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1788872998.222624:0:94377:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:1.0:1788872998.222627:0:94377:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:1.0:1788872998.222650:0:94377:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00010000:00000040:1.0:1788872998.222655:0:94377:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327891584 00000100:00000040:1.0:1788872998.222664:0:94377:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872998.222668:0:94377:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.222687:0:94377:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff98a9f5c1dc00 x1875765327891584/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.222723:0:94377:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872998.222729:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f67cc850 x1875765327891584/t0(0) o501->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 512/272 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.222739:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:96948:x1875765327891584:12345-0@lo:501:mount.lustre.0 Request processed in 137us (487us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788872998.222746:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:1.0:1788872998.222749:0:94377:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:1.0:1788872998.222766:0:94377:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 20 00000100:00000040:2.0:1788872998.222917:0:96948:0:(client.c:1497:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff98a9f5c1dc00 x1875765327891584/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.222927:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1dc00 x1875765327891584/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.222936:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1dc00 x1875765327891584/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.222942:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327891584:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1788872998.222949:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1dc00 x1875765327891584/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.222967:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000100:00000040:2.0:1788872998.222972:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1dc00 x1875765327891584/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.222980:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 10000000:01000000:2.0:1788872998.222988:0:96948:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788872998.223013:0:96948:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:2.0:1788872998.223017:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8c52ae400 refcount=3 00010000:00010000:2.0:1788872998.223021:0:96948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01dbbe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbe8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872998.223029:0:96948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01dbbe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dbbe8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788872998.223068:0:96948:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98a9fbfad000 10000000:01000000:2.0:1788872998.223073:0:96948:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:2.0:1788872998.223078:0:96948:0:(genops.c:889:class_export_get()) GET export ffff98a9e98d1800 refcount=18 10000000:00000040:2.0:1788872998.223081:0:96948:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff98a9c5c14e00) refs 4 10000000:01000000:2.0:1788872998.223083:0:96948:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788872998.223086:0:96948:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:2.0:1788872998.223088:0:96948:0:(genops.c:889:class_export_get()) GET export ffff98a9e98d1800 refcount=19 10000000:01000000:2.0:1788872998.223092:0:96948:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788872998.223095:0:96948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:2.0:1788872998.223099:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00010000:00000040:2.0:1788872998.223112:0:96948:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a9f016a900 count: 8 00000020:00000040:2.0:1788872998.223119:0:96948:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a8c4839a00 with handle 0xe4e6e89fb01dc5dc to hash 00010000:00010000:2.0:1788872998.223124:0:96948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4839a00/0xe4e6e89fb01dc5dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872998.223131:0:96948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4839a00/0xe4e6e89fb01dc5dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872998.223140:0:96948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4839a00/0xe4e6e89fb01dc5dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788872998.223155:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a8c9fe5500 x1875765327891712/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.223164:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327891712:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1788872998.223177:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a8c9fe5500 x1875765327891712/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.223183:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872998.223202:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f67ce850 x1875765327891712 msgsize 328 00000100:00100000:2.0:1788872998.223212:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872998.223214:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788872998.223240:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a8c9fe5500 x1875765327891712/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.223258:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c1cb29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872998.223327:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327891712 00000100:00100000:0.0:1788872998.223332:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327891712 00000020:00000040:0.0:1788872998.223334:0:94382:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:0.0:1788872998.223337:0:94382:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=21 00000100:00000040:0.0:1788872998.223350:0:94382:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788872998.223374:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:0.0:1788872998.223377:0:94382:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:0.0:1788872998.223381:0:94382:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f67ce850 x1875765327891712/t0(0) o101->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.223390:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+21:96948:x1875765327891712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788872998.223400:0:94382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1788872998.223407:0:94382:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a9c1358e00 count: 10 00000020:00000040:0.0:1788872998.223413:0:94382:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a8cc3e7400 with handle 0xe4e6e89fb01dc5e3 to hash 00010000:00010000:0.0:1788872998.223416:0:94382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8cc3e7400/0xe4e6e89fb01dc5e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dc5dc expref: -99 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.223422:0:94382:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff98a8c2645800 : new locks_count 16 00000020:00000040:0.0:1788872998.223424:0:94382:0:(genops.c:889:class_export_get()) GET export ffff98a8c2645800 refcount=22 00010000:00000040:0.0:1788872998.223438:0:94382:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff98a9c1358e00) refcount = 10 00010000:00000040:0.0:1788872998.223442:0:94382:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1788872998.223449:0:94382:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbbf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb24d expref: 9 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.223467:0:94382:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c52ae600/0xe4e6e89fb01dbbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb246 expref: 9 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.223473:0:94382:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98aa002a4600/0xe4e6e89fb01dbbe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbe1 expref: 22 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.223480:0:94382:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a9caa1b000/0xe4e6e89fb01dbbbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbb7 expref: 22 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.223486:0:94382:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a9caa1bc00/0xe4e6e89fb01dbbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbba9 expref: 22 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.223493:0:94382:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01dbba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb9b expref: 22 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.223499:0:94382:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c449aa00/0xe4e6e89fb01dbb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb8d expref: 22 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.223505:0:94382:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98aa002a5400/0xe4e6e89fb01dbb86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb7f expref: 22 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.223510:0:94382:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a9caa1b600/0xe4e6e89fb01dbb78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb71 expref: 22 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.223516:0:94382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8cc3e7400/0xe4e6e89fb01dc5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dc5dc expref: 22 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.223527:0:94382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8cc3e7400/0xe4e6e89fb01dc5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dc5dc expref: 22 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.223535:0:94382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8cc3e7400, rc 0) 00010000:00000040:0.0:1788872998.223538:0:94382:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327891712 00000100:00000040:0.0:1788872998.223571:0:94382:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:0.0:1788872998.223575:0:94382:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.223594:0:94382:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff98a8c9fe5500 x1875765327891712/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.223628:0:94382:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:0.0:1788872998.223633:0:94382:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f67ce850 x1875765327891712/t0(0) o101->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/344 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.223641:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:96948:x1875765327891712:12345-0@lo:101:mount.lustre.0 Request processed in 252us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872998.223647:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:0.0:1788872998.223650:0:94382:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:0.0:1788872998.223658:0:94382:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 21 00000100:00000040:2.0:1788872998.223727:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a8c9fe5500 x1875765327891712/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.223748:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe5500 x1875765327891712/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.223756:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327891712:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1788872998.223762:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a8c9fe5500 x1875765327891712/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.223771:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8c4839a00 refcount=4 00010000:00000040:2.0:1788872998.223775:0:96948:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff98a8c4839a00, remote cookie: 0xe4e6e89fb01dc5e3, flags: 0x0 00010000:00000040:2.0:1788872998.223911:0:96948:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff98a9f016a900) refcount = 8 00010000:00000040:2.0:1788872998.223914:0:96948:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1788872998.223917:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01dbbe1 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbe8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788872998.223924:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98aa002a4e00/0xe4e6e89fb01dbbb7 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbbe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788872998.223930:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01dbba9 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbb0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788872998.223937:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98aa002a5000/0xe4e6e89fb01dbb9b lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbba2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788872998.223942:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a600/0xe4e6e89fb01dbb8d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb94 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788872998.223966:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a400/0xe4e6e89fb01dbb7f lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788872998.223973:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98aa002a5e00/0xe4e6e89fb01dbb71 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872998.223979:0:96948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4839a00/0xe4e6e89fb01dc5dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc5e3 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872998.223989:0:96948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4839a00/0xe4e6e89fb01dc5dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dc5e3 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788872998.223998:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a8c9fe5500 x1875765327891712/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.224008:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 10000000:00000040:2.0:1788872998.224014:0:96948:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff98aa00127200) refs 2 00000020:00000040:2.0:1788872998.224017:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8c4839a00 refcount=3 10000000:00000040:2.0:1788872998.224040:0:96948:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a9ca25d240 : new refcount 2 10000000:00000040:2.0:1788872998.224043:0:96948:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a9ef3e2180 : new refcount 2 10000000:00000040:2.0:1788872998.224045:0:96948:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.139@tcp: copy local log lustre-OST0000 00000040:00080000:2.0:1788872998.224189:0:96948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788872998.224516:0:96948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788872998.227988:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788872998.228037:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788872998.228052:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788872998.228065:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788872998.228078:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788872998.228091:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788872998.228113:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788872998.228119:0:96948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:2.0:1788872998.228264:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:2.0:1788872998.228271:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:2.0:1788872998.228309:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a8c9fe5500 x1875765327891840/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.228325:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327891840:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1788872998.228351:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a8c9fe5500 x1875765327891840/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.228360:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872998.228403:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f67cec50 x1875765327891840 msgsize 512 00000100:00100000:2.0:1788872998.228408:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872998.228411:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788872998.228438:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a8c9fe5500 x1875765327891840/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.228466:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c1cb2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788872998.229049:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327891840 00000100:00100000:0.0:1788872998.229058:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327891840 00000020:00000040:0.0:1788872998.229061:0:94376:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:0.0:1788872998.229065:0:94376:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=22 00000100:00000040:0.0:1788872998.229089:0:94376:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788872998.229124:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00000040:0.0:1788872998.229262:0:94376:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:0.0:1788872998.229270:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f67cec50 x1875765327891840/t0(0) o501->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 512/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.229283:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:96948:x1875765327891840:12345-0@lo:501:mount.lustre.0 00000040:00000040:0.0:1788872998.229304:0:94376:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:0.0:1788872998.229307:0:94376:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:0.0:1788872998.229414:0:94376:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00000020:00000040:0.0:1788872998.229424:0:94376:0:(genops.c:889:class_export_get()) GET export ffff98a8c2645800 refcount=23 00000020:00000040:0.0:1788872998.229427:0:94376:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 22 00010000:00000040:0.0:1788872998.229432:0:94376:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327891840 00000100:00000040:0.0:1788872998.229440:0:94376:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:0.0:1788872998.229455:0:94376:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.229484:0:94376:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff98a8c9fe5500 x1875765327891840/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.229520:0:94376:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:0.0:1788872998.229526:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f67cec50 x1875765327891840/t0(0) o501->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 512/272 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.229535:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:96948:x1875765327891840:12345-0@lo:501:mount.lustre.0 Request processed in 255us (1130us total) trans 0 rc 0/0 00000100:00000040:2.0:1788872998.229622:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a8c9fe5500 x1875765327891840/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.229632:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe5500 x1875765327891840/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.229640:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327891840:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1788872998.229648:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a8c9fe5500 x1875765327891840/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.229658:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000100:00000040:2.0:1788872998.229663:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a8c9fe5500 x1875765327891840/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.229672:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000020:00000040:2.0:1788872998.229684:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:2.0:1788872998.229687:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:2.0:1788872998.229709:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a8c9fe5500 x1875765327891968/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.229720:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327891968:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1788872998.229745:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a8c9fe5500 x1875765327891968/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.229753:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872998.229769:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f67cdc50 x1875765327891968 msgsize 272 00000100:00100000:2.0:1788872998.229773:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872998.229775:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 62 buffers still posted 00000100:00000040:2.0:1788872998.229790:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a8c9fe5500 x1875765327891968/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.229809:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c1cb2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788872998.231719:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327891968 00000100:00100000:3.0:1788872998.231734:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327891968 00000020:00000040:3.0:1788872998.231737:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:3.0:1788872998.231742:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=23 00000100:00100000:0.0:1788872998.232940:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00000040:0.0:1788872998.232947:0:94376:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:0.0:1788872998.232974:0:94376:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 22 00000100:00100000:3.0:1788872998.235701:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00000040:3.0:1788872998.235710:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:3.0:1788872998.235721:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f67cdc50 x1875765327891968/t0(0) o503->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.235748:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:96948:x1875765327891968:12345-0@lo:503:mount.lustre.0 00000040:00000040:3.0:1788872998.235801:0:94375:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:3.0:1788872998.235858:0:94375:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00010000:00000040:3.0:1788872998.235864:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327891968 00000100:00000040:3.0:1788872998.235876:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872998.235883:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.235942:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff98a8c9fe5500 x1875765327891968/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.236036:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:3.0:1788872998.236042:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f67cdc50 x1875765327891968/t0(0) o503->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/8416 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.236052:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:96948:x1875765327891968:12345-0@lo:503:mount.lustre.0 Request processed in 317us (6281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872998.236060:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00000040:3.0:1788872998.236063:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:3.0:1788872998.236073:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 21 00000100:00000040:2.0:1788872998.239570:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a8c9fe5500 x1875765327891968/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.239587:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe5500 x1875765327891968/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.239594:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327891968:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1788872998.239604:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a8c9fe5500 x1875765327891968/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.239620:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a8c9fe5500 x1875765327891968/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.239644:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:2.0:1788872998.239654:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000040:00080000:2.0:1788872998.240130:0:96948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:2.0:1788872998.240186:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:2.0:1788872998.240191:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:2.0:1788872998.240223:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a8c9fe5500 x1875765327892096/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.240248:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892096:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788872998.240288:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a8c9fe5500 x1875765327892096/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.240296:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872998.240339:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f67ce050 x1875765327892096 msgsize 272 00000100:00100000:2.0:1788872998.240343:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872998.240345:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788872998.240377:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a8c9fe5500 x1875765327892096/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.240405:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c1cb29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788872998.240910:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327892096 00000100:00100000:3.0:1788872998.240919:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327892096 00000020:00000040:3.0:1788872998.240922:0:94381:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:3.0:1788872998.240927:0:94381:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=22 00000100:00000040:3.0:1788872998.240946:0:94381:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788872998.240987:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00000040:3.0:1788872998.240991:0:94381:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:3.0:1788872998.240996:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f67ce050 x1875765327892096/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.241007:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:96948:x1875765327892096:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1788872998.241037:0:94381:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:3.0:1788872998.242105:0:94381:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00010000:00000040:3.0:1788872998.242114:0:94381:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327892096 00000100:00000040:3.0:1788872998.242125:0:94381:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872998.242131:0:94381:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.242175:0:94381:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff98a8c9fe5500 x1875765327892096/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.242208:0:94381:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:3.0:1788872998.242213:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f67ce050 x1875765327892096/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/8472 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.242223:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:96948:x1875765327892096:12345-0@lo:502:mount.lustre.0 Request processed in 1217us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872998.242231:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00000040:3.0:1788872998.242234:0:94381:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:3.0:1788872998.242243:0:94381:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 21 00000100:00000040:2.0:1788872998.242459:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a8c9fe5500 x1875765327892096/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.242469:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe5500 x1875765327892096/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.242477:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892096:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788872998.242484:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a8c9fe5500 x1875765327892096/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.242498:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a8c9fe5500 x1875765327892096/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.242513:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:2.0:1788872998.242520:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000040:00080000:2.0:1788872998.242734:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788872998.243317:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788872998.243338:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788872998.243353:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788872998.243368:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788872998.243397:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788872998.243421:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788872998.243436:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788872998.243448:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788872998.243460:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788872998.243475:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788872998.243489:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:2.0:1788872998.243498:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:2.0:1788872998.243504:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:2.0:1788872998.243536:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a8c9fe5500 x1875765327892224/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.243576:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892224:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788872998.243611:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a8c9fe5500 x1875765327892224/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.243619:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872998.243653:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f67cc050 x1875765327892224 msgsize 272 00000100:00100000:2.0:1788872998.243658:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872998.243660:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788872998.243757:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a8c9fe5500 x1875765327892224/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.243783:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c1cb29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788872998.244013:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327892224 00000100:00100000:0.0:1788872998.244021:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327892224 00000020:00000040:0.0:1788872998.244024:0:94376:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:0.0:1788872998.244029:0:94376:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=22 00000100:00000040:0.0:1788872998.244049:0:94376:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788872998.244117:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00000040:0.0:1788872998.244121:0:94376:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:0.0:1788872998.244127:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f67cc050 x1875765327892224/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.244139:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:96948:x1875765327892224:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1788872998.244168:0:94376:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:0.0:1788872998.244238:0:94376:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00010000:00000040:0.0:1788872998.244243:0:94376:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327892224 00000100:00000040:0.0:1788872998.244252:0:94376:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:0.0:1788872998.244257:0:94376:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.244282:0:94376:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff98a8c9fe5500 x1875765327892224/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.244331:0:94376:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:0.0:1788872998.244336:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f67cc050 x1875765327892224/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/8472 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.244344:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:96948:x1875765327892224:12345-0@lo:502:mount.lustre.0 Request processed in 208us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872998.244350:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00000040:0.0:1788872998.244353:0:94376:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:0.0:1788872998.244361:0:94376:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 21 00000100:00000040:3.0:1788872998.244442:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a8c9fe5500 x1875765327892224/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.244452:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe5500 x1875765327892224/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.244465:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892224:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788872998.244472:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a8c9fe5500 x1875765327892224/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.244483:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a8c9fe5500 x1875765327892224/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872998.244496:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:3.0:1788872998.244503:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000040:00080000:3.0:1788872998.244543:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788872998.244581:0:96948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:3.0:1788872998.244859:0:96948:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a9ca25d240 : new refcount 1 00000020:00000040:3.0:1788872998.244864:0:96948:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:3.0:1788872998.245295:0:96952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788872998.245304:0:96952:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788872998.245309:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872998.245312:0:96952:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788872998.245318:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788872998.245332:0:96952:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98a8c1cfcd40) 00000020:00000040:3.0:1788872998.245338:0:96952:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a9e0219000 with handle 0xe4e6e89fb01dc5ea to hash 00000020:00000040:3.0:1788872998.245344:0:96952:0:(genops.c:900:class_export_put()) PUTting export ffff98a9e0219000 : new refcount 1 00000020:00000040:3.0:1788872998.245357:0:96952:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 2 - obd_device_list 00000020:00000080:3.0:1788872998.245363:0:96952:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:3.0:1788872998.245367:0:96952:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:3.0:1788872998.245370:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788872998.245431:0:96952:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9fbfad000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788872998.245439:0:96952:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000040:3.0:1788872998.245443:0:96952:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a8ca9bc800 with handle 0xe4e6e89fb01dc5f1 to hash 00000020:00000040:3.0:1788872998.245446:0:96952:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff98a9e9b0cd40) now 5 - export 00000020:00000040:3.0:1788872998.245449:0:96952:0:(genops.c:900:class_export_put()) PUTting export ffff98a8ca9bc800 : new refcount 1 00000020:00000080:3.0:1788872998.245457:0:96952:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe4e6e89fb01dc5f1 00000020:00000040:3.0:1788872998.245460:0:96952:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc5f1 00000020:00000040:3.0:1788872998.245462:0:96952:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8ca9bc800 refcount=2 00010000:00010000:3.0:1788872998.249466:0:96952:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:3.0:1788872998.249479:0:96952:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 707, crc32c 5239, adler 565, t10ip512 2923, t10ip4k 5723, t10crc512 1167, t10crc4k 690 00002000:00000040:3.0:1788872998.249521:0:96952:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:3.0:1788872998.249884:0:96952:0:(tgt_lastrcvd.c:685:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969456: rc = 0 00000001:00000040:3.0:1788872998.249890:0:96952:0:(tgt_lastrcvd.c:1991:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:3.0:1788872998.249898:0:96952:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294969455, last_xid = 1875765327787392, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1788872998.249903:0:96952:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294969455 srv lr: 4294969456 lx: 1875765327787392 gen 0 00000020:00000040:3.0:1788872998.249914:0:96952:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a9ee83f800 with handle 0xe4e6e89fb01dc5f8 to hash 00000020:00000040:3.0:1788872998.249940:0:96952:0:(genops.c:889:class_export_get()) GET export ffff98a9ee83f800 refcount=3 00000020:00000040:3.0:1788872998.249945:0:96952:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 3 - export 00000001:00000040:3.0:1788872998.249949:0:96952:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:3.0:1788872998.249952:0:96952:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ee83f800 : new refcount 2 00000001:00000040:3.0:1788872998.249995:0:96952:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294969473, last_xid = 1875765327875584, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1788872998.249999:0:96952:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294969473 srv lr: 4294969456 lx: 1875765327875584 gen 0 00000020:00000040:3.0:1788872998.250004:0:96952:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a8c3948000 with handle 0xe4e6e89fb01dc5ff to hash 00000020:00000040:3.0:1788872998.250015:0:96952:0:(genops.c:889:class_export_get()) GET export ffff98a8c3948000 refcount=3 00000020:00000040:3.0:1788872998.250017:0:96952:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 4 - export 00000001:00000040:3.0:1788872998.250020:0:96952:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:3.0:1788872998.250022:0:96952:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c3948000 : new refcount 2 00000001:00000040:3.0:1788872998.250027:0:96952:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:3.0:1788872998.250030:0:96952:0:(tgt_lastrcvd.c:1736:tgt_clients_data_init()) skipping zeroed client at offset 2 00000001:00000040:3.0:1788872998.250040:0:96952:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = 0804304d-5904-48ad-87f2-bcbc7642a62a, last_transno = 4294969477, last_xid = 1875765311260288, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1788872998.250043:0:96952:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 0804304d-5904-48ad-87f2-bcbc7642a62a idx: 3 lr: 4294969477 srv lr: 4294969456 lx: 1875765311260288 gen 0 00000020:00000040:3.0:1788872998.250049:0:96952:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a8c394c000 with handle 0xe4e6e89fb01dc606 to hash 00000020:00000040:3.0:1788872998.250058:0:96952:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=3 00000020:00000040:3.0:1788872998.250060:0:96952:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 5 - export 00000001:00000040:3.0:1788872998.250062:0:96952:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 3 with UUID '0804304d-5904-48ad-87f2-bcbc7642a62a' added, generation 0 00000020:00000040:3.0:1788872998.250065:0:96952:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 2 00000001:00000004:3.0:1788872998.250069:0:96952:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294969477 00000001:00000040:3.0:1788872998.250116:0:96952:0:(tgt_lastrcvd.c:707:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969477: rc = 0 00000001:00000040:3.0:1788872998.250417:0:96952:0:(tgt_lastrcvd.c:761:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969477: rc = 0 00002000:00000040:3.0:1788872998.250434:0:96952:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:3.0:1788872998.250478:0:96952:0:(fid_store.c:167:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:3.0:1788872998.250536:0:96952:0:(fid_handler.c:58:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:3.0:1788872998.250544:0:96952:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:3.0:1788872998.250614:0:96952:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:3.0:1788872998.250654:0:96952:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:3.0:1788872998.250663:0:96952:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:3.0:1788872998.250707:0:96952:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:3.0:1788872998.250725:0:96952:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:3.0:1788872998.250768:0:96952:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:3.0:1788872998.250896:0:96952:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:3.0:1788872998.250924:0:96952:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:3.0:1788872998.251287:0:96952:0:(ofd_dev.c:466:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:3.0:1788872998.251487:0:96952:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:1.0:1788872998.252873:0:96952:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 6 - setup 00000020:00000080:1.0:1788872998.252878:0:96952:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788872998.252889:0:96952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872998.252895:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872998.252897:0:96952:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788872998.252901:0:96952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788872998.252904:0:96952:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788872998.252905:0:96952:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788872998.252907:0:96952:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788872998.252908:0:96952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788872998.252911:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872998.252913:0:96952:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788872998.252915:0:96952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788872998.252918:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872998.252919:0:96952:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788872998.252923:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788872998.252925:0:96952:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788872998.252927:0:96952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872998.252929:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872998.252930:0:96952:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788872998.252932:0:96952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788872998.252935:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872998.252936:0:96952:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788872998.252939:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788872998.252976:0:96952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788872998.252979:0:96952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788872998.252980:0:96952:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788872998.252984:0:96952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788872998.253236:0:96948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788872998.253272:0:96948:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:3.0:1788872998.254151:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8c4839a00 refcount=3 00010000:00010000:3.0:1788872998.254175:0:96948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4839a00/0xe4e6e89fb01dc5dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc5e3 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.254188:0:96948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4839a00/0xe4e6e89fb01dc5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc5e3 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872998.254197:0:96948:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98a9fbfad000 from 1 10000000:01000000:3.0:1788872998.254200:0:96948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:3.0:1788872998.254208:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00010000:00000040:3.0:1788872998.254232:0:96948:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a9faf66a00 count: 4 00000020:00000040:3.0:1788872998.254240:0:96948:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a9fa898a00 with handle 0xe4e6e89fb01dc60d to hash 00010000:00010000:3.0:1788872998.254248:0:96948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01dc60d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.254256:0:96948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01dc60d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.254268:0:96948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01dc60d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788872998.254293:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1f800 x1875765327892352/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.254307:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892352:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1788872998.254340:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1f800 x1875765327892352/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.254349:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.254390:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f67cf850 x1875765327892352 msgsize 328 00000100:00100000:3.0:1788872998.254395:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872998.254397:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788872998.254424:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9f5c1f800 x1875765327892352/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.254457:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c54923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872998.254833:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327892352 00000100:00100000:1.0:1788872998.254842:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327892352 00000020:00000040:1.0:1788872998.254845:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:1.0:1788872998.254848:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=22 00000100:00000040:1.0:1788872998.254868:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788872998.254902:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00000040:1.0:1788872998.254907:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:1.0:1788872998.254911:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f67cf850 x1875765327892352/t0(0) o101->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.254922:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:96948:x1875765327892352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788872998.254935:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1788872998.254944:0:94375:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a8ca102e00 count: 5 00000020:00000040:1.0:1788872998.254949:0:94375:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98aa002a5800 with handle 0xe4e6e89fb01dc614 to hash 00010000:00010000:1.0:1788872998.254964:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa002a5800/0xe4e6e89fb01dc614 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dc60d expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788872998.254972:0:94375:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff98a8c2645800 : new locks_count 17 00000020:00000040:1.0:1788872998.254975:0:94375:0:(genops.c:889:class_export_get()) GET export ffff98a8c2645800 refcount=23 00010000:00000040:1.0:1788872998.254992:0:94375:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff98a8ca102e00) refcount = 5 00010000:00000040:1.0:1788872998.254995:0:94375:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1788872998.254999:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a9fa899e00/0xe4e6e89fb01db7ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db7a4 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788872998.255005:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c4f9c200/0xe4e6e89fb01db781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db77a expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788872998.255012:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c4f9d800/0xe4e6e89fb01db70a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db703 expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788872998.255021:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c52aee00/0xe4e6e89fb01db60e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1dd expref: 9 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872998.255027:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa002a5800/0xe4e6e89fb01dc614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dc60d expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872998.255037:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa002a5800/0xe4e6e89fb01dc614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dc60d expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872998.255052:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa002a5800, rc 0) 00010000:00000040:1.0:1788872998.255056:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327892352 00000100:00000040:1.0:1788872998.255066:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872998.255071:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.255093:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff98a9f5c1f800 x1875765327892352/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.255121:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872998.255135:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f67cf850 x1875765327892352/t0(0) o101->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/344 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.255144:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:96948:x1875765327892352:12345-0@lo:101:mount.lustre.0 Request processed in 224us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872998.255151:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00000040:1.0:1788872998.255154:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:1.0:1788872998.255163:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 22 00000100:00000040:2.0:1788872998.258076:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1f800 x1875765327892352/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.258092:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1f800 x1875765327892352/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.258100:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892352:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1788872998.258109:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1f800 x1875765327892352/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.258140:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a9fa898a00 refcount=4 00010000:00000040:2.0:1788872998.258149:0:96948:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff98a9fa898a00, remote cookie: 0xe4e6e89fb01dc614, flags: 0x0 00010000:00000040:2.0:1788872998.258157:0:96948:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff98a9faf66a00) refcount = 4 00010000:00000040:2.0:1788872998.258160:0:96948:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1788872998.258164:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a9efac5000/0xe4e6e89fb01db7a4 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db7ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788872998.258174:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a9fa899800/0xe4e6e89fb01db77a lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788872998.258180:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a9fa899600/0xe4e6e89fb01db703 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01db70a expref: -99 pid: 94369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872998.258197:0:96948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01dc60d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc614 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872998.258207:0:96948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01dc60d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dc614 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788872998.258218:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1f800 x1875765327892352/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.258231:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 10000000:00000040:2.0:1788872998.258244:0:96948:0:(mgc_request.c:108:config_log_get()) log params (ffff98aa00127c00) refs 2 00000020:00000040:2.0:1788872998.258247:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a9fa898a00 refcount=3 10000000:00000040:2.0:1788872998.258284:0:96948:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a9ca25d240 : new refcount 2 10000000:00000040:2.0:1788872998.258289:0:96948:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a9ef3e2180 : new refcount 2 10000000:00000040:2.0:1788872998.258293:0:96948:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.139@tcp: copy local log params 00000040:00080000:2.0:1788872998.258460:0:96948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788872998.258725:0:96948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788872998.260567:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788872998.260615:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788872998.260636:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788872998.260641:0:96948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:2.0:1788872998.260695:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:2.0:1788872998.260703:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:2.0:1788872998.261927:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a8c9fe6d80 x1875765327892480/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.261943:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892480:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788872998.265596:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a8c9fe6d80 x1875765327892480/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.265613:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.265677:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f67cf450 x1875765327892480 msgsize 504 00000100:00100000:3.0:1788872998.265682:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872998.265684:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788872998.265706:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a8c9fe6d80 x1875765327892480/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.265734:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c1cb2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788872998.265803:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327892480 00000100:00100000:0.0:1788872998.265822:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327892480 00000020:00000040:0.0:1788872998.265825:0:94381:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:0.0:1788872998.265830:0:94381:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=23 00000100:00000040:0.0:1788872998.265854:0:94381:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788872998.265885:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00000040:0.0:1788872998.265890:0:94381:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:0.0:1788872998.265896:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f67cf450 x1875765327892480/t0(0) o501->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 504/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.265908:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:96948:x1875765327892480:12345-0@lo:501:mount.lustre.0 00000040:00000040:0.0:1788872998.265931:0:94381:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:0.0:1788872998.265935:0:94381:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:0.0:1788872998.266015:0:94381:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00010000:00000040:0.0:1788872998.266022:0:94381:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327892480 00000100:00000040:0.0:1788872998.266034:0:94381:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:0.0:1788872998.266039:0:94381:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.266062:0:94381:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff98a8c9fe6d80 x1875765327892480/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.266096:0:94381:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:0.0:1788872998.266114:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f67cf450 x1875765327892480/t0(0) o501->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 504/272 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.266123:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:96948:x1875765327892480:12345-0@lo:501:mount.lustre.0 Request processed in 217us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872998.266130:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00000040:0.0:1788872998.266133:0:94381:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:0.0:1788872998.266142:0:94381:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 22 00000100:00000040:3.0:1788872998.266375:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a8c9fe6d80 x1875765327892480/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.266387:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe6d80 x1875765327892480/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.266406:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892480:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788872998.266414:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a8c9fe6d80 x1875765327892480/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872998.266425:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000100:00000040:3.0:1788872998.266428:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a8c9fe6d80 x1875765327892480/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872998.266437:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000020:00000040:3.0:1788872998.266452:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:3.0:1788872998.266457:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:3.0:1788872998.266749:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1d180 x1875765327892608/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.266761:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892608:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1788872998.266798:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1d180 x1875765327892608/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.266805:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.267702:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f67cd850 x1875765327892608 msgsize 272 00000100:00100000:3.0:1788872998.267710:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872998.267712:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788872998.267733:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9f5c1d180 x1875765327892608/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.267761:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5492f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872998.268329:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327892608 00000100:00100000:0.0:1788872998.268340:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327892608 00000020:00000040:0.0:1788872998.268343:0:94376:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:0.0:1788872998.268347:0:94376:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=23 00000100:00000040:0.0:1788872998.268368:0:94376:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788872998.268404:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00000040:0.0:1788872998.268408:0:94376:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:0.0:1788872998.268413:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f67cd850 x1875765327892608/t0(0) o503->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.268425:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:96948:x1875765327892608:12345-0@lo:503:mount.lustre.0 00000040:00000040:0.0:1788872998.268459:0:94376:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:0.0:1788872998.268512:0:94376:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00010000:00000040:0.0:1788872998.268517:0:94376:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327892608 00000100:00000040:0.0:1788872998.268526:0:94376:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:0.0:1788872998.268530:0:94376:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.268598:0:94376:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff98a9f5c1d180 x1875765327892608/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.268627:0:94376:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:0.0:1788872998.268631:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f67cd850 x1875765327892608/t0(0) o503->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/8416 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.268639:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:96948:x1875765327892608:12345-0@lo:503:mount.lustre.0 Request processed in 215us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872998.268652:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00000040:0.0:1788872998.268655:0:94376:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:0.0:1788872998.268664:0:94376:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 22 00000100:00000040:3.0:1788872998.268979:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1d180 x1875765327892608/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.268990:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1d180 x1875765327892608/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.268997:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892608:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1788872998.269005:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1d180 x1875765327892608/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.269017:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1d180 x1875765327892608/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872998.269031:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:3.0:1788872998.269040:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000040:00080000:3.0:1788872998.269474:0:96948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:3.0:1788872998.269528:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:3.0:1788872998.269534:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:3.0:1788872998.269585:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1d180 x1875765327892736/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.269598:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892736:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788872998.269634:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1d180 x1875765327892736/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.269643:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.269672:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c1f4cc50 x1875765327892736 msgsize 272 00000100:00100000:3.0:1788872998.269677:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872998.269679:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788872998.269699:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9f5c1d180 x1875765327892736/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.269720:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5492f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788872998.269730:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327892736 00000100:00100000:1.0:1788872998.269747:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327892736 00000020:00000040:1.0:1788872998.269749:0:94377:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:1.0:1788872998.269752:0:94377:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=23 00000100:00000040:1.0:1788872998.269766:0:94377:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788872998.269802:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00000040:1.0:1788872998.269805:0:94377:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:1.0:1788872998.269810:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c1f4cc50 x1875765327892736/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.269823:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:96948:x1875765327892736:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1788872998.269846:0:94377:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:1.0:1788872998.269883:0:94377:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00010000:00000040:1.0:1788872998.269893:0:94377:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327892736 00000100:00000040:1.0:1788872998.269900:0:94377:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872998.269904:0:94377:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.269924:0:94377:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff98a9f5c1d180 x1875765327892736/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.269952:0:94377:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872998.269968:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c1f4cc50 x1875765327892736/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/8472 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.269976:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:96948:x1875765327892736:12345-0@lo:502:mount.lustre.0 Request processed in 155us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872998.269982:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00000040:1.0:1788872998.269985:0:94377:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:1.0:1788872998.269991:0:94377:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 22 00000100:00000040:0.0:1788872998.270860:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1d180 x1875765327892736/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.270872:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1d180 x1875765327892736/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.270880:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892736:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1788872998.270890:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1d180 x1875765327892736/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.270904:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1d180 x1875765327892736/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872998.270921:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:0.0:1788872998.270931:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000040:00080000:0.0:1788872998.271180:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788872998.271211:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788872998.271226:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788872998.271239:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788872998.271252:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:0.0:1788872998.271259:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:0.0:1788872998.271264:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:0.0:1788872998.271292:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df5aea00 x1875765327892864/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.271303:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892864:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1788872998.271333:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df5aea00 x1875765327892864/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.271352:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.271389:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c1f4ec50 x1875765327892864 msgsize 272 00000100:00100000:0.0:1788872998.271393:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872998.271396:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788872998.271432:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9df5aea00 x1875765327892864/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.271449:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327892864 00000100:00100000:0.0:1788872998.271453:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788872998.271456:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327892864 00000020:00000040:3.0:1788872998.271458:0:94381:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:3.0:1788872998.271462:0:94381:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=23 00000100:00000040:3.0:1788872998.271481:0:94381:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788872998.271512:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00000040:3.0:1788872998.271517:0:94381:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:3.0:1788872998.271522:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c1f4ec50 x1875765327892864/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.271533:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:96948:x1875765327892864:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1788872998.274287:0:94381:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:3.0:1788872998.275070:0:94381:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00010000:00000040:3.0:1788872998.275080:0:94381:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327892864 00000100:00000040:3.0:1788872998.275097:0:94381:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872998.275104:0:94381:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.275169:0:94381:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff98a9df5aea00 x1875765327892864/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.275212:0:94381:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:3.0:1788872998.275219:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c1f4ec50 x1875765327892864/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/8472 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.275240:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:96948:x1875765327892864:12345-0@lo:502:mount.lustre.0 Request processed in 3708us (3848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872998.275251:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00000040:3.0:1788872998.275255:0:94381:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:3.0:1788872998.275270:0:94381:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 22 00000100:00000040:1.0:1788872998.275450:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df5aea00 x1875765327892864/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.275463:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5aea00 x1875765327892864/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.275470:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892864:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1788872998.275480:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df5aea00 x1875765327892864/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.275494:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df5aea00 x1875765327892864/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872998.275534:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:1.0:1788872998.275544:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000040:00080000:1.0:1788872998.275631:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788872998.275645:0:96948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:1.0:1788872998.275984:0:96948:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a9ca25d240 : new refcount 1 00000020:00000040:1.0:1788872998.275996:0:96948:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:3.0:1788872998.278054:0:96956:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872998.278068:0:96956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872998.278071:0:96956:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788872998.278080:0:96956:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a9fbfad000 00000020:00000080:3.0:1788872998.278083:0:96956:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788872998.278091:0:96956:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872998.278094:0:96956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872998.278095:0:96956:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788872998.278098:0:96956:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788872998.278100:0:96956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872998.278101:0:96956:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788872998.278105:0:96956:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98a9fbfad000 00000020:00000080:3.0:1788872998.278107:0:96956:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788872998.278179:0:96956:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788872998.278183:0:96956:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788872998.278185:0:96956:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788872998.278188:0:96956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:0.0:1788872998.278507:0:96948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788872998.278540:0:96948:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:0.0:1788872998.278585:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a9fa898a00 refcount=3 00010000:00010000:0.0:1788872998.278594:0:96948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01dc60d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc614 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.278605:0:96948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa898a00/0xe4e6e89fb01dc60d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc614 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788872998.278659:0:96948:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788872998.278662:0:96948:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98a9fbfad000 10000000:01000000:0.0:1788872998.278665:0:96948:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98a9fbfad000 10000000:01000000:0.0:1788872998.278669:0:96948:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:0.0:1788872998.278673:0:96948:0:(genops.c:889:class_export_get()) GET export ffff98a9e98d1800 refcount=20 10000000:01000000:0.0:1788872998.278677:0:96948:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98a9fbfad000 from 1 10000000:01000000:0.0:1788872998.278680:0:96948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:0.0:1788872998.278688:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00010000:00000040:0.0:1788872998.278713:0:96948:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a9f016a900 count: 9 00000020:00000040:0.0:1788872998.278721:0:96948:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a8cc3e6a00 with handle 0xe4e6e89fb01dc61b to hash 00010000:00010000:0.0:1788872998.278727:0:96948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e6a00/0xe4e6e89fb01dc61b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.278736:0:96948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e6a00/0xe4e6e89fb01dc61b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.278760:0:96948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e6a00/0xe4e6e89fb01dc61b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788872998.278784:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df5ace00 x1875765327892992/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.278798:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892992:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1788872998.279154:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df5ace00 x1875765327892992/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.279164:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.279211:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f67ce450 x1875765327892992 msgsize 328 00000100:00100000:0.0:1788872998.279216:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872998.279217:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788872998.279245:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9df5ace00 x1875765327892992/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.279273:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788872998.279432:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327892992 00000100:00100000:3.0:1788872998.279439:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327892992 00000020:00000040:3.0:1788872998.279442:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:3.0:1788872998.279445:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=23 00000100:00000040:3.0:1788872998.279464:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788872998.279498:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00000040:3.0:1788872998.279503:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:3.0:1788872998.279508:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f67ce450 x1875765327892992/t0(0) o101->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.279531:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f67ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:96948:x1875765327892992:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788872998.279545:0:94375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1788872998.279572:0:94375:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a9c1358e00 count: 11 00000020:00000040:3.0:1788872998.279577:0:94375:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a9fa899000 with handle 0xe4e6e89fb01dc622 to hash 00010000:00010000:3.0:1788872998.279581:0:94375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a9fa899000/0xe4e6e89fb01dc622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dc61b expref: -99 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.279588:0:94375:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff98a8c2645800 : new locks_count 18 00000020:00000040:3.0:1788872998.279590:0:94375:0:(genops.c:889:class_export_get()) GET export ffff98a8c2645800 refcount=24 00010000:00000040:3.0:1788872998.279607:0:94375:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff98a9c1358e00) refcount = 11 00010000:00000040:3.0:1788872998.279610:0:94375:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1788872998.279614:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8cc3e7400/0xe4e6e89fb01dc5e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dc5dc expref: 24 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.279624:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c52afe00/0xe4e6e89fb01dbbf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb24d expref: 9 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.279631:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c52ae600/0xe4e6e89fb01dbbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb246 expref: 9 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.279638:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98aa002a4600/0xe4e6e89fb01dbbe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbe1 expref: 24 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.279645:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a9caa1b000/0xe4e6e89fb01dbbbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbbb7 expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.279651:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a9caa1bc00/0xe4e6e89fb01dbbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbba9 expref: 24 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.279658:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c52afc00/0xe4e6e89fb01dbba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb9b expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.279670:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c449aa00/0xe4e6e89fb01dbb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb8d expref: 24 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.279677:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98aa002a5400/0xe4e6e89fb01dbb86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb7f expref: 24 pid: 94377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.279683:0:94375:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a9caa1b600/0xe4e6e89fb01dbb78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dbb71 expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.279690:0:94375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a9fa899000/0xe4e6e89fb01dc622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dc61b expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.279701:0:94375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a9fa899000/0xe4e6e89fb01dc622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dc61b expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.279711:0:94375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a9fa899000, rc 0) 00010000:00000040:3.0:1788872998.279714:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327892992 00000100:00000040:3.0:1788872998.279725:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872998.279729:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.279749:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff98a9df5ace00 x1875765327892992/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.279767:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:3.0:1788872998.279772:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f67ce450 x1875765327892992/t0(0) o101->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/344 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.279781:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f67ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327892992:12345-0@lo:101:mount.lustre.0 Request processed in 251us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872998.279787:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00000040:3.0:1788872998.279790:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:3.0:1788872998.279800:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 23 00000100:00000040:0.0:1788872998.280112:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df5ace00 x1875765327892992/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.280123:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ace00 x1875765327892992/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.280130:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327892992:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1788872998.280138:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df5ace00 x1875765327892992/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872998.280152:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8cc3e6a00 refcount=4 00010000:00000040:0.0:1788872998.280157:0:96948:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff98a8cc3e6a00, remote cookie: 0xe4e6e89fb01dc622, flags: 0x0 00010000:00000040:0.0:1788872998.280163:0:96948:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff98a9f016a900) refcount = 9 00010000:00000040:0.0:1788872998.280170:0:96948:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1788872998.280173:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a8c4839a00/0xe4e6e89fb01dc5dc lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dc5e3 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.280180:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a8c52ae400/0xe4e6e89fb01dbbe1 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbe8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.280187:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98aa002a4e00/0xe4e6e89fb01dbbb7 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbbe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.280193:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a8c52af600/0xe4e6e89fb01dbba9 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbbb0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.280199:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98aa002a5000/0xe4e6e89fb01dbb9b lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbba2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.280205:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a600/0xe4e6e89fb01dbb8d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb94 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.280212:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a9caa1a400/0xe4e6e89fb01dbb7f lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.280219:0:96948:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98aa002a5e00/0xe4e6e89fb01dbb71 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dbb78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.280225:0:96948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e6a00/0xe4e6e89fb01dc61b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc622 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.280233:0:96948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e6a00/0xe4e6e89fb01dc61b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dc622 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788872998.280243:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df5ace00 x1875765327892992/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872998.280257:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 10000000:00000040:0.0:1788872998.280267:0:96948:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff98a8c3960400) refs 2 00000020:00000040:0.0:1788872998.280270:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8cc3e6a00 refcount=3 10000000:00000040:0.0:1788872998.280299:0:96948:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a9ca25d240 : new refcount 2 10000000:00000040:0.0:1788872998.280303:0:96948:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a9ef3e2180 : new refcount 2 10000000:00000040:0.0:1788872998.280317:0:96948:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.139@tcp: copy local log lustre-client 00000040:00080000:0.0:1788872998.280543:0:96948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788872998.281096:0:96948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788872998.281678:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788872998.281708:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788872998.281723:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788872998.281735:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788872998.281749:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788872998.281762:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788872998.281777:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788872998.281790:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788872998.281805:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788872998.281835:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788872998.281849:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788872998.281861:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788872998.281873:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788872998.281887:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788872998.281900:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788872998.281911:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788872998.281922:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788872998.281935:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788872998.281948:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788872998.281976:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788872998.281991:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788872998.282004:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788872998.282020:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788872998.282048:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788872998.282063:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788872998.282076:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788872998.282087:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788872998.282098:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788872998.282111:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788872998.282123:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788872998.282135:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788872998.282149:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788872998.282164:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788872998.282176:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788872998.282189:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788872998.282202:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788872998.282214:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788872998.282235:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788872998.282241:0:96948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:0.0:1788872998.282301:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:0.0:1788872998.282321:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:0.0:1788872998.282365:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df5ace00 x1875765327893120/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.282378:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327893120:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1788872998.282401:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df5ace00 x1875765327893120/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.282409:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.282448:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c1f4f450 x1875765327893120 msgsize 512 00000100:00100000:0.0:1788872998.282453:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872998.282455:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788872998.282488:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9df5ace00 x1875765327893120/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.282518:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788872998.283452:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327893120 00000100:00100000:2.0:1788872998.283461:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327893120 00000020:00000040:2.0:1788872998.283463:0:94382:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:2.0:1788872998.283467:0:94382:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=24 00000100:00000040:2.0:1788872998.283487:0:94382:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788872998.283527:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00000040:2.0:1788872998.283532:0:94382:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:2.0:1788872998.283538:0:94382:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c1f4f450 x1875765327893120/t0(0) o501->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 512/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.284043:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327893120:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1788872998.284069:0:94382:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:2.0:1788872998.284073:0:94382:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:2.0:1788872998.284218:0:94382:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00000020:00000040:2.0:1788872998.284227:0:94382:0:(genops.c:889:class_export_get()) GET export ffff98a8c2645800 refcount=25 00000020:00000040:2.0:1788872998.284230:0:94382:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 24 00010000:00000040:2.0:1788872998.284236:0:94382:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327893120 00000100:00000040:2.0:1788872998.284247:0:94382:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:2.0:1788872998.284252:0:94382:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872998.284292:0:94382:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff98a9df5ace00 x1875765327893120/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.284418:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df5ace00 x1875765327893120/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.284428:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ace00 x1875765327893120/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.284434:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327893120:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1788872998.284443:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df5ace00 x1875765327893120/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872998.284454:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000100:00000040:0.0:1788872998.284458:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df5ace00 x1875765327893120/t0(0) o501->MGC192.168.204.139@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872998.284468:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000020:00000040:0.0:1788872998.284480:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:0.0:1788872998.284484:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:0.0:1788872998.284505:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df5ace00 x1875765327893248/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.284516:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327893248:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1788872998.284574:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df5ace00 x1875765327893248/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.284583:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872998.284681:0:94382:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:2.0:1788872998.284693:0:94382:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c1f4f450 x1875765327893120/t0(0) o501->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 512/272 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.284702:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327893120:12345-0@lo:501:mount.lustre.0 Request processed in 1153us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872998.284710:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00000040:2.0:1788872998.284714:0:94382:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:2.0:1788872998.284724:0:94382:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 23 00000100:00000040:1.0:1788872998.285107:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c1f4d450 x1875765327893248 msgsize 272 00000100:00100000:1.0:1788872998.285113:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872998.285115:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788872998.285233:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9df5ace00 x1875765327893248/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.285268:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788872998.285306:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327893248 00000100:00100000:0.0:1788872998.285313:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327893248 00000020:00000040:0.0:1788872998.285316:0:94376:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:0.0:1788872998.285379:0:94376:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=24 00000100:00000040:0.0:1788872998.285403:0:94376:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788872998.285429:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00000040:0.0:1788872998.285433:0:94376:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:0.0:1788872998.285438:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c1f4d450 x1875765327893248/t0(0) o503->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.285457:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327893248:12345-0@lo:503:mount.lustre.0 00000040:00000040:0.0:1788872998.285485:0:94376:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:0.0:1788872998.285527:0:94376:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00010000:00000040:0.0:1788872998.285531:0:94376:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327893248 00000100:00000040:0.0:1788872998.285538:0:94376:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:0.0:1788872998.285542:0:94376:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.286012:0:94376:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff98a9df5ace00 x1875765327893248/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.286093:0:94376:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:0.0:1788872998.286099:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c1f4d450 x1875765327893248/t0(0) o503->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/8416 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.286108:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327893248:12345-0@lo:503:mount.lustre.0 Request processed in 654us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872998.286115:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00000040:0.0:1788872998.286118:0:94376:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:0.0:1788872998.286126:0:94376:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 23 00000100:00000040:1.0:1788872998.286417:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df5ace00 x1875765327893248/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.286427:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ace00 x1875765327893248/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.286434:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327893248:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1788872998.286441:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df5ace00 x1875765327893248/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.286453:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df5ace00 x1875765327893248/t0(0) o503->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872998.286468:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:1.0:1788872998.286477:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000040:00080000:1.0:1788872998.287090:0:96948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:1.0:1788872998.287378:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:1.0:1788872998.287385:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:1.0:1788872998.287414:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ee81d500 x1875765327893376/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.287426:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327893376:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1788872998.287458:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ee81d500 x1875765327893376/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.287466:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.287501:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c1f4c850 x1875765327893376 msgsize 272 00000100:00100000:1.0:1788872998.287506:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872998.287508:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788872998.287647:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9ee81d500 x1875765327893376/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.287694:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be7300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872998.288129:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327893376 00000100:00100000:0.0:1788872998.288137:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327893376 00000020:00000040:0.0:1788872998.288140:0:94377:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:0.0:1788872998.288144:0:94377:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=24 00000100:00000040:0.0:1788872998.288164:0:94377:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788872998.288234:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00000040:0.0:1788872998.288238:0:94377:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:0.0:1788872998.288243:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c1f4c850 x1875765327893376/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.288254:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327893376:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1788872998.288290:0:94377:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:0.0:1788872998.288355:0:94377:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00010000:00000040:0.0:1788872998.288360:0:94377:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327893376 00000100:00000040:0.0:1788872998.288369:0:94377:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:0.0:1788872998.288374:0:94377:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.288406:0:94377:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff98a9ee81d500 x1875765327893376/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.288443:0:94377:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:0.0:1788872998.288447:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c1f4c850 x1875765327893376/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/8472 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.288455:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327893376:12345-0@lo:502:mount.lustre.0 Request processed in 203us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872998.288462:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00000040:0.0:1788872998.288465:0:94377:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:0.0:1788872998.288473:0:94377:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 23 00000100:00000040:1.0:1788872998.288610:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ee81d500 x1875765327893376/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.288618:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81d500 x1875765327893376/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.288625:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327893376:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1788872998.288631:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ee81d500 x1875765327893376/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.288642:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ee81d500 x1875765327893376/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872998.288656:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:1.0:1788872998.288663:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000040:00080000:1.0:1788872998.289167:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788872998.289200:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788872998.289213:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788872998.289226:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788872998.289240:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788872998.289254:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788872998.289268:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788872998.289282:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788872998.289298:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788872998.289311:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788872998.289390:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788872998.289408:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788872998.289435:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788872998.289450:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788872998.289463:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788872998.289475:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788872998.289487:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788872998.289499:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788872998.289512:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788872998.289524:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788872998.289536:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788872998.289574:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788872998.289589:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788872998.289612:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788872998.289626:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788872998.289638:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788872998.289650:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788872998.289662:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788872998.289673:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788872998.289684:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788872998.289696:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788872998.289708:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1788872998.289720:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1788872998.289731:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1788872998.290129:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788872998.290153:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788872998.290167:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1788872998.290180:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1788872998.290192:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1788872998.290204:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1788872998.290217:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1788872998.290231:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1788872998.290244:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1788872998.290258:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1788872998.290272:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1788872998.290300:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1788872998.290317:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1788872998.290538:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:1.0:1788872998.290597:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:1.0:1788872998.290604:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:1.0:1788872998.290644:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ee81d500 x1875765327893504/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.290657:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327893504:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1788872998.290692:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ee81d500 x1875765327893504/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.290699:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.290737:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c1f4d050 x1875765327893504 msgsize 272 00000100:00100000:1.0:1788872998.290741:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872998.290889:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788872998.290918:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9ee81d500 x1875765327893504/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.290944:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be7300 going to sleep for 11 seconds 00000100:00100000:0.0:1788872998.291016:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327893504 00000100:00100000:0.0:1788872998.291024:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327893504 00000020:00000040:0.0:1788872998.291026:0:94382:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:0.0:1788872998.291030:0:94382:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=24 00000100:00000040:0.0:1788872998.291053:0:94382:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788872998.291116:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00000040:0.0:1788872998.291121:0:94382:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:0.0:1788872998.291126:0:94382:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c1f4d050 x1875765327893504/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.291138:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c1f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327893504:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1788872998.291168:0:94382:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:0.0:1788872998.291217:0:94382:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00010000:00000040:0.0:1788872998.291229:0:94382:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327893504 00000100:00000040:0.0:1788872998.291238:0:94382:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:0.0:1788872998.291244:0:94382:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.291266:0:94382:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff98a9ee81d500 x1875765327893504/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.291317:0:94382:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:0.0:1788872998.291409:0:94382:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c1f4d050 x1875765327893504/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/8472 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.291417:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c1f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327893504:12345-0@lo:502:mount.lustre.0 Request processed in 281us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872998.291425:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00000040:0.0:1788872998.291427:0:94382:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:0.0:1788872998.291436:0:94382:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 23 00000100:00000040:3.0:1788872998.291510:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ee81d500 x1875765327893504/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.291521:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81d500 x1875765327893504/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.291529:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327893504:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788872998.291536:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ee81d500 x1875765327893504/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.291567:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ee81d500 x1875765327893504/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872998.291582:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:3.0:1788872998.291589:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000040:00080000:3.0:1788872998.291763:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788872998.291789:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:3.0:1788872998.291802:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788872998.292026:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:3.0:1788872998.292046:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:3.0:1788872998.292057:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:3.0:1788872998.292068:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:3.0:1788872998.292078:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:3.0:1788872998.292090:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:3.0:1788872998.292100:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:3.0:1788872998.292109:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:3.0:1788872998.292119:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:3.0:1788872998.292129:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:3.0:1788872998.292141:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:3.0:1788872998.292149:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:3.0:1788872998.292154:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:3.0:1788872998.292177:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1d880 x1875765327893632/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.292206:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327893632:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788872998.292232:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1d880 x1875765327893632/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.292239:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.292267:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c454e850 x1875765327893632 msgsize 272 00000100:00100000:3.0:1788872998.292271:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872998.292273:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788872998.295501:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9f5c1d880 x1875765327893632/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.295540:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9c5492d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788872998.295667:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327893632 00000100:00100000:1.0:1788872998.295678:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327893632 00000020:00000040:1.0:1788872998.295682:0:94381:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:1.0:1788872998.295686:0:94381:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=24 00000100:00000040:1.0:1788872998.295709:0:94381:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788872998.295773:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00000040:1.0:1788872998.295778:0:94381:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:1.0:1788872998.295784:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c454e850 x1875765327893632/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.295796:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327893632:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1788872998.295835:0:94381:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a8c4ad0600 : new refcount 2 00000040:00000040:1.0:1788872998.295895:0:94381:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a8c4ad0600 : new refcount 1 00010000:00000040:1.0:1788872998.295900:0:94381:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327893632 00000100:00000040:1.0:1788872998.295909:0:94381:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:1.0:1788872998.295914:0:94381:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.295975:0:94381:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff98a9f5c1d880 x1875765327893632/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.295998:0:94381:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 51 to 0@lo 00000100:00000040:1.0:1788872998.296003:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c454e850 x1875765327893632/t0(0) o502->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 272/8472 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.296012:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327893632:12345-0@lo:502:mount.lustre.0 Request processed in 217us (3743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872998.296019:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00000040:1.0:1788872998.296022:0:94381:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:1.0:1788872998.296032:0:94381:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 23 00000100:00000040:0.0:1788872998.297695:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1d880 x1875765327893632/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.297710:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1d880 x1875765327893632/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.297718:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327893632:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1788872998.297727:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1d880 x1875765327893632/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.297753:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1d880 x1875765327893632/t0(0) o502->MGC192.168.204.139@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872998.297770:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:0.0:1788872998.297784:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000040:00080000:0.0:1788872998.297851:0:96948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:0.0:1788872998.297865:0:96948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:0.0:1788872998.298138:0:96948:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a9ca25d240 : new refcount 1 00000020:00000040:0.0:1788872998.298149:0:96948:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:3.0:1788872998.299803:0:96959:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.204.139@tcp 192.168.204.139@tcp cnt=1 00000020:01000004:3.0:1788872998.299840:0:96959:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788872998.299856:0:96959:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98a8c1cfb380) 00000020:00000040:3.0:1788872998.299863:0:96959:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a8c2794800 with handle 0xe4e6e89fb01dc629 to hash 00000020:00000040:3.0:1788872998.299872:0:96959:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2794800 : new refcount 1 00000020:00000040:3.0:1788872998.299886:0:96959:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff98a8c1cfb380) now 2 - obd_device_list 00000020:00000080:3.0:1788872998.299892:0:96959:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788872998.300059:0:96959:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9fbfad000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788872998.300063:0:96959:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9fbfad000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788872998.300066:0:96959:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9fbfad000 3 00000020:00000040:3.0:1788872998.300082:0:96959:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff98a8c1cfb380) now 3 - import 00000020:00000040:3.0:1788872998.300087:0:96959:0:(genops.c:1244:class_import_put()) import ffff98a9ef237000 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1788872998.300097:0:96959:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872998.300100:0:96959:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 52 to 0@lo 00000100:00000040:3.0:1788872998.300102:0:96959:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.139@tcp -> ffff98a9c86f8940 00010000:00080000:3.0:1788872998.300106:0:96959:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a9ef237000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.139@tcp at head 00010000:00010000:3.0:1788872998.301699:0:96959:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:3.0:1788872998.301800:0:96959:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff98a8c1cfb380) now 4 - setup 00000020:00000080:3.0:1788872998.301810:0:96959:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788872998.301850:0:96959:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:3.0:1788872998.301857:0:96959:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a9efc04800 with handle 0xe4e6e89fb01dc630 to hash 00000020:00000040:3.0:1788872998.301865:0:96959:0:(genops.c:889:class_export_get()) GET export ffff98a9efc04800 refcount=3 00000020:00000040:3.0:1788872998.301869:0:96959:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff98a8c1cfb380) now 5 - export 00000020:00000040:3.0:1788872998.301872:0:96959:0:(genops.c:900:class_export_put()) PUTting export ffff98a9efc04800 : new refcount 2 00000020:00000080:3.0:1788872998.301875:0:96959:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe4e6e89fb01dc630 00000020:00000040:3.0:1788872998.301878:0:96959:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc630 00000020:00000040:3.0:1788872998.301880:0:96959:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9efc04800 refcount=3 00000100:00080000:3.0:1788872998.301889:0:96959:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:3.0:1788872998.301893:0:96959:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 53 to 0@lo 00000020:00000040:3.0:1788872998.301896:0:96959:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc630 00000020:00000040:3.0:1788872998.301897:0:96959:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9efc04800 refcount=4 00000100:00000040:3.0:1788872998.301899:0:96959:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 54 to 0@lo 00000020:00000040:3.0:1788872998.301901:0:96959:0:(genops.c:900:class_export_put()) PUTting export ffff98a9efc04800 : new refcount 3 00000100:00080000:3.0:1788872998.301904:0:96959:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98a9ef237000 using connection 192.168.204.139@tcp/0@lo 00000020:00000040:3.0:1788872998.301918:0:96959:0:(genops.c:1231:class_import_get()) import ffff98a9ef237000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:3.0:1788872998.301940:0:96959:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f5c1c700 x1875765327893760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.301968:0:96959:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d5cb5ec5] to pc [ptlrpcd_rcv+-1] req@ffff98a9f5c1c700 x1875765327893760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872998.301993:0:96959:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:3.0:1788872998.301996:0:96959:0:(genops.c:1231:class_import_get()) import ffff98a9ef237000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1788872998.302025:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872998.302032:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9efadc000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1788872998.302041:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff98a9f5c1d500 x1875765327893888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.302053:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000028d55f1e] to pc [ptlrpcd_00_01+1] req@ffff98a9f5c1d500 x1875765327893888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.302073:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872998.302078:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a8c2644800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1788872998.302088:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff98a9f5c1d880 x1875765327894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.302097:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e66cc575] to pc [ptlrpcd_00_02+2] req@ffff98a9f5c1d880 x1875765327894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.302113:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872998.302117:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9df8c9800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1788872998.302124:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff98a9f5c1d180 x1875765327894144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.302132:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007de57a47] to pc [ptlrpcd_00_03+3] req@ffff98a9f5c1d180 x1875765327894144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872998.302140:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872998.302144:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788872998.302146:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872998.302150:0:82775:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3931 00000100:00080000:3.0:1788872998.302152:0:82775:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:3.0:1788872998.302155:0:82775:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 53 to 0@lo 00000100:00000040:3.0:1788872998.302157:0:82775:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 54 to 0@lo 00000020:00000040:3.0:1788872998.302160:0:82775:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d5518 00000020:00000040:3.0:1788872998.302162:0:82775:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c5646000 refcount=4 00000100:00000040:3.0:1788872998.302165:0:82775:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 53 to 0@lo 00000100:00000040:3.0:1788872998.302168:0:82775:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 54 to 0@lo 00000020:00000040:3.0:1788872998.302170:0:82775:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c5646000 : new refcount 3 00000100:00080000:3.0:1788872998.302172:0:82775:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98a9e7bf8800 using connection 192.168.204.139@tcp/0@lo 00000020:00000040:3.0:1788872998.302182:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9e7bf8800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1788872998.302190:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f5c1f800 x1875765327894272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.302199:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000339bef34] to pc [ptlrpcd_rcv+-1] req@ffff98a9f5c1f800 x1875765327894272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.302207:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872998.302211:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9dfe90800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1788872998.302218:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff98a9f5c1dc00 x1875765327894400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.302227:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d0f43810] to pc [ptlrpcd_00_00+0] req@ffff98a9f5c1dc00 x1875765327894400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.302235:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872998.302272:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9dfe96800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1788872998.302280:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff98a9f4937b80 x1875765327894528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.302288:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000018aa673b] to pc [ptlrpcd_00_01+1] req@ffff98a9f4937b80 x1875765327894528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.302295:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872998.302300:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a8c9e82800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1788872998.302305:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff98a9f4936a00 x1875765327894656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.302314:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a199b9eb] to pc [ptlrpcd_00_02+2] req@ffff98a9f4936a00 x1875765327894656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872998.302321:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788872998.302328:0:82775:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788872998.302330:0:82775:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788872998.302335:0:82775:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3931 00000100:00080000:3.0:1788872998.302337:0:82775:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00000040:3.0:1788872998.302340:0:82775:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 53 to 0@lo 00000100:00000040:3.0:1788872998.302342:0:82775:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 54 to 0@lo 00000020:00000040:3.0:1788872998.302344:0:82775:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6cb 00000020:00000040:3.0:1788872998.302346:0:82775:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ef0af000 refcount=4 00000100:00000040:3.0:1788872998.302349:0:82775:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 53 to 0@lo 00000100:00000040:3.0:1788872998.302351:0:82775:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 54 to 0@lo 00000020:00000040:3.0:1788872998.302354:0:82775:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ef0af000 : new refcount 3 00000100:00080000:3.0:1788872998.302356:0:82775:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98a8c37f1000 using connection 192.168.204.139@tcp/0@lo 00000020:00000040:3.0:1788872998.302361:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a8c37f1000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1788872998.302369:0:82775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f4934a80 x1875765327894784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.302377:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001d35666a] to pc [ptlrpcd_rcv+-1] req@ffff98a9f4934a80 x1875765327894784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.302385:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872998.302389:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9e021b000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1788872998.302396:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff98a9f4934e00 x1875765327894912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.302404:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000aa0521e] to pc [ptlrpcd_00_03+3] req@ffff98a9f4934e00 x1875765327894912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.302411:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788872998.302414:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a8ca9bc000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1788872998.302420:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff98a9f4934000 x1875765327895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.302433:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000361c0605] to pc [ptlrpcd_00_00+0] req@ffff98a9f4934000 x1875765327895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.302442:0:82775:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3940) 00000100:00000040:3.0:1788872998.302462:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1d880 x1875765327894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.302475:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327894016:0@lo:400:kworker.0 00000100:00000040:3.0:1788872998.302503:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1d880 x1875765327894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.302512:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.303155:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1dc00 x1875765327894400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.303168:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327894400:0@lo:400:kworker.0 00000100:00000040:1.0:1788872998.303187:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1dc00 x1875765327894400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.303194:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.303220:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81d180 x1875765327894400 msgsize 224 00000100:00100000:1.0:1788872998.303224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872998.303244:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1dc00 x1875765327894400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.303257:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 7117 usecs (8 jiffies) 00000100:00000040:1.0:1788872998.303266:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4934000 x1875765327895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.303274:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327895040:0@lo:400:kworker.0 00000100:00000040:1.0:1788872998.303297:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4934000 x1875765327895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.303304:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.303319:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81ed80 x1875765327895040 msgsize 224 00000100:00100000:1.0:1788872998.303323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872998.303336:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4934000 x1875765327895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.303346:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8802 usecs (9 jiffies) 00000100:00100000:1.0:1788872998.303359:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:1.0:1788872998.303364:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1d500 x1875765327893888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.303373:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327893888:0@lo:400:kworker.0 00000100:00000040:1.0:1788872998.303385:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1d500 x1875765327893888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.303392:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.303403:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81f100 x1875765327893888 msgsize 224 00000100:00100000:1.0:1788872998.303407:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872998.303419:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1d500 x1875765327893888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.303427:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8822 usecs (9 jiffies) 00000100:00000040:1.0:1788872998.303433:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4937b80 x1875765327894528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.303440:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327894528:0@lo:400:kworker.0 00000100:00000040:1.0:1788872998.303452:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4937b80 x1875765327894528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.303459:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.303469:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81e680 x1875765327894528 msgsize 224 00000100:00100000:1.0:1788872998.303477:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872998.303493:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4937b80 x1875765327894528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.303503:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 130151 usecs (131 jiffies) 00000100:00100000:1.0:1788872998.303525:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327894400 00000100:00100000:1.0:1788872998.303532:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327894400 00000020:00000040:1.0:1788872998.303535:0:26196:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d553b 00000020:00000040:1.0:1788872998.303539:0:26196:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c45cb000 refcount=5 00000100:00000040:1.0:1788872998.303619:0:26196:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1788872998.303647:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794 00000100:00000040:1.0:1788872998.303651:0:26196:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9c45cb000 : new rpc_count 1 00000100:00000040:1.0:1788872998.303657:0:26196:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81d180 x1875765327894400/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:169/0 lens 224/0 e 0 to 0 dl 1788873009 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.303669:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327894400:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788872998.303692:0:26196:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875765327894400 00000100:00000040:1.0:1788872998.303703:0:26196:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 55 to 0@lo 00000100:00000040:1.0:1788872998.303708:0:26196:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.303726:0:26196:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f5c1dc00 x1875765327894400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.303744:0:26196:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 54 to 0@lo 00000100:00000040:1.0:1788872998.303749:0:26196:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81d180 x1875765327894400/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:169/0 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.303758:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327894400:12345-0@lo:400:kworker.0 Request processed in 91us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872998.303764:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794 00000100:00000040:1.0:1788872998.303767:0:26196:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9c45cb000 : new rpc_count 0 00000020:00000040:1.0:1788872998.303777:0:26196:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c45cb000 : new refcount 4 00000100:00000040:0.0:1788872998.303986:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1c700 x1875765327893760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.303995:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327893760:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1788872998.304015:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1c700 x1875765327893760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788873008 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.304022:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.304037:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5aca80 x1875765327893760 msgsize 520 00000100:00100000:0.0:1788872998.304040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788872998.304058:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327895040 00000100:00100000:1.0:1788872998.304069:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327895040 00000020:00000040:1.0:1788872998.304071:0:66190:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db814 00000100:00000040:0.0:1788872998.304071:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1c700 x1875765327893760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788873008 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872998.304074:0:66190:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9df96b800 refcount=5 00000100:00000040:1.0:1788872998.304086:0:66190:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:0.0:1788872998.304090:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00100000:1.0:1788872998.304103:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327893888 00000100:00000040:0.0:1788872998.304104:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1f800 x1875765327894272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.304106:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327893888 00000020:00000040:1.0:1788872998.304108:0:66190:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db806 00000020:00000040:1.0:1788872998.304110:0:66190:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9f0834000 refcount=5 00000100:00100000:0.0:1788872998.304112:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327894272:0@lo:8:kworker.0 00000020:00000040:1.0:1788872998.304121:0:66190:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff98a9e99999c0) now 14 - evictor 00000100:00000040:0.0:1788872998.304124:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1f800 x1875765327894272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873023 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.304130:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1788872998.304142:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327894528 00000100:00000040:0.0:1788872998.304143:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5ad500 x1875765327894272 msgsize 520 00000100:00100000:1.0:1788872998.304145:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327894528 00000020:00000040:1.0:1788872998.304147:0:66190:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db80d 00000100:00100000:0.0:1788872998.304147:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000040:1.0:1788872998.304149:0:66190:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9f0835000 refcount=5 00000100:00100000:1.0:1788872998.304160:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327893760 00000100:00000040:0.0:1788872998.304161:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1f800 x1875765327894272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873023 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.304162:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327893760 00000020:00000040:1.0:1788872998.304164:0:66190:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00000040:0.0:1788872998.304172:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 6690 usecs (7 jiffies) 00000100:00100000:1.0:1788872998.304174:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00000040:1.0:1788872998.304177:0:66190:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9df96b800 : new rpc_count 1 00000100:00000040:0.0:1788872998.304179:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4934a80 x1875765327894784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.304182:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81ed80 x1875765327895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:169/0 lens 224/0 e 0 to 0 dl 1788873009 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.304188:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327894784:0@lo:8:kworker.0 00000100:00100000:1.0:1788872998.304193:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327895040:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1788872998.304198:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4934a80 x1875765327894784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873023 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1788872998.304205:0:66190:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327895040 00000100:00000040:1.0:1788872998.304209:0:66190:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 55 to 0@lo 00000100:00000040:0.0:1788872998.304211:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.304213:0:66190:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.304224:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5ac700 x1875765327894784 msgsize 520 00000100:00000040:1.0:1788872998.304227:0:66190:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4934000 x1875765327895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.304228:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872998.304243:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4934a80 x1875765327894784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873023 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.305619:0:66190:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 54 to 0@lo 00000100:00000040:1.0:1788872998.305630:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81ed80 x1875765327895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:169/0 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.305642:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875765327895040:12345-0@lo:400:kworker.0 Request processed in 1449us (2320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872998.305664:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00000040:1.0:1788872998.305667:0:66190:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9df96b800 : new rpc_count 0 00000020:00000040:1.0:1788872998.305678:0:66190:0:(genops.c:900:class_export_put()) PUTting export ffff98a9df96b800 : new refcount 4 00000100:00100000:1.0:1788872998.305697:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00000040:1.0:1788872998.305700:0:66190:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9f0834000 : new rpc_count 1 00000100:00000040:1.0:1788872998.305705:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81f100 x1875765327893888/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:169/0 lens 224/0 e 0 to 0 dl 1788873009 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.305730:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327893888:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788872998.305746:0:66190:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327893888 00000100:00000040:1.0:1788872998.305754:0:66190:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 55 to 0@lo 00000100:00000040:1.0:1788872998.305759:0:66190:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.305788:0:66190:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f5c1d500 x1875765327893888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.305806:0:66190:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 54 to 0@lo 00000100:00000040:1.0:1788872998.305810:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81f100 x1875765327893888/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:169/0 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.305929:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327893888:12345-0@lo:400:kworker.0 Request processed in 92us (2413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872998.305935:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00000040:1.0:1788872998.305937:0:66190:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9f0834000 : new rpc_count 0 00000020:00000040:1.0:1788872998.305944:0:66190:0:(genops.c:900:class_export_put()) PUTting export ffff98a9f0834000 : new refcount 4 00000100:00100000:1.0:1788872998.305963:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00000040:1.0:1788872998.305966:0:66190:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9f0835000 : new rpc_count 1 00000100:00000040:1.0:1788872998.305971:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81e680 x1875765327894528/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:169/0 lens 224/0 e 0 to 0 dl 1788873009 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.305982:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327894528:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788872998.305999:0:66190:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327894528 00000100:00000040:1.0:1788872998.306004:0:66190:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 55 to 0@lo 00000100:00000040:1.0:1788872998.306008:0:66190:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.306026:0:66190:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4937b80 x1875765327894528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.306039:0:66190:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 54 to 0@lo 00000100:00000040:1.0:1788872998.306043:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81e680 x1875765327894528/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:169/0 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.306051:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327894528:12345-0@lo:400:kworker.0 Request processed in 72us (2580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872998.306058:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00000040:1.0:1788872998.306060:0:66190:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9f0835000 : new rpc_count 0 00000020:00000040:1.0:1788872998.306066:0:66190:0:(genops.c:900:class_export_put()) PUTting export ffff98a9f0835000 : new refcount 4 00000100:00100000:1.0:1788872998.306075:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603 00000100:00000040:1.0:1788872998.306080:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5aca80 x1875765327893760/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1788873018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.306089:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875765327893760:12345-0@lo:38:llog_process_th.0 00000020:00000040:1.0:1788872998.306104:0:66190:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff98a9e99999c0) now 15 - find 00010000:00000040:1.0:1788872998.306112:0:66190:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1788872998.306119:0:66190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3935 last 0 00000020:00000040:1.0:1788872998.306128:0:66190:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98aa002c0800 with handle 0xe4e6e89fb01dc637 to hash 00000020:00000040:1.0:1788872998.306155:0:66190:0:(genops.c:889:class_export_get()) GET export ffff98aa002c0800 refcount=3 00000020:00000040:1.0:1788872998.306159:0:66190:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff98a9e99999c0) now 16 - export 00000020:00000040:1.0:1788872998.306162:0:66190:0:(genops.c:900:class_export_put()) PUTting export ffff98aa002c0800 : new refcount 2 00000020:00000080:1.0:1788872998.306164:0:66190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe4e6e89fb01dc637 00000020:00000040:1.0:1788872998.306167:0:66190:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc637 00000020:00000040:1.0:1788872998.306169:0:66190:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98aa002c0800 refcount=3 00000001:00000040:1.0:1788872998.306185:0:66190:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.139@tcp 00000001:00000040:1.0:1788872998.306190:0:66190:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff98a8c3866800) : new refcount 17 00000020:00000040:1.0:1788872998.306194:0:66190:0:(genops.c:889:class_export_get()) GET export ffff98aa002c0800 refcount=4 00000001:00000040:1.0:1788872998.306196:0:66190:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff98a8c3866800) : new refcount 18 00000001:00000040:1.0:1788872998.306200:0:66190:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff98a8c3866800) : new refcount 17 00000004:00100000:1.0:1788872998.306205:0:66190:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:1.0:1788872998.306214:0:66190:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff98a9f82a1000 for nid 0@lo - ref 6 00000020:00000040:1.0:1788872998.306222:0:66190:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff98a9e99999c0) now 17 - import 00000020:00000040:1.0:1788872998.306229:0:66190:0:(genops.c:1244:class_import_put()) import ffff98aa002c3800 refcount=1 obd=lustre-MDT0000 00000020:00000040:1.0:1788872998.306234:0:66190:0:(genops.c:889:class_export_get()) GET export ffff98aa002c0800 refcount=5 00000100:00000040:1.0:1788872998.306236:0:66190:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff98aa002c0800 : new rpc_count 1 00000100:00000040:1.0:1788872998.306240:0:66190:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 55 to 0@lo 00000100:00000040:1.0:1788872998.306243:0:66190:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 55 to 0@lo 00000020:00000040:1.0:1788872998.306245:0:66190:0:(genops.c:889:class_export_get()) GET export ffff98aa002c0800 refcount=6 00000100:00000040:1.0:1788872998.306252:0:66190:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 56 to 0@lo 00000100:00080000:1.0:1788872998.306260:0:66190:0:(import.c:65:import_set_state_nolock()) ffff98aa002c3800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1788872998.306265:0:66190:0:(genops.c:900:class_export_put()) PUTting export ffff98aa002c0800 : new refcount 5 00000020:00000040:1.0:1788872998.306267:0:66190:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff98a9e99999c0) now 17 - find 00010000:00000040:1.0:1788872998.306278:0:66190:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327893760 00000100:00000040:1.0:1788872998.306282:0:66190:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 57 to 0@lo 00000100:00000040:1.0:1788872998.306285:0:66190:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.306303:0:66190:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff98a9f5c1c700 x1875765327893760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788873008 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.306318:0:66190:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 56 to 0@lo 00000100:00000040:1.0:1788872998.306322:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5aca80 x1875765327893760/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788873018 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.306331:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875765327893760:12345-0@lo:38:llog_process_th.0 Request processed in 242us (2292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872998.306338:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603 00000100:00000040:1.0:1788872998.306346:0:66190:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98aa002c0800 : new rpc_count 0 00000020:00000040:1.0:1788872998.306352:0:66190:0:(genops.c:900:class_export_put()) PUTting export ffff98aa002c0800 : new refcount 4 00000100:00100000:1.0:1788872998.306384:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327894272 00000100:00100000:1.0:1788872998.306406:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327894272 00000020:00000040:1.0:1788872998.306408:0:26183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d552d 00000100:00100000:1.0:1788872998.306436:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327894784 00000100:00100000:1.0:1788872998.306440:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327894784 00000020:00000040:1.0:1788872998.306441:0:26183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6e0 00000100:00100000:1.0:1788872998.306456:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6089 00000100:00000040:1.0:1788872998.306461:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5ad500 x1875765327894272/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788873018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.306471:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3643:x1875765327894272:12345-0@lo:8:kworker.0 00000020:00000040:1.0:1788872998.306481:0:26183:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 7 - find 00010000:00000040:1.0:1788872998.306485:0:26183:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:1.0:1788872998.306487:0:26183:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff98a8c1cfcd40) now 7 - find 00000100:00000040:1.0:1788872998.306495:0:26183:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 57 to 0@lo 00000100:00000040:1.0:1788872998.306498:0:26183:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 57 to 0@lo 00000100:00000040:1.0:1788872998.306501:0:26183:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.306519:0:26183:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff98a9f5c1f800 x1875765327894272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873023 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.306533:0:26183:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 56 to 0@lo 00000100:00000040:1.0:1788872998.306536:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ad500 x1875765327894272/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788873018 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.306544:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3643:x1875765327894272:12345-0@lo:8:kworker.0 Request processed in 73us (2400us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788872998.306572:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6089 00000100:00100000:1.0:1788872998.306584:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6090 00000100:00000040:1.0:1788872998.306588:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5ac700 x1875765327894784/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788873018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.306606:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3643:x1875765327894784:12345-0@lo:8:kworker.0 00000020:00000040:1.0:1788872998.306615:0:26183:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 7 - find 00010000:00000040:1.0:1788872998.306617:0:26183:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:1.0:1788872998.306619:0:26183:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff98a8c1cfcd40) now 7 - find 00000100:00000040:1.0:1788872998.306625:0:26183:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 57 to 0@lo 00000100:00000040:1.0:1788872998.306627:0:26183:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 57 to 0@lo 00000100:00000040:1.0:1788872998.306630:0:26183:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.306645:0:26183:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff98a9f4934a80 x1875765327894784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873023 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.306657:0:26183:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 56 to 0@lo 00000100:00000040:1.0:1788872998.306660:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ac700 x1875765327894784/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788873018 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.306667:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3643:x1875765327894784:12345-0@lo:8:kworker.0 Request processed in 61us (2441us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788872998.306672:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6090 00000100:00000040:1.0:1788872998.306723:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788872998.306730:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1d500 x1875765327893888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.306740:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1d500 x1875765327893888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.306747:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327893888:0@lo:400:kworker.0 00000100:00000040:1.0:1788872998.306759:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788872998.306763:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4937b80 x1875765327894528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.306770:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4937b80 x1875765327894528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.306783:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327894528:0@lo:400:kworker.0 00000100:00000040:1.0:1788872998.306797:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:1.0:1788872998.306801:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1dc00 x1875765327894400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.306808:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1dc00 x1875765327894400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.306895:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327894400:0@lo:400:kworker.0 00000100:00000040:1.0:1788872998.306910:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788872998.306914:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4934000 x1875765327895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.306921:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934000 x1875765327895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.306926:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875765327895040:0@lo:400:kworker.0 00000100:00000040:1.0:1788872998.306932:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1d500 x1875765327893888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872998.306941:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9efadc000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1788872998.306951:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4937b80 x1875765327894528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872998.306969:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9dfe96800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1788872998.306974:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1dc00 x1875765327894400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872998.306980:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9dfe90800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1788872998.306984:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4934000 x1875765327895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872998.306997:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a8ca9bc000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1788872998.308116:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8502 usecs (9 jiffies) 00000100:00080000:0.0:1788872998.308164:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1788872998.308171:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff98a9e99999c0) now 16 - evictor 00000100:00000040:0.0:1788872998.308215:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294969456 00000100:00000040:0.0:1788872998.308224:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4934a80 x1875765327894784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873023 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872998.308234:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872998.308238:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:0.0:1788872998.308242:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934a80 x1875765327894784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873023 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.308250:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327894784:0@lo:8:kworker.0 00000100:00000040:0.0:1788872998.308255:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4934a80 x1875765327894784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873023 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872998.308264:0:3643:0:(genops.c:1244:class_import_put()) import ffff98a8c37f1000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1788872998.308286:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:0.0:1788872998.308290:0:3643:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:0.0:1788872998.308294:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1c700 x1875765327893760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872998.308305:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000020:00000040:0.0:1788872998.308307:0:3643:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc630 00000020:00000040:0.0:1788872998.308310:0:3643:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9efc04800 refcount=4 00000100:00080000:0.0:1788872998.308323:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:0.0:1788872998.308326:0:3643:0:(genops.c:900:class_export_put()) PUTting export ffff98a9efc04800 : new refcount 3 00000100:00080000:0.0:1788872998.308330:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788872998.308332:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9ef237000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:0.0:1788872998.308339:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1c700 x1875765327893760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873008 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.308346:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1875765327893760:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1788872998.308358:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:0.0:1788872998.308362:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1f800 x1875765327894272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873023 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872998.308369:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788872998.308372:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:0.0:1788872998.308376:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1f800 x1875765327894272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873023 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.308382:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327894272:0@lo:8:kworker.0 00000100:00000040:0.0:1788872998.308388:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1c700 x1875765327893760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873008 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872998.308396:0:3643:0:(genops.c:1244:class_import_put()) import ffff98a9ef237000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1788872998.308401:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1f800 x1875765327894272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788873023 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872998.308409:0:3643:0:(genops.c:1244:class_import_put()) import ffff98a9e7bf8800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1788872998.308566:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4935880 x1875765327894016 msgsize 224 00000100:00100000:3.0:1788872998.308573:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872998.308600:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1d880 x1875765327894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.308612:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8790 usecs (9 jiffies) 00000100:00000040:3.0:1788872998.308619:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4936a00 x1875765327894656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.308630:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327894656:0@lo:400:kworker.0 00000100:00000040:3.0:1788872998.308653:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4936a00 x1875765327894656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.308660:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.309037:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4936300 x1875765327894656 msgsize 224 00000100:00100000:3.0:1788872998.309042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872998.309064:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4936a00 x1875765327894656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.309074:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5057 usecs (6 jiffies) 00000100:00100000:3.0:1788872998.309084:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:3.0:1788872998.309096:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f5c1d180 x1875765327894144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.309106:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f5c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327894144:0@lo:400:kworker.0 00000100:00000040:3.0:1788872998.309120:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f5c1d180 x1875765327894144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.311106:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327894016 00000100:00100000:0.0:1788872998.311123:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327894016 00000020:00000040:0.0:1788872998.311127:0:66190:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d55b9 00000020:00000040:0.0:1788872998.311134:0:66190:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c37f4800 refcount=5 00000020:00000040:0.0:1788872998.311158:0:66190:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff98a9f9df99c0) now 10 - evictor 00000100:00000040:0.0:1788872998.311205:0:66190:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1788872998.311240:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00000040:0.0:1788872998.311244:0:66190:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c37f4800 : new rpc_count 1 00000100:00000040:0.0:1788872998.311250:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4935880 x1875765327894016/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:169/0 lens 224/0 e 0 to 0 dl 1788873009 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.311264:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327894016:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788872998.311287:0:66190:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327894016 00000100:00000040:0.0:1788872998.311298:0:66190:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 57 to 0@lo 00000100:00000040:0.0:1788872998.311304:0:66190:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.311366:0:66190:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f5c1d880 x1875765327894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.311407:0:66190:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 56 to 0@lo 00000100:00000040:0.0:1788872998.311412:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4935880 x1875765327894016/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:169/0 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.311419:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327894016:12345-0@lo:400:kworker.0 Request processed in 159us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872998.311426:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00000040:0.0:1788872998.311429:0:66190:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c37f4800 : new rpc_count 0 00000020:00000040:0.0:1788872998.311439:0:66190:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c37f4800 : new refcount 4 00000100:00080000:0.0:1788872998.311455:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1788872998.311460:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff98a9f9df99c0) now 10 - evictor 00000100:00000040:3.0:1788872998.311883:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.311909:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4935f80 x1875765327894144 msgsize 224 00000100:00100000:3.0:1788872998.311913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872998.311936:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f5c1d180 x1875765327894144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.311948:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1537508 usecs (1538 jiffies) 00000100:00100000:2.0:1788872998.311965:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327894656 00000100:00000040:3.0:1788872998.311968:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4934e00 x1875765327894912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.311970:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327894656 00000020:00000040:2.0:1788872998.311973:0:30614:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6b6 00000020:00000040:2.0:1788872998.311976:0:30614:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ff63e800 refcount=5 00000100:00100000:3.0:1788872998.311981:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327894912:0@lo:400:kworker.0 00000100:00000040:2.0:1788872998.311992:0:30614:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:3.0:1788872998.312002:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4934e00 x1875765327894912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.312007:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327894144 00000100:00000040:3.0:1788872998.312009:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1788872998.312010:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327894144 00000020:00000040:2.0:1788872998.312011:0:30614:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db67e 00000020:00000040:2.0:1788872998.312013:0:30614:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9cb5ec800 refcount=7 00000100:00000040:3.0:1788872998.312024:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4935c00 x1875765327894912 msgsize 224 00000100:00100000:3.0:1788872998.312027:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788872998.312029:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4086 00000100:00000040:2.0:1788872998.312032:0:30614:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9ff63e800 : new rpc_count 1 00000100:00000040:2.0:1788872998.312036:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4936300 x1875765327894656/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:169/0 lens 224/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.312037:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4934e00 x1875765327894912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.312047:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 5907 usecs (6 jiffies) 00000100:00100000:2.0:1788872998.312048:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327894656:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788872998.312060:0:30614:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327894656 00000100:00000040:2.0:1788872998.312065:0:30614:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 57 to 0@lo 00000100:00000040:2.0:1788872998.312068:0:30614:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.312069:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1788872998.312073:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1d880 x1875765327894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.312082:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1d880 x1875765327894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.312085:0:30614:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4936a00 x1875765327894656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.312097:0:30614:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 56 to 0@lo 00000100:00000040:2.0:1788872998.312101:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4936300 x1875765327894656/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:169/0 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.312115:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327894016:0@lo:400:kworker.0 00000100:00100000:2.0:1788872998.312118:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327894656:12345-0@lo:400:kworker.0 Request processed in 71us (3079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872998.312124:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4086 00000100:00000040:3.0:1788872998.312126:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788872998.312126:0:30614:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9ff63e800 : new rpc_count 0 00000100:00000040:3.0:1788872998.312130:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4936a00 x1875765327894656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.312133:0:30614:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ff63e800 : new refcount 4 00000100:00000040:3.0:1788872998.312137:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4936a00 x1875765327894656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.312142:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4087 00000100:00100000:3.0:1788872998.312144:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327894656:0@lo:400:kworker.0 00000100:00000040:2.0:1788872998.312144:0:30614:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9cb5ec800 : new rpc_count 1 00000100:00000040:2.0:1788872998.312148:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4935f80 x1875765327894144/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:169/0 lens 224/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.312151:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1d880 x1875765327894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.312157:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327894144:12345-0@lo:400:kworker.0 00000020:00000040:3.0:1788872998.312163:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a8c2644800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00010000:00000040:2.0:1788872998.312166:0:30614:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1875765327894144 00000100:00000040:2.0:1788872998.312169:0:30614:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 57 to 0@lo 00000100:00000040:3.0:1788872998.312172:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4936a00 x1875765327894656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.312173:0:30614:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:3.0:1788872998.312178:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a8c9e82800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788872998.312186:0:30614:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f5c1d180 x1875765327894144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.312201:0:30614:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 56 to 0@lo 00000100:00000040:2.0:1788872998.312205:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4935f80 x1875765327894144/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:169/0 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.312212:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327894144:12345-0@lo:400:kworker.0 Request processed in 56us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872998.312217:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4087 00000100:00000040:2.0:1788872998.312220:0:30614:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9cb5ec800 : new rpc_count 0 00000020:00000040:2.0:1788872998.312225:0:30614:0:(genops.c:900:class_export_put()) PUTting export ffff98a9cb5ec800 : new refcount 6 00000100:00000040:2.0:1788872998.312366:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00000040:2.0:1788872998.312371:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f5c1d180 x1875765327894144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.312388:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1d180 x1875765327894144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.312395:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f5c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327894144:0@lo:400:kworker.0 00000100:00000040:2.0:1788872998.312400:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f5c1d180 x1875765327894144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.312407:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a9df8c9800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:00000040:1.0:1788872998.315019:0:96959:0:(genops.c:889:class_export_get()) GET export ffff98a9efc04800 refcount=4 00000020:00000040:1.0:1788872998.315036:0:96959:0:(genops.c:889:class_export_get()) GET export ffff98a9efc04800 refcount=5 00000100:00000040:1.0:1788872998.315110:0:96959:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.204.139@tcp 192.168.204.139@tcp cnt=1 00000020:01000004:1.0:1788872998.315149:0:96959:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788872998.315164:0:96959:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98a9f6714d40) 00000020:00000040:1.0:1788872998.315171:0:96959:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98aa002c5800 with handle 0xe4e6e89fb01dc63e to hash 00000020:00000040:1.0:1788872998.315178:0:96959:0:(genops.c:900:class_export_put()) PUTting export ffff98aa002c5800 : new refcount 1 00000020:00000040:1.0:1788872998.315194:0:96959:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff98a9f6714d40) now 2 - obd_device_list 00000020:00000080:1.0:1788872998.315200:0:96959:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788872998.315371:0:96959:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98a9fbfad000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788872998.315375:0:96959:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98a9fbfad000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788872998.315378:0:96959:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98a9fbfad000 3 00000100:00100000:0.0:1788872998.315987:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327894912 00000100:00100000:0.0:1788872998.315998:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327894912 00000020:00000040:0.0:1788872998.316001:0:26188:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6ee 00000020:00000040:0.0:1788872998.316005:0:26188:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9dfe94000 refcount=5 00000020:00000040:0.0:1788872998.316020:0:26188:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:0.0:1788872998.316038:0:26188:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1788872998.316064:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795 00000100:00000040:0.0:1788872998.316068:0:26188:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9dfe94000 : new rpc_count 1 00000100:00000040:0.0:1788872998.316082:0:26188:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4935c00 x1875765327894912/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:169/0 lens 224/0 e 0 to 0 dl 1788873009 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.316096:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327894912:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788872998.316117:0:26188:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875765327894912 00000100:00000040:0.0:1788872998.316141:0:26188:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 57 to 0@lo 00000100:00000040:0.0:1788872998.316146:0:26188:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.316193:0:26188:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4934e00 x1875765327894912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.316244:0:26188:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 56 to 0@lo 00000100:00000040:0.0:1788872998.316249:0:26188:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4935c00 x1875765327894912/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:169/0 lens 224/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.316257:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327894912:12345-0@lo:400:kworker.0 Request processed in 164us (4231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872998.316265:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795 00000100:00000040:0.0:1788872998.316268:0:26188:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9dfe94000 : new rpc_count 0 00000020:00000040:0.0:1788872998.316277:0:26188:0:(genops.c:900:class_export_put()) PUTting export ffff98a9dfe94000 : new refcount 4 00000100:00080000:0.0:1788872998.316290:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788872998.316294:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:0.0:1788872998.316328:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:0.0:1788872998.316335:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4934e00 x1875765327894912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.316345:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934e00 x1875765327894912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.316352:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327894912:0@lo:400:kworker.0 00000100:00000040:0.0:1788872998.316359:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4934e00 x1875765327894912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872998.316380:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a9e021b000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000020:00000040:3.0:1788872998.316456:0:96961:0:(genops.c:889:class_export_get()) GET export ffff98a9efc04800 refcount=6 00000020:00000040:3.0:1788872998.316461:0:96961:0:(genops.c:889:class_export_get()) GET export ffff98a9efc04800 refcount=7 00000020:00000040:3.0:1788872998.316464:0:96961:0:(genops.c:900:class_export_put()) PUTting export ffff98a9efc04800 : new refcount 6 00000020:00000040:1.0:1788872998.317209:0:96959:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff98a9f6714d40) now 3 - import 00000020:00000040:1.0:1788872998.317218:0:96959:0:(genops.c:1244:class_import_put()) import ffff98a8c1f5c800 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:1.0:1788872998.317231:0:96959:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 57 to 0@lo 00000100:00000040:1.0:1788872998.317234:0:96959:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 57 to 0@lo 00000100:00000040:1.0:1788872998.317236:0:96959:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.139@tcp -> ffff98a9c86f8940 00010000:00080000:1.0:1788872998.317240:0:96959:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98a8c1f5c800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.139@tcp at head 00010000:00010000:1.0:1788872998.324596:0:96959:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000040:1.0:1788872998.324722:0:96959:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff98a9f6714d40) now 4 - setup 00000020:00000080:1.0:1788872998.324727:0:96959:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788872998.324774:0:96959:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:1.0:1788872998.324781:0:96959:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98aa002c7000 with handle 0xe4e6e89fb01dc645 to hash 00000020:00000040:1.0:1788872998.324787:0:96959:0:(genops.c:889:class_export_get()) GET export ffff98aa002c7000 refcount=3 00000020:00000040:1.0:1788872998.324792:0:96959:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff98a9f6714d40) now 5 - export 00000020:00000040:1.0:1788872998.324795:0:96959:0:(genops.c:900:class_export_put()) PUTting export ffff98aa002c7000 : new refcount 2 00000020:00000080:1.0:1788872998.324798:0:96959:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe4e6e89fb01dc645 00000020:00000040:1.0:1788872998.324801:0:96959:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc645 00000020:00000040:1.0:1788872998.325625:0:96959:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98aa002c7000 refcount=3 00000100:00080000:1.0:1788872998.325640:0:96959:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:1.0:1788872998.325645:0:96959:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 58 to 0@lo 00000020:00000040:1.0:1788872998.325648:0:96959:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc645 00000020:00000040:1.0:1788872998.325651:0:96959:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98aa002c7000 refcount=4 00000100:00000040:1.0:1788872998.325654:0:96959:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 59 to 0@lo 00000020:00000040:1.0:1788872998.325656:0:96959:0:(genops.c:900:class_export_put()) PUTting export ffff98aa002c7000 : new refcount 3 00000100:00080000:1.0:1788872998.325659:0:96959:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98a8c1f5c800 using connection 192.168.204.139@tcp/0@lo 00000020:00000040:1.0:1788872998.325677:0:96959:0:(genops.c:1231:class_import_get()) import ffff98a8c1f5c800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:1.0:1788872998.325716:0:96959:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9ee81c700 x1875765327895168/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872998.325733:0:96959:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002e2880bf] to pc [ptlrpcd_rcv+-1] req@ffff98a9ee81c700 x1875765327895168/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788872998.325757:0:96959:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:1.0:1788872998.325760:0:96959:0:(genops.c:1231:class_import_get()) import ffff98a8c1f5c800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1788872998.325920:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ee81c700 x1875765327895168/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.325937:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875765327895168:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1788872998.325970:0:82775:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3940) 00000100:00000040:0.0:1788872998.325990:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ee81c700 x1875765327895168/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788873008 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.326009:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.326055:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5adc00 x1875765327895168 msgsize 520 00000100:00100000:0.0:1788872998.326061:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872998.326098:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ee81c700 x1875765327895168/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788873008 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.326120:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00100000:0.0:1788872998.326167:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327895168 00000100:00100000:0.0:1788872998.326176:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327895168 00000020:00000040:0.0:1788872998.326178:0:66979:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:0.0:1788872998.326228:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00000040:0.0:1788872998.326249:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5adc00 x1875765327895168/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1788873018 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.326259:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875765327895168:12345-0@lo:38:llog_process_th.0 00000020:00000040:0.0:1788872998.326273:0:66979:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff98a9f9df99c0) now 10 - find 00010000:00000040:0.0:1788872998.326284:0:66979:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1788872998.326292:0:66979:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3935 last 0 00000020:00000040:0.0:1788872998.326302:0:66979:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a9df968800 with handle 0xe4e6e89fb01dc64c to hash 00000020:00000040:0.0:1788872998.326330:0:66979:0:(genops.c:889:class_export_get()) GET export ffff98a9df968800 refcount=3 00000020:00000040:0.0:1788872998.326334:0:66979:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff98a9f9df99c0) now 11 - export 00000020:00000040:0.0:1788872998.326336:0:66979:0:(genops.c:900:class_export_put()) PUTting export ffff98a9df968800 : new refcount 2 00000020:00000080:0.0:1788872998.326345:0:66979:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe4e6e89fb01dc64c 00000020:00000040:0.0:1788872998.326347:0:66979:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc64c 00000020:00000040:0.0:1788872998.326349:0:66979:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9df968800 refcount=3 00000001:00000040:0.0:1788872998.326359:0:66979:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.139@tcp 00000001:00000040:0.0:1788872998.326364:0:66979:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff98a8c3866800) : new refcount 18 00000020:00000040:0.0:1788872998.326368:0:66979:0:(genops.c:889:class_export_get()) GET export ffff98a9df968800 refcount=4 00000001:00000040:0.0:1788872998.326370:0:66979:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff98a8c3866800) : new refcount 19 00000001:00000040:0.0:1788872998.326375:0:66979:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff98a8c3866800) : new refcount 18 00000004:00100000:0.0:1788872998.326381:0:66979:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:0.0:1788872998.326390:0:66979:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff98aa002e97e0 for nid 0@lo - ref 4 00000020:00000040:0.0:1788872998.326401:0:66979:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff98a9f9df99c0) now 12 - import 00000020:00000040:0.0:1788872998.326406:0:66979:0:(genops.c:1244:class_import_put()) import ffff98a9e99a5000 refcount=1 obd=lustre-MDT0001 00000020:00000040:0.0:1788872998.326414:0:66979:0:(genops.c:889:class_export_get()) GET export ffff98a9df968800 refcount=5 00000100:00000040:0.0:1788872998.326416:0:66979:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff98a9df968800 : new rpc_count 1 00000100:00000040:0.0:1788872998.326421:0:66979:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 60 to 0@lo 00000100:00000040:0.0:1788872998.326424:0:66979:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 60 to 0@lo 00000020:00000040:0.0:1788872998.326427:0:66979:0:(genops.c:889:class_export_get()) GET export ffff98a9df968800 refcount=6 00000100:00000040:0.0:1788872998.326432:0:66979:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000100:00080000:0.0:1788872998.326439:0:66979:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a5000 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1788872998.326444:0:66979:0:(genops.c:900:class_export_put()) PUTting export ffff98a9df968800 : new refcount 5 00000020:00000040:0.0:1788872998.326446:0:66979:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff98a9f9df99c0) now 12 - find 00010000:00000040:0.0:1788872998.326460:0:66979:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327895168 00000100:00000040:0.0:1788872998.326469:0:66979:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:0.0:1788872998.326474:0:66979:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.326494:0:66979:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff98a9ee81c700 x1875765327895168/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788873008 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.326520:0:66979:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000100:00000040:0.0:1788872998.326525:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5adc00 x1875765327895168/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788873018 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.326533:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875765327895168:12345-0@lo:38:llog_process_th.0 Request processed in 275us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872998.326547:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00000040:0.0:1788872998.326567:0:66979:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9df968800 : new rpc_count 0 00000020:00000040:0.0:1788872998.326578:0:66979:0:(genops.c:900:class_export_put()) PUTting export ffff98a9df968800 : new refcount 4 00000100:00100000:0.0:1788872998.326610:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:0.0:1788872998.326614:0:3643:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:0.0:1788872998.326620:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ee81c700 x1875765327895168/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788872998.326630:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 18 00000020:00000040:0.0:1788872998.326633:0:3643:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc645 00000020:00000040:0.0:1788872998.326635:0:3643:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98aa002c7000 refcount=4 00000100:00080000:0.0:1788872998.326641:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:0.0:1788872998.326643:0:3643:0:(genops.c:900:class_export_put()) PUTting export ffff98aa002c7000 : new refcount 3 00000100:00080000:0.0:1788872998.326647:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788872998.326650:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c1f5c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:0.0:1788872998.326656:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81c700 x1875765327895168/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873008 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.326663:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1875765327895168:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1788872998.326669:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ee81c700 x1875765327895168/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788873008 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872998.326677:0:3643:0:(genops.c:1244:class_import_put()) import ffff98a8c1f5c800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000020:00000040:3.0:1788872998.329213:0:96959:0:(genops.c:889:class_export_get()) GET export ffff98aa002c7000 refcount=4 00000020:00000040:3.0:1788872998.329232:0:96959:0:(genops.c:889:class_export_get()) GET export ffff98aa002c7000 refcount=5 00000040:00080000:3.0:1788872998.329327:0:96959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:00000040:2.0:1788872998.329394:0:96963:0:(genops.c:900:class_export_put()) PUTting export ffff98aa002c7000 : new refcount 4 00000020:01000000:0.0:1788872998.329468:0:96948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:0.0:1788872998.329508:0:96948:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000040:0.0:1788872998.329522:0:96948:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8cc3e6a00 refcount=3 00010000:00010000:0.0:1788872998.329529:0:96948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e6a00/0xe4e6e89fb01dc61b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc622 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.329601:0:96948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8cc3e6a00/0xe4e6e89fb01dc61b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc622 expref: -99 pid: 96948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788872998.329697:0:96948:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788872998.329700:0:96948:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788872998.329701:0:96948:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872998.329703:0:96948:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872998.329705:0:96948:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872998.329706:0:96948:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872998.329708:0:96948:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788872998.329709:0:96948:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872998.329710:0:96948:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788872998.329714:0:96948:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788872998.329716:0:96948:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788872998.329718:0:96948:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788872998.329719:0:96948:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788872998.329720:0:96948:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788872998.329721:0:96948:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788872998.329722:0:96948:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788872998.329723:0:96948:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788872998.329724:0:96948:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788872998.329725:0:96948:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:0.0:1788872998.329732:0:96948:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 10000000:01000000:0.0:1788872998.329753:0:96948:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:0.0:1788872998.329772:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df5ad180 x1875765327895296/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.329784:0:96948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327895296:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1788872998.329815:0:96948:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df5ad180 x1875765327895296/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.329823:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.329862:0:96948:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c454c450 x1875765327895296 msgsize 4848 00000100:00100000:0.0:1788872998.329867:0:96948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872998.330418:0:96948:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788872998.330461:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9df5ad180 x1875765327895296/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.330476:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327895296 00000100:00100000:2.0:1788872998.330483:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327895296 00000020:00000040:2.0:1788872998.330485:0:94377:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:2.0:1788872998.330488:0:94377:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=24 00000100:00100000:0.0:1788872998.330497:0:96948:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c674dd80 going to sleep for 11 seconds 00000100:00000040:2.0:1788872998.330506:0:94377:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788872998.330590:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00000040:1.0:1788872998.330595:0:94376:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:1.0:1788872998.330601:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c454c450 x1875765327895296/t0(0) o253->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 4848/0 e 0 to 0 dl 1788873009 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.330617:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327895296:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788872998.330648:0:94376:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788872998.330661:0:94376:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788872998.342508:0:94376:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788872998.343121:0:94376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:1.0:1788872998.343439:0:94376:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327895296 00000100:00000040:1.0:1788872998.343455:0:94376:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:1.0:1788872998.343464:0:94376:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.343518:0:94376:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff98a9df5ad180 x1875765327895296/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 20000000:01000000:0.0:1788872998.343802:0:94378:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788872998.343807:0:94378:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00000040:2.0:1788872998.343826:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df5ad180 x1875765327895296/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872998.343838:0:96948:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ad180 x1875765327895296/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872998.343846:0:96948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f2e885a0-f180-4b85-9f87-6a01e20afd1a:96948:1875765327895296:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1788872998.343854:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df5ad180 x1875765327895296/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788872998.343866:0:96948:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788872998.343869:0:96948:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788872998.343871:0:96948:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788872998.343873:0:96948:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788872998.343874:0:96948:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788872998.343875:0:96948:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788872998.343876:0:96948:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788872998.343884:0:96948:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788872998.343886:0:96948:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788872998.343888:0:96948:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:2.0:1788872998.343892:0:96948:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df5ad180 x1875765327895296/t0(0) o253->MGC192.168.204.139@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872998.343903:0:96948:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000020:02000000:2.0:1788872998.343919:0:96948:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00000040:0.0:1788872998.343942:0:94378:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a9faf66300 count: 4 00000020:00000040:0.0:1788872998.343963:0:94378:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a8cc3e6800 with handle 0xe4e6e89fb01dc653 to hash 00010000:00010000:0.0:1788872998.343971:0:94378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.343985:0:94378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db73b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db734 expref: 24 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.343994:0:94378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01db750 expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.344003:0:94378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98a9efac4200/0xe4e6e89fb01db7f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1eb expref: 9 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.344010:0:94378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.344016:0:94378:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff98a9faf66300) refcount = 4 00010000:00000040:0.0:1788872998.344019:0:94378:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1788872998.344021:0:94378:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a9efac4200/0xe4e6e89fb01db7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1eb expref: 9 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.344027:0:94378:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0xe4e6e89fb01db750 expref: 24 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.344033:0:94378:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db73b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0xe4e6e89fb01db734 expref: 24 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.344044:0:94378:0:(ldlm_resource.c:1894:ldlm_resource_dump()) Waiting locks: 00010000:00000040:0.0:1788872998.344046:0:94378:0:(ldlm_resource.c:1896:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788872998.344064:0:94378:0:(genops.c:1231:class_import_get()) import ffff98a8ca9b9000 refcount=2 obd=MGS 00002000:00000040:2.0:1788872998.344077:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00010000:00010000:0.0:1788872998.344082:0:94378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9efac4200/0xe4e6e89fb01db7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1eb expref: 9 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000040:2.0:1788872998.344089:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00010000:00010000:0.0:1788872998.344096:0:94378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9efac4200/0xe4e6e89fb01db7f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1eb expref: 9 pid: 94376 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788872998.344109:0:94378:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df5ae680 x1875765327895424/t0(0) o104->MGS@192.168.204.39@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872998.344120:0:94378:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ae680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94378:1875765327895424:192.168.204.39@tcp:104: 00002000:00000040:2.0:1788872998.344132:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00000100:00000040:0.0:1788872998.344143:0:94378:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff98a9df5ae680 x1875765327895424/t0(0) o104->MGS@192.168.204.39@tcp:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788872998.344151:0:94378:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00002000:00000040:2.0:1788872998.344163:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00000100:00000040:1.0:1788872998.344251:0:94376:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000100:00000040:1.0:1788872998.344258:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c454c450 x1875765327895296/t0(0) o253->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 4848/4768 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.344267:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:96948:x1875765327895296:12345-0@lo:253:mount.lustre.0 Request processed in 13655us (14403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872998.344277:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00000040:1.0:1788872998.344281:0:94376:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:1.0:1788872998.344293:0:94376:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 23 00002000:00000040:2.0:1788872998.344470:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00002000:00000040:2.0:1788872998.344504:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:2.0:1788872998.344524:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00002000:00000040:2.0:1788872998.344545:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00002000:00000040:2.0:1788872998.344608:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00002000:00000040:2.0:1788872998.344653:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 00000020:00000040:0.0:1788872998.345048:0:94378:0:(genops.c:1231:class_import_get()) import ffff98a8c2644000 refcount=2 obd=MGS 00010000:00010000:0.0:1788872998.345064:0:94378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db750 expref: 23 pid: 94375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.345075:0:94378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db757 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db750 expref: 23 pid: 94375 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788872998.345086:0:94378:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df5ad180 x1875765327895552/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872998.345095:0:94378:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5ad180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94378:1875765327895552:0@lo:104: 00000100:00000040:0.0:1788872998.345108:0:94378:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff98a9df5ad180 x1875765327895552/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788872998.345125:0:94378:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.345154:0:94378:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5ace00 x1875765327895552 msgsize 328 00000100:00100000:0.0:1788872998.345158:0:94378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872998.345194:0:94378:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df5ad180 x1875765327895552/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1788872998.345217:0:94378:0:(genops.c:1231:class_import_get()) import ffff98a8c2644000 refcount=3 obd=MGS 00010000:00010000:0.0:1788872998.345225:0:94378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db73b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe4e6e89fb01db734 expref: 23 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.345233:0:94378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db73b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe4e6e89fb01db734 expref: 23 pid: 94382 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788872998.345242:0:94378:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df5aea00 x1875765327895680/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872998.345248:0:94378:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94378:1875765327895680:0@lo:104: 00000100:00000040:0.0:1788872998.345258:0:94378:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff98a9df5aea00 x1875765327895680/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788872998.345264:0:94378:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872998.345291:0:94378:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f558b450 x1875765327895680 msgsize 328 00000100:00100000:0.0:1788872998.345295:0:94378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872998.345297:0:94378:0:(events.c:349:request_in_callback()) Buffer complete: 0 buffers still posted 00000100:00000040:0.0:1788872998.345309:0:94378:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df5aea00 x1875765327895680/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872998.345356:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788872998.345370:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327895552 00000100:00100000:3.0:1788872998.345377:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327895552 00000020:00000040:3.0:1788872998.345380:0:6503:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb018e638 00000020:00000040:3.0:1788872998.345385:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9f9db9800 refcount=3 00000100:00000040:3.0:1788872998.345402:0:6503:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:3.0:1788872998.345424:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327895680 00000100:00100000:3.0:1788872998.345428:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327895680 00000020:00000040:3.0:1788872998.345435:0:6503:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb018e638 00000020:00000040:3.0:1788872998.345438:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9f9db9800 refcount=4 00000100:00100000:3.0:1788872998.345457:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00000040:3.0:1788872998.345461:0:6503:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9f9db9800 : new rpc_count 1 00000100:00000040:3.0:1788872998.345466:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5ace00 x1875765327895552/t0(0) o104->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/0 e 0 to 0 dl 1788873009 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872998.345479:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:94378:x1875765327895552:12345-0@lo:104: 00000020:00000040:3.0:1788872998.345487:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8c4f9c000 refcount=2 00010000:00010000:3.0:1788872998.345496:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db757 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788872998.345514:0:6503:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:3.0:1788872998.345518:0:6503:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.345539:0:6503:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff98a9df5ad180 x1875765327895552/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.345588:0:6503:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 61 to 0@lo 00010000:00010000:3.0:1788872998.345600:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:3.0:1788872998.345605:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ace00 x1875765327895552/t0(0) o104->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872998.345614:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+4:94378:x1875765327895552:12345-0@lo:104: Request processed in 138us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872998.345621:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00000040:3.0:1788872998.345624:0:6503:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9f9db9800 : new rpc_count 0 00000020:00000040:3.0:1788872998.345632:0:6503:0:(genops.c:900:class_export_put()) PUTting export ffff98a9f9db9800 : new refcount 3 00000100:00100000:3.0:1788872998.345641:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00000040:3.0:1788872998.345644:0:6503:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9f9db9800 : new rpc_count 1 00000100:00000040:3.0:1788872998.345647:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f558b450 x1875765327895680/t0(0) o104->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/0 e 0 to 0 dl 1788873009 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872998.345670:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f558b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:94378:x1875765327895680:12345-0@lo:104: 00000020:00000040:3.0:1788872998.345675:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8c4f9c600 refcount=2 00010000:00010000:3.0:1788872998.345680:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db73b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788872998.345692:0:6503:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:3.0:1788872998.345695:0:6503:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.345712:0:6503:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff98a9df5aea00 x1875765327895680/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.345724:0:6503:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 61 to 0@lo 00010000:00010000:3.0:1788872998.345733:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00000040:3.0:1788872998.345737:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f558b450 x1875765327895680/t0(0) o104->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788872998.345744:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f558b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+3:94378:x1875765327895680:12345-0@lo:104: Request processed in 77us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872998.345749:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00000040:3.0:1788872998.345751:0:6503:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9f9db9800 : new rpc_count 0 00000020:00000040:3.0:1788872998.345757:0:6503:0:(genops.c:900:class_export_put()) PUTting export ffff98a9f9db9800 : new refcount 2 00010000:00010000:3.0:1788872998.345790:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788872998.345796:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db757 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.345803:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872998.345807:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db757 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1788872998.345813:0:6509:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8c4f9c000 refcount=3 00010000:00010000:3.0:1788872998.345822:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db757 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872998.345831:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db757 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872998.345837:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:3.0:1788872998.345840:0:6509:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:3.0:1788872998.345842:0:6509:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:3.0:1788872998.345848:0:6509:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff98a9f1175400) refs 2 00000020:00000040:3.0:1788872998.345854:0:6509:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff98a8c4f9c000 with handle 0xe4e6e89fb01db750 from hash 00000020:00000040:3.0:1788872998.345863:0:6509:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00010000:00010000:3.0:1788872998.345894:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db757 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.345900:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:3.0:1788872998.345910:0:6509:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a199b9eb] to pc [ptlrpcd_00_01+1] req@ffff98a9f4936a00 x1875765327895808/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788872998.345929:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db757 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.345937:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c000/0xe4e6e89fb01db750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db757 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.345947:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788872998.345951:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe4e6e89fb01db73b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.345966:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8c4f9c600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1788872998.345969:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe4e6e89fb01db73b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1788872998.345985:0:6509:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8c4f9c600 refcount=3 00010000:00010000:3.0:1788872998.345988:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe4e6e89fb01db73b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788872998.346003:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe4e6e89fb01db73b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788872998.346009:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:3.0:1788872998.346012:0:6509:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=3) 10000000:00000040:3.0:1788872998.346014:0:6509:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:3.0:1788872998.346016:0:6509:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff98a8c75cee00) refs 2 00000020:00000040:3.0:1788872998.346019:0:6509:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff98a8c4f9c600 with handle 0xe4e6e89fb01db734 from hash 00000020:00000040:3.0:1788872998.346025:0:6509:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00010000:00010000:3.0:1788872998.346032:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db73b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.346038:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:3.0:1788872998.346043:0:6509:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e3ce665e] to pc [ptlrpcd_00_02+2] req@ffff98a9f4937480 x1875765327895936/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788872998.346061:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db73b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.346068:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.139@tcp lock: ffff98a8c4f9c600/0xe4e6e89fb01db734 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe4e6e89fb01db73b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.346074:0:6509:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff98a9f1424400 count: 0 00010000:00010000:3.0:1788872998.346082:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872998.346084:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788872998.346085:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788872998.346097:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:3.0:1788872998.346107:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4937480 x1875765327895936/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.346117:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327895936:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1788872998.346131:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4937480 x1875765327895936/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.346138:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872998.346154:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4934700 x1875765327895936 msgsize 328 00000100:00100000:3.0:1788872998.346158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872998.346171:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4937480 x1875765327895936/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.346239:0:94378:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9d0d950c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788872998.346249:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1788872998.346262:0:94378:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df5ad180 x1875765327895552/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872998.346435:0:3638:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df5ae680 x1875765327895424/t0(0) o104->MGS@192.168.204.39@tcp:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872998.346464:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:1.0:1788872998.346474:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4936a00 x1875765327895808/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.346482:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327895808:0@lo:103:ldlm_bl.0 00000100:00000040:1.0:1788872998.346496:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4936a00 x1875765327895808/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.346502:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.346520:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f820bc50 x1875765327895808 msgsize 328 00000100:00100000:1.0:1788872998.346536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872998.346538:0:3644:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788872998.346582:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4936a00 x1875765327895808/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873014 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.346604:0:94378:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ad180 x1875765327895552/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872998.346612:0:94378:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ad180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94378:1875765327895552:0@lo:104: 00000100:00100000:1.0:1788872998.346616:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327895936 00000100:00100000:1.0:1788872998.346621:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327895936 00000020:00000040:1.0:1788872998.346623:0:6506:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:1.0:1788872998.346625:0:6506:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=24 00000100:00000040:0.0:1788872998.346632:0:94378:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df5aea00 x1875765327895680/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872998.346640:0:6506:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000100:00000040:0.0:1788872998.346640:0:94378:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5aea00 x1875765327895680/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788872998.346646:0:94378:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5aea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94378:1875765327895680:0@lo:104: 00000020:00000040:1.0:1788872998.346651:0:6506:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a9fa899a00 refcount=4 00010000:00010000:1.0:1788872998.346655:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db73b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db734 expref: 24 pid: 94382 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788872998.346684:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327895808 00000100:00100000:1.0:1788872998.346688:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327895808 00000020:00000040:1.0:1788872998.346689:0:6506:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:1.0:1788872998.346692:0:6506:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=25 00000020:00000040:1.0:1788872998.346704:0:6506:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a9fa898200 refcount=4 00000100:00100000:3.0:1788872998.346710:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00010000:00010000:1.0:1788872998.346712:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db757 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db750 expref: 25 pid: 94375 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788872998.346717:0:26198:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:3.0:1788872998.346726:0:26198:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4934700 x1875765327895936/t0(0) o103->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/0 e 0 to 0 dl 1788873009 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.346741:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:3.0:1788872998.346743:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4934700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3647:x1875765327895936:12345-0@lo:103:ldlm_bl.0 00000100:00000040:1.0:1788872998.346745:0:6506:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 2 00000100:00000040:1.0:1788872998.346753:0:6506:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f820bc50 x1875765327895808/t0(0) o103->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/0 e 0 to 0 dl 1788873009 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788872998.346759:0:26198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:3.0:1788872998.346764:0:26198:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a9fa899a00 refcount=4 00000100:00100000:1.0:1788872998.346767:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f820bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+25:3644:x1875765327895808:12345-0@lo:103:ldlm_bl.0 00010000:00000040:3.0:1788872998.346769:0:26198:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a9faf66300 count: 5 00010000:00010000:3.0:1788872998.346778:0:26198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db73b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db734 expref: 25 pid: 94382 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.346789:0:26198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db73b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db734 expref: 25 pid: 94382 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872998.346790:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:1.0:1788872998.346796:0:6506:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a9fa898200 refcount=4 00010000:00000040:1.0:1788872998.346800:0:6506:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a9faf66300 count: 6 00010000:00010000:1.0:1788872998.346805:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db757 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe4e6e89fb01db750 expref: 25 pid: 94375 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1788872998.346806:0:26198:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff98a9fa899a00 with handle 0xe4e6e89fb01db73b from hash 00010000:00010000:3.0:1788872998.346816:0:26198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa899a00/0xe4e6e89fb01db73b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db734 expref: 25 pid: 94382 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872998.346820:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe4e6e89fb01db750 expref: 25 pid: 94375 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1788872998.346833:0:6506:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff98a9fa898200 with handle 0xe4e6e89fb01db757 from hash 00010000:00010000:1.0:1788872998.346841:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9fa898200/0xe4e6e89fb01db757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe4e6e89fb01db750 expref: 25 pid: 94375 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.346842:0:26198:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff98a8c2645800 : new locks_count 17 00000020:00000040:3.0:1788872998.346847:0:26198:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 24 00002000:00000040:2.0:1788872998.346969:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:2.0:1788872998.347112:0:96948:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294969477 00010000:00000040:1.0:1788872998.347442:0:6506:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff98a8c2645800 : new locks_count 16 00000020:00000040:1.0:1788872998.347444:0:6506:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 23 00010000:00000040:3.0:1788872998.348172:0:26198:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff98a8cc3e6800 00010000:00010000:3.0:1788872998.348181:0:26198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00000040:1.0:1788872998.348182:0:6506:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff98a8cc3e6800 00010000:00010000:1.0:1788872998.348188:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:3.0:1788872998.348193:0:26198:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:1.0:1788872998.348195:0:6506:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 63 to 0@lo 00000100:00000040:3.0:1788872998.348206:0:26198:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.348206:0:6506:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872998.348245:0:6506:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4936a00 x1875765327895808/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872998.348271:0:6506:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:1.0:1788872998.348280:0:6506:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f820bc50 x1875765327895808/t0(0) o103->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872998.348288:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f820bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:3644:x1875765327895808:12345-0@lo:103:ldlm_bl.0 Request processed in 1526us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872998.348296:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00000040:1.0:1788872998.348299:0:6506:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 1 00000020:00000040:1.0:1788872998.348308:0:6506:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 22 00000100:00000040:3.0:1788872998.348417:0:26198:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9f4937480 x1875765327895936/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.348439:0:26198:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000100:00000040:3.0:1788872998.348443:0:26198:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934700 x1875765327895936/t0(0) o103->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:169/0 lens 328/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.348451:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4934700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:3647:x1875765327895936:12345-0@lo:103:ldlm_bl.0 Request processed in 1715us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872998.348458:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00000040:3.0:1788872998.348461:0:26198:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:3.0:1788872998.348468:0:26198:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 21 00000100:00000040:0.0:1788872998.348522:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4936a00 x1875765327895808/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872998.348534:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4936a00 x1875765327895808/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.348541:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327895808:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1788872998.348578:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4936a00 x1875765327895808/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872998.348581:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4937480 x1875765327895936/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872998.348597:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000100:00000040:3.0:1788872998.348600:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4937480 x1875765327895936/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872998.348609:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327895936:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1788872998.348614:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4937480 x1875765327895936/t0(0) o103->MGC192.168.204.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872998.348624:0:3647:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000100:00000040:3.0:1788872998.351017:0:3639:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff98a9df5ae680 x1875765327895424/t0(0) o104->MGS@192.168.204.39@tcp:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872998.351082:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4937480 x1875765311295872 msgsize 328 00000100:00100000:3.0:1788872998.351088:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:1.0:1788872998.351320:0:94378:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df5ae680 x1875765327895424/t0(0) o104->MGS@192.168.204.39@tcp:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788872998.351334:0:94378:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ae680 x1875765327895424/t0(0) o104->MGS@192.168.204.39@tcp:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788872998.351342:0:94378:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5ae680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94378:1875765327895424:192.168.204.39@tcp:104: 00000100:00000040:1.0:1788872998.351353:0:94378:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df5ad180 x1875765327895552/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:1.0:1788872998.351364:0:94378:0:(genops.c:1244:class_import_put()) import ffff98a8c2644000 refcount=2 obd=MGS 00000100:00000040:1.0:1788872998.351372:0:94378:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df5aea00 x1875765327895680/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:1.0:1788872998.351390:0:94378:0:(genops.c:1244:class_import_put()) import ffff98a8c2644000 refcount=1 obd=MGS 00000100:00000040:1.0:1788872998.351396:0:94378:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df5ae680 x1875765327895424/t0(0) o104->MGS@192.168.204.39@tcp:15/16 lens 328/224 e 0 to 0 dl 1788873014 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:1.0:1788872998.351402:0:94378:0:(genops.c:1244:class_import_put()) import ffff98a8ca9b9000 refcount=1 obd=MGS 00010000:00010000:1.0:1788872998.351417:0:94378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788872998.352213:0:96965:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-OST0000: started recovery thread pid 96965 00010000:02000000:2.0:1788872998.352290:0:96965:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788872998.352395:0:96965:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1788872998.352399:0:96965:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:0.0:1788872998.352399:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311295872 00000100:00100000:0.0:1788872998.352406:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311295872 00000020:00000040:0.0:1788872998.352410:0:26197:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db5f9 00000020:00000040:0.0:1788872998.352414:0:26197:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8ca9be000 refcount=10 00000100:00000040:0.0:1788872998.352441:0:26197:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:0.0:1788872998.352453:0:26197:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a9efac4200 refcount=4 00010000:00010000:0.0:1788872998.352460:0:26197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98a9efac4200/0xe4e6e89fb01db7f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1eb expref: 10 pid: 94376 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788872998.352506:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2617 00000100:00000040:0.0:1788872998.352511:0:26197:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8ca9be000 : new rpc_count 1 00000100:00000040:0.0:1788872998.352518:0:26197:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4937480 x1875765311295872/t0(0) o103->c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp:169/0 lens 328/0 e 0 to 0 dl 1788873009 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.352530:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311295872:12345-192.168.204.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788872998.352582:0:26197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1788872998.352586:0:26197:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a9efac4200 refcount=4 00010000:00000040:0.0:1788872998.352589:0:26197:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a9faf66300 count: 3 00010000:00010000:0.0:1788872998.352594:0:26197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98a9efac4200/0xe4e6e89fb01db7f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1eb expref: 10 pid: 94376 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.352607:0:26197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98a9efac4200/0xe4e6e89fb01db7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1eb expref: 10 pid: 94376 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788872998.352623:0:26197:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff98a9efac4200 with handle 0xe4e6e89fb01db7f8 from hash 00010000:00010000:0.0:1788872998.352629:0:26197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a9efac4200/0xe4e6e89fb01db7f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb1eb expref: 10 pid: 94376 timeout: 4035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.352636:0:26197:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff98a8ca9be000 : new locks_count 3 00000020:00000040:0.0:1788872998.352638:0:26197:0:(genops.c:900:class_export_put()) PUTting export ffff98a8ca9be000 : new refcount 9 00010000:00000040:0.0:1788872998.352646:0:26197:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff98a8cc3e6800 00010000:00010000:0.0:1788872998.352652:0:26197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788872998.352661:0:26197:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff98a9faf66300) refcount = 2 00010000:00010000:0.0:1788872998.352665:0:26197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788872998.352681:0:26197:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011559702s 00000020:00000040:0.0:1788872998.352685:0:26197:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8cc3e6800 refcount=5 00010000:00010000:0.0:1788872998.352688:0:26197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.352695:0:26197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.352726:0:26197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.352733:0:26197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.352740:0:26197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98a8cc3e6800 already unused, calling callback (ffffffffc0dc5220) 00010000:00010000:0.0:1788872998.352745:0:26197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788872998.352752:0:26197:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8cc3e6800 refcount=6 00010000:00010000:0.0:1788872998.352757:0:26197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788872998.352783:0:26197:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff98a8cc3e6800 with handle 0xe4e6e89fb01dc653 from hash 00010000:00010000:0.0:1788872998.352789:0:26197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788872998.352799:0:26197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788872998.352874:0:94378:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788872998.352881:0:26197:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00010000:00010000:3.0:1788872998.352883:0:94378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872998.352890:0:94378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98a8cc3e6800/0xe4e6e89fb01dc653 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788872998.352895:0:94378:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff98a9faf66300 count: 0 00000100:00000040:0.0:1788872998.352897:0:26197:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788872998.352962:0:26197:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872998.352969:0:26197:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4937480 x1875765311295872/t0(0) o103->c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp:169/0 lens 328/224 e 0 to 0 dl 1788873009 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872998.352978:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c67645b7-2296-4087-92b1-886500c47477+9:2404:x1875765311295872:12345-192.168.204.39@tcp:103:ldlm_bl.0 Request processed in 450us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872998.352985:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2617 00000100:00000040:0.0:1788872998.352989:0:26197:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8ca9be000 : new rpc_count 0 00000020:00000040:0.0:1788872998.353003:0:26197:0:(genops.c:900:class_export_put()) PUTting export ffff98a8ca9be000 : new refcount 8 00000020:01000004:1.0:1788872998.353672:0:96948:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:1.0:1788872998.353680:0:96948:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff98a9ef3e2180 : new refcount 2 00000040:00000040:1.0:1788872998.353685:0:96948:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff98a9ef3e2180 : new refcount 1 00000020:00000040:1.0:1788872998.353727:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff98a9e7bfb000 : new refcount 1 00000020:00000040:1.0:1788872998.353740:0:96948:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.204.139@tcp (ffff98a9e9b999c0) now 6 - mgc_fs 10000000:01000000:1.0:1788872998.353743:0:96948:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.139@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788872998.353764:0:96948:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788872998.353804:0:96948:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788872998.355166:0:96948:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788872998.355615:0:96948:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000040:1.0:1788872999.096846:0:94388:0:(genops.c:1231:class_import_get()) import ffff98a8c9e82800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1788872999.096891:0:94388:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bcd8a1ec] to pc [ptlrpcd_00_03+3] req@ffff98a9ee81c380 x1875765327896064/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.096935:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:1.0:1788872999.096961:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ee81c380 x1875765327896064/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.096974:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327896064:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788872999.097005:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ee81c380 x1875765327896064/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873015 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872999.097013:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872999.097056:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81f480 x1875765327896064 msgsize 224 00000100:00100000:1.0:1788872999.097061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788872999.097102:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ee81c380 x1875765327896064/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873015 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872999.097118:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5296 usecs (6 jiffies) 00000100:00100000:1.0:1788872999.097144:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327896064 00000100:00100000:1.0:1788872999.097152:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327896064 00000020:00000040:1.0:1788872999.097155:0:30614:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6b6 00000020:00000040:1.0:1788872999.097160:0:30614:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ff63e800 refcount=5 00000100:00000040:1.0:1788872999.097183:0:30614:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1788872999.097209:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4088 00000100:00000040:1.0:1788872999.097214:0:30614:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9ff63e800 : new rpc_count 1 00000100:00000040:1.0:1788872999.097219:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81f480 x1875765327896064/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.097230:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327896064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788872999.097263:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00010000:00000040:1.0:1788872999.097274:0:30614:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327896064 00000100:00000040:1.0:1788872999.097284:0:30614:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:1.0:1788872999.097289:0:30614:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872999.097307:0:30614:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9ee81c380 x1875765327896064/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872999.097326:0:30614:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000100:00000040:1.0:1788872999.097331:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81f480 x1875765327896064/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:170/0 lens 224/368 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.097339:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327896064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872999.097345:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4088 00000100:00000040:1.0:1788872999.097348:0:30614:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9ff63e800 : new rpc_count 0 00000020:00000040:1.0:1788872999.097357:0:30614:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ff63e800 : new refcount 4 00000100:00000040:1.0:1788872999.097391:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788872999.097403:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ee81c380 x1875765327896064/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788872999.097413:0:3646:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352901 avail=317198 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023685 state=0: rc = 0 00000100:00000040:1.0:1788872999.097419:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81c380 x1875765327896064/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.097425:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ee81c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327896064:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788872999.097431:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ee81c380 x1875765327896064/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788872999.097439:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a8c9e82800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00010000:00010000:2.0:1788872999.234582:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788872999.331914:0:97014:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788872999.334462:0:97014:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00000040:1.0:1788872999.439332:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c454e450 x1875765311296000 msgsize 328 00000100:00100000:1.0:1788872999.439346:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:1.0:1788872999.439349:0:3638:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:2.0:1788872999.439594:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311296000 00000100:00100000:2.0:1788872999.439606:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311296000 00000020:00000040:2.0:1788872999.439609:0:94382:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db5f9 00000020:00000040:2.0:1788872999.439614:0:94382:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8ca9be000 refcount=9 00000100:00000040:2.0:1788872999.439641:0:94382:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788872999.439678:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 214 00000100:00000040:2.0:1788872999.439682:0:94382:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8ca9be000 : new rpc_count 1 00000100:00000040:2.0:1788872999.439690:0:94382:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c454e450 x1875765311296000/t0(0) o101->c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp:170/0 lens 328/0 e 0 to 0 dl 1788873010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.439724:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c454e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+9:71021:x1875765311296000:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788872999.439741:0:94382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:2.0:1788872999.439761:0:94382:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a8c4839e00 with handle 0xe4e6e89fb01dc65a to hash 00010000:00010000:2.0:1788872999.439766:0:94382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98a8c4839e00/0xe4e6e89fb01dc65a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1098c8e5828fb556 expref: -99 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788872999.439774:0:94382:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff98a8ca9be000 : new locks_count 4 00000020:00000040:2.0:1788872999.439776:0:94382:0:(genops.c:889:class_export_get()) GET export ffff98a8ca9be000 refcount=10 00010000:00000040:2.0:1788872999.439794:0:94382:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff98a9c2ab1100) refcount = 1 00010000:00010000:2.0:1788872999.439800:0:94382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98a8c4839e00/0xe4e6e89fb01dc65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb556 expref: 10 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872999.439812:0:94382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98a8c4839e00/0xe4e6e89fb01dc65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb556 expref: 10 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872999.439822:0:94382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98a8c4839e00, rc 0) 00010000:00000040:2.0:1788872999.439826:0:94382:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765311296000 00000100:00000040:2.0:1788872999.439838:0:94382:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:2.0:1788872999.439843:0:94382:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:2.0:1788872999.439881:0:94382:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:2.0:1788872999.439886:0:94382:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c454e450 x1875765311296000/t0(0) o101->c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp:170/0 lens 328/344 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.439897:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c454e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311296000:12345-192.168.204.39@tcp:101:ll_cfg_requeue.0 Request processed in 175us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872999.439903:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 214 00000100:00000040:2.0:1788872999.439906:0:94382:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8ca9be000 : new rpc_count 0 00000020:00000040:2.0:1788872999.439921:0:94382:0:(genops.c:900:class_export_put()) PUTting export ffff98a8ca9be000 : new refcount 9 00000100:00000040:0.0:1788872999.453113:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c6c67c50 x1875765311296128 msgsize 304 00000100:00100000:0.0:1788872999.453127:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:0.0:1788872999.453129:0:3637:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1788872999.453411:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311296128 00000100:00100000:1.0:1788872999.453421:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311296128 00000020:00000040:1.0:1788872999.453424:0:94381:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db5f9 00000020:00000040:1.0:1788872999.453429:0:94381:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8ca9be000 refcount=10 00000100:00000040:1.0:1788872999.453448:0:94381:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788872999.453479:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 215 00000100:00000040:1.0:1788872999.453483:0:94381:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8ca9be000 : new rpc_count 1 00000100:00000040:1.0:1788872999.453490:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c6c67c50 x1875765311296128/t0(0) o256->c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp:170/0 lens 304/0 e 0 to 0 dl 1788873010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.453503:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311296128:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788872999.453532:0:94381:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:1.0:1788872999.453641:0:94381:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1788872999.453648:0:94381:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788872999.453655:0:94381:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:1.0:1788872999.453662:0:94381:0:(genops.c:889:class_export_get()) GET export ffff98a8ca9be000 refcount=11 00000020:00000040:1.0:1788872999.467066:0:94381:0:(genops.c:900:class_export_put()) PUTting export ffff98a8ca9be000 : new refcount 10 00010000:00000040:1.0:1788872999.467095:0:94381:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765311296128 00000100:00000040:1.0:1788872999.467122:0:94381:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:1.0:1788872999.467131:0:94381:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788872999.467192:0:94381:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 8 to 192.168.204.39@tcp 00000100:00000040:1.0:1788872999.467204:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c6c67c50 x1875765311296128/t0(0) o256->c67645b7-2296-4087-92b1-886500c47477@192.168.204.39@tcp:170/0 lens 304/240 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.467215:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:71021:x1875765311296128:12345-192.168.204.39@tcp:256:ll_cfg_requeue.0 Request processed in 13713us (14102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872999.467225:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 215 00000100:00000040:1.0:1788872999.467229:0:94381:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8ca9be000 : new rpc_count 0 00000020:00000040:1.0:1788872999.467243:0:94381:0:(genops.c:900:class_export_put()) PUTting export ffff98a8ca9be000 : new refcount 9 00000100:00000040:3.0:1788872999.472626:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4934700 x1875765311296256 msgsize 520 00000100:00100000:3.0:1788872999.472646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872999.473898:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311296256 00000100:00100000:0.0:1788872999.473910:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311296256 00000020:00000040:0.0:1788872999.473913:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dbcba 00000100:00100000:0.0:1788872999.473977:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6091 00000100:00000040:0.0:1788872999.473988:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4934700 x1875765311296256/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788873019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872999.474003:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1875765311296256:12345-192.168.204.39@tcp:8:ll_cfg_requeue.0 00000020:00000040:0.0:1788872999.474023:0:8436:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 7 - find 00010000:00000040:0.0:1788872999.474035:0:8436:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0467af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1788872999.474042:0:8436:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '0804304d-5904-48ad-87f2-bcbc7642a62a' at ffff98a8c394c000, cookie 0xe4e6e89fb01dc606 00010000:00080000:0.0:1788872999.474047:0:8436:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp recovering/t4294969478 exp ffff98a8c394c000 cur 3936 last 1788872998 00010000:02000400:0.0:1788872999.474056:0:8436:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:0.0:1788872999.474062:0:8436:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:0.0:1788872999.474070:0:8436:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff98a8c3866800) : new refcount 19 00000020:00000040:0.0:1788872999.474074:0:8436:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=4 00000001:00000040:0.0:1788872999.474076:0:8436:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff98a8c3866800) : new refcount 20 00000001:00000040:0.0:1788872999.474080:0:8436:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff98a8c3866800) : new refcount 19 00002000:00100000:0.0:1788872999.474083:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0804304d-5904-48ad-87f2-bcbc7642a62a/ffff98a8c394c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788872999.474092:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:0.0:1788872999.474102:0:8436:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff98a9c5d23240 for nid 192.168.204.39@tcp - ref 2 00000020:00000040:0.0:1788872999.474209:0:8436:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 8 - import 00000020:00000040:0.0:1788872999.474216:0:8436:0:(genops.c:1244:class_import_put()) import ffff98a9e99a4800 refcount=1 obd=lustre-OST0000 00000020:00000040:0.0:1788872999.474232:0:8436:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=5 00000100:00000040:0.0:1788872999.474235:0:8436:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788872999.474246:0:8436:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872999.474249:0:8436:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9f6986700 refcount 9 to 192.168.204.39@tcp 00000020:00000040:0.0:1788872999.474252:0:8436:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=6 00000100:00000040:0.0:1788872999.474257:0:8436:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00000100:00080000:0.0:1788872999.474266:0:8436:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a4800 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1788872999.474273:0:8436:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 5 00000020:00000040:0.0:1788872999.474276:0:8436:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff98a8c1cfcd40) now 8 - find 00010000:00000040:0.0:1788872999.474293:0:8436:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 0, xid 1875765311296256 00000100:00000040:0.0:1788872999.474302:0:8436:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872999.474309:0:8436:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788872999.474357:0:8436:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00000100:00000040:0.0:1788872999.474363:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934700 x1875765311296256/t0(0) o8->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:0/0 lens 520/416 e 0 to 0 dl 1788873019 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872999.474373:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2403:x1875765311296256:12345-192.168.204.39@tcp:8:ll_cfg_requeue.0 Request processed in 371us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872999.474381:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6091 00000100:00000040:0.0:1788872999.474384:0:8436:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:0.0:1788872999.474396:0:8436:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 4 00000100:00000040:0.0:1788872999.488816:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5ad880 x1875765311267456 msgsize 440 00000100:00100000:0.0:1788872999.488830:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872999.488920:0:25436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311267456 00000100:00100000:3.0:1788872999.488940:0:25436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311267456 00000020:00000040:3.0:1788872999.488944:0:25436:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788872999.488949:0:25436:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=5 00000100:00000040:3.0:1788872999.488976:0:25436:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788872999.489028:0:25436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1048 00000100:00000040:3.0:1788872999.489033:0:25436:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:3.0:1788872999.489039:0:25436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5ad880 x1875765311267456/t0(4294969478) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872999.489054:0:25436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2403:x1875765311267456:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:3.0:1788872999.489066:0:25436:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9df5ad880 x1875765311267456/t0(4294969478) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788872999.489093:0:25436:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969478, current: 4294969478, replaying 00010000:00000040:3.0:1788872999.489102:0:25436:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:3.0:1788872999.489124:0:25436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ad880 x1875765311267456/t0(4294969478) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872999.489133:0:25436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2403:x1875765311267456:12345-192.168.204.39@tcp:10:dd.0 Request processed in 82us (318us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872999.489140:0:25436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1048 00000100:00000040:3.0:1788872999.489143:0:25436:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:2.0:1788872999.489249:0:96965:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:00000040:0.0:1788872999.608696:0:75626:0:(genops.c:1231:class_import_get()) import ffff98a9df8c9800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1788872999.608739:0:75626:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009d8d30b3] to pc [ptlrpcd_00_00+0] req@ffff98a9df5adf80 x1875765327896192/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872999.608774:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df5adf80 x1875765327896192/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872999.608786:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327896192:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788872999.608826:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df5adf80 x1875765327896192/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873015 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872999.608834:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872999.608871:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5aed80 x1875765327896192 msgsize 224 00000100:00100000:0.0:1788872999.608875:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872999.608899:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df5adf80 x1875765327896192/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873015 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872999.608919:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1533165 usecs (1534 jiffies) 00000100:00100000:0.0:1788872999.608967:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327896192 00000100:00100000:0.0:1788872999.608975:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327896192 00000020:00000040:0.0:1788872999.608978:0:8446:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db67e 00000020:00000040:0.0:1788872999.608982:0:8446:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9cb5ec800 refcount=7 00000100:00000040:0.0:1788872999.609003:0:8446:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1788872999.609025:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4089 00000100:00000040:0.0:1788872999.609029:0:8446:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9cb5ec800 : new rpc_count 1 00000100:00000040:0.0:1788872999.609034:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5aed80 x1875765327896192/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872999.609045:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327896192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788872999.609085:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00010000:00000040:0.0:1788872999.609097:0:8446:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1875765327896192 00000100:00000040:0.0:1788872999.609107:0:8446:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:0.0:1788872999.609111:0:8446:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872999.609128:0:8446:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9df5adf80 x1875765327896192/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872999.609148:0:8446:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000100:00000040:0.0:1788872999.609152:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5aed80 x1875765327896192/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:170/0 lens 224/368 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872999.609161:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875765327896192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872999.609175:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4089 00000100:00000040:0.0:1788872999.609178:0:8446:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9cb5ec800 : new rpc_count 0 00000020:00000040:0.0:1788872999.609187:0:8446:0:(genops.c:900:class_export_put()) PUTting export ffff98a9cb5ec800 : new refcount 6 00000100:00000040:0.0:1788872999.609222:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00000040:0.0:1788872999.609231:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df5adf80 x1875765327896192/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788872999.609241:0:3644:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352801 avail=317098 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023574 state=0: rc = 0 00000100:00000040:0.0:1788872999.609251:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5adf80 x1875765327896192/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872999.609257:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327896192:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788872999.609263:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df5adf80 x1875765327896192/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872999.609271:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9df8c9800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:00000040:3.0:1788872999.612076:0:94392:0:(genops.c:1231:class_import_get()) import ffff98a9e021b000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1788872999.612119:0:94392:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b833aeb6] to pc [ptlrpcd_00_01+1] req@ffff98a9f4934380 x1875765327896320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872999.612175:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:0.0:1788872999.614900:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4934380 x1875765327896320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872999.614920:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327896320:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1788872999.614965:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4934380 x1875765327896320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873015 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872999.614974:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872999.615019:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5adf80 x1875765327896320 msgsize 224 00000100:00100000:0.0:1788872999.615024:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788872999.615088:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4934380 x1875765327896320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873015 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872999.615111:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6235 usecs (7 jiffies) 00000100:00100000:1.0:1788872999.618527:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327896320 00000100:00100000:1.0:1788872999.618605:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327896320 00000020:00000040:1.0:1788872999.618609:0:8440:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6ee 00000020:00000040:1.0:1788872999.618614:0:8440:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9dfe94000 refcount=5 00000100:00000040:1.0:1788872999.618642:0:8440:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1788872999.618723:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257 00000100:00000040:1.0:1788872999.618728:0:8440:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9dfe94000 : new rpc_count 1 00000100:00000040:1.0:1788872999.618736:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5adf80 x1875765327896320/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.618751:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327896320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788872999.618784:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00010000:00000040:1.0:1788872999.618795:0:8440:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875765327896320 00000100:00000040:1.0:1788872999.618808:0:8440:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:1.0:1788872999.618814:0:8440:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872999.618870:0:8440:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9f4934380 x1875765327896320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872999.618905:0:8440:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000100:00000040:1.0:1788872999.618911:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5adf80 x1875765327896320/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:170/0 lens 224/368 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.618920:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327896320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (3899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872999.618937:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257 00000100:00000040:1.0:1788872999.618940:0:8440:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9dfe94000 : new rpc_count 0 00000020:00000040:1.0:1788872999.618950:0:8440:0:(genops.c:900:class_export_put()) PUTting export ffff98a9dfe94000 : new refcount 4 00000100:00000040:0.0:1788872999.620156:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:0.0:1788872999.620170:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4934380 x1875765327896320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788872999.620186:0:3644:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1788872999.620189:0:3644:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1788872999.620201:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934380 x1875765327896320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872999.620208:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327896320:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1788872999.620217:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4934380 x1875765327896320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788872999.620232:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9e021b000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788872999.690890:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81c380 x1875765311296512 msgsize 224 00000100:00100000:1.0:1788872999.690905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:1.0:1788872999.690952:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81ce00 x1875765311296384 msgsize 224 00000100:00100000:1.0:1788872999.690958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:1.0:1788872999.691058:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81c700 x1875765311296640 msgsize 224 00000100:00100000:1.0:1788872999.691064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872999.691147:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311296640 00000100:00100000:3.0:1788872999.691158:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311296640 00000020:00000040:3.0:1788872999.691161:0:26184:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dba1a 00000020:00000040:3.0:1788872999.691167:0:26184:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c2a7b000 refcount=7 00000020:00000040:3.0:1788872999.691184:0:26184:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:3.0:1788872999.691216:0:26184:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1788872999.691247:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2796 00000100:00000040:3.0:1788872999.691251:0:26184:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9c2a7b000 : new rpc_count 1 00000100:00000040:3.0:1788872999.691258:0:26184:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81c700 x1875765311296640/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872999.691271:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311296640:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000040:3.0:1788872999.691305:0:26184:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765311296640 00000100:00000040:3.0:1788872999.691317:0:26184:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.691323:0:26184:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872999.691377:0:26184:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.691383:0:26184:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81c700 x1875765311296640/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 224/224 e 0 to 0 dl 1788873010 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872999.691405:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311296640:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 124us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788872999.691419:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2796 00000100:00000040:3.0:1788872999.691422:0:26184:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9c2a7b000 : new rpc_count 0 00000020:00000040:3.0:1788872999.691433:0:26184:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c2a7b000 : new refcount 6 00000100:00080000:1.0:1788872999.691706:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1788872999.691720:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00100000:2.0:1788872999.696207:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311296512 00000100:00100000:2.0:1788872999.696225:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311296512 00000020:00000040:2.0:1788872999.696228:0:83669:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dac7c 00000020:00000040:2.0:1788872999.696234:0:83669:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c6799800 refcount=11 00000020:00000040:3.0:1788872999.699249:0:83669:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff98a9f9df99c0) now 12 - evictor 00000100:00000040:3.0:1788872999.699313:0:83669:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1788872999.699365:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311296384 00000100:00100000:3.0:1788872999.699373:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311296384 00000020:00000040:3.0:1788872999.699376:0:83669:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db685 00000020:00000040:3.0:1788872999.699381:0:83669:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9cb5ef800 refcount=51 00000020:00000040:3.0:1788872999.699402:0:83669:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff98a9e99999c0) now 16 - evictor 00000100:00080000:1.0:1788872999.699764:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1788872999.699770:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff98a9e99999c0) now 16 - evictor 00000100:00080000:1.0:1788872999.699773:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1788872999.699775:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff98a9f9df99c0) now 12 - evictor 00000100:00100000:2.0:1788872999.705902:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1546 00000100:00000040:2.0:1788872999.705910:0:66190:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c6799800 : new rpc_count 1 00000100:00000040:2.0:1788872999.705920:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81c380 x1875765311296512/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.705959:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2404:x1875765311296512:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000040:2.0:1788872999.705987:0:66190:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 77309411472, transno 0, xid 1875765311296512 00000100:00000040:2.0:1788872999.705999:0:66190:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:2.0:1788872999.706004:0:66190:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:2.0:1788872999.706073:0:66190:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00000100:00000040:2.0:1788872999.706079:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81c380 x1875765311296512/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 224/224 e 0 to 0 dl 1788873010 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.706088:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2404:x1875765311296512:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 144us (15199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872999.706097:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1546 00000100:00000040:2.0:1788872999.706100:0:66190:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c6799800 : new rpc_count 0 00000020:00000040:2.0:1788872999.706115:0:66190:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c6799800 : new refcount 10 00000100:00100000:2.0:1788872999.706140:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1547 00000100:00000040:2.0:1788872999.706143:0:66190:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9cb5ef800 : new rpc_count 1 00000100:00000040:2.0:1788872999.706147:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81ce00 x1875765311296384/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.706160:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2404:x1875765311296384:12345-192.168.204.39@tcp:400:kworker.0 00010000:00000040:2.0:1788872999.706187:0:66190:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1875765311296384 00000100:00000040:2.0:1788872999.706192:0:66190:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:2.0:1788872999.706196:0:66190:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:2.0:1788872999.706212:0:66190:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00000100:00000040:2.0:1788872999.706217:0:66190:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81ce00 x1875765311296384/t0(0) o400->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 224/224 e 0 to 0 dl 1788873010 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.706225:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2404:x1875765311296384:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 68us (15272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872999.706232:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1547 00000100:00000040:2.0:1788872999.706234:0:66190:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9cb5ef800 : new rpc_count 0 00000020:00000040:2.0:1788872999.706240:0:66190:0:(genops.c:900:class_export_put()) PUTting export ffff98a9cb5ef800 : new refcount 50 10000000:00000040:2.0:1788872999.800675:0:6517:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff98a8c75cee00) refs 2 10000000:01000000:2.0:1788872999.800688:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788872999.800691:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9fa734000 from 128 10000000:01000000:2.0:1788872999.800696:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:2.0:1788872999.800780:0:6517:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:2.0:1788872999.800819:0:6517:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a8c4838c00 with handle 0xe4e6e89fb01dc661 to hash 00010000:00010000:2.0:1788872999.800829:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4838c00/0xe4e6e89fb01dc661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872999.800839:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a8c4838c00/0xe4e6e89fb01dc661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872999.800850:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a8c4838c00/0xe4e6e89fb01dc661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788872999.800875:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a8c9fe6a00 x1875765327896448/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.800910:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327896448:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1788872999.800948:0:6517:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a8c9fe6a00 x1875765327896448/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.800955:0:6517:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872999.801000:0:6517:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c6c65450 x1875765327896448 msgsize 328 00000100:00100000:2.0:1788872999.801004:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872999.801006:0:6517:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788872999.801028:0:6517:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a8c9fe6a00 x1875765327896448/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.801055:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a8c3be7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788872999.801135:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327896448 00000100:00100000:1.0:1788872999.801142:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327896448 00000020:00000040:1.0:1788872999.801145:0:94376:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:1.0:1788872999.801148:0:94376:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=22 00000100:00000040:1.0:1788872999.801172:0:94376:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788872999.801203:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00000040:1.0:1788872999.801207:0:94376:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:1.0:1788872999.801213:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c6c65450 x1875765327896448/t0(0) o101->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:170/0 lens 328/0 e 0 to 0 dl 1788873010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.801232:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+22:6517:x1875765327896448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872999.801247:0:94376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1788872999.801256:0:94376:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a9c2ab1100 count: 2 00000020:00000040:1.0:1788872999.801264:0:94376:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98aa002a4000 with handle 0xe4e6e89fb01dc668 to hash 00010000:00010000:1.0:1788872999.801268:0:94376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa002a4000/0xe4e6e89fb01dc668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dc661 expref: -99 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788872999.801277:0:94376:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff98a8c2645800 : new locks_count 17 00000020:00000040:1.0:1788872999.801280:0:94376:0:(genops.c:889:class_export_get()) GET export ffff98a8c2645800 refcount=23 00010000:00000040:1.0:1788872999.801417:0:94376:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff98a9c2ab1100) refcount = 2 00010000:00000040:1.0:1788872999.801422:0:94376:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1788872999.801427:0:94376:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c4839e00/0xe4e6e89fb01dc65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb556 expref: 9 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872999.801434:0:94376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa002a4000/0xe4e6e89fb01dc668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dc661 expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872999.801445:0:94376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa002a4000/0xe4e6e89fb01dc668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dc661 expref: 23 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872999.801454:0:94376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa002a4000, rc 0) 00010000:00000040:1.0:1788872999.801458:0:94376:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327896448 00000100:00000040:1.0:1788872999.801467:0:94376:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:1.0:1788872999.801472:0:94376:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872999.801494:0:94376:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff98a8c9fe6a00 x1875765327896448/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872999.802437:0:94376:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000100:00000040:1.0:1788872999.802448:0:94376:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c6c65450 x1875765327896448/t0(0) o101->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:170/0 lens 328/344 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.802468:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327896448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1238us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872999.802476:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00000040:1.0:1788872999.802480:0:94376:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:1.0:1788872999.802492:0:94376:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 22 00000100:00000040:2.0:1788872999.811847:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a8c9fe6a00 x1875765327896448/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.811862:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe6a00 x1875765327896448/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.811869:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9fe6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327896448:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1788872999.811879:0:6517:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a8c9fe6a00 x1875765327896448/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872999.811893:0:6517:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8c4838c00 refcount=4 00010000:00000040:2.0:1788872999.811901:0:6517:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff98a8c4838c00, remote cookie: 0xe4e6e89fb01dc668, flags: 0x0 00010000:00000040:2.0:1788872999.811910:0:6517:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff98a9c2ab1a00) refcount = 1 00010000:00010000:2.0:1788872999.811915:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a8c4838c00/0xe4e6e89fb01dc661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc668 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788872999.811939:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a8c4838c00/0xe4e6e89fb01dc661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dc668 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788872999.811960:0:6517:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a8c9fe6a00 x1875765327896448/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872999.811969:0:6517:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 10000000:00000040:2.0:1788872999.811979:0:6517:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff98a8c75cee00) refs 3 00000020:00000040:2.0:1788872999.811982:0:6517:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8c4838c00 refcount=3 00000020:00000040:3.0:1788872999.813636:0:6517:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:3.0:1788872999.813668:0:6517:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:3.0:1788872999.813690:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4936d80 x1875765327896576/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872999.813703:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4936d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327896576:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1788872999.813745:0:6517:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4936d80 x1875765327896576/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872999.813753:0:6517:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872999.813798:0:6517:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c6c66850 x1875765327896576 msgsize 304 00000100:00100000:3.0:1788872999.813804:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872999.813806:0:6517:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788872999.813828:0:6517:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9f4936d80 x1875765327896576/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872999.813858:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e843c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788872999.814071:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327896576 00000100:00100000:2.0:1788872999.814081:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327896576 00000020:00000040:2.0:1788872999.814084:0:94375:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:2.0:1788872999.814089:0:94375:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=23 00000100:00000040:2.0:1788872999.814112:0:94375:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788872999.814147:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00000040:2.0:1788872999.814151:0:94375:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:2.0:1788872999.814157:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c6c66850 x1875765327896576/t0(0) o256->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:170/0 lens 304/0 e 0 to 0 dl 1788873010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.814169:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327896576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788872999.814192:0:94375:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:2.0:1788872999.814204:0:94375:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1788872999.814210:0:94375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788872999.814213:0:94375:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:2.0:1788872999.814220:0:94375:0:(genops.c:889:class_export_get()) GET export ffff98a8c2645800 refcount=24 00000020:00000040:2.0:1788872999.814267:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 23 00010000:00000040:2.0:1788872999.814295:0:94375:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327896576 00000100:00000040:2.0:1788872999.814307:0:94375:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:2.0:1788872999.814312:0:94375:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872999.814329:0:94375:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff98a9f4936d80 x1875765327896576/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.814342:0:94375:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000100:00000040:2.0:1788872999.814347:0:94375:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c6c66850 x1875765327896576/t0(0) o256->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:170/0 lens 304/240 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.814360:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327896576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 193us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872999.814366:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00000040:2.0:1788872999.814369:0:94375:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:2.0:1788872999.814379:0:94375:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 22 00000100:00000040:3.0:1788872999.815506:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff98a9f4936d80 x1875765327896576/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872999.815519:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff98a9f4936d80 x1875765327896576/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872999.815527:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4936d80 x1875765327896576/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872999.815535:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4936d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327896576:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1788872999.815543:0:6517:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4936d80 x1875765327896576/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1788872999.815603:0:6517:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 128, more 0. 10000000:00000040:3.0:1788872999.815619:0:6517:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1788872999.815635:0:6517:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.204.139@tcp has 192.168.204.139@tcp. 10000000:00000040:3.0:1788872999.815654:0:6517:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:3.0:1788872999.815659:0:6517:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff98a8c37f1000 already not connected (conn 6, was 0): DISCONN 00000100:00000040:3.0:1788872999.815673:0:6517:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:3.0:1788872999.815676:0:6517:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:3.0:1788872999.815679:0:6517:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.139@tcp -> ffff98a9c86f8940 00010000:00080000:3.0:1788872999.815682:0:6517:0:(ldlm_lib.c:85:import_set_conn()) imp ffff98a8c37f1000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.204.139@tcp, moved to head 00010000:00000040:3.0:1788872999.815686:0:6517:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000100:00080000:3.0:1788872999.815691:0:6517:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:3.0:1788872999.815695:0:6517:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 60 to 0@lo 00000100:00000040:3.0:1788872999.815698:0:6517:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000020:00000040:3.0:1788872999.815701:0:6517:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6cb 00000020:00000040:3.0:1788872999.815704:0:6517:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ef0af000 refcount=4 00000100:00000040:3.0:1788872999.815774:0:6517:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 60 to 0@lo 00000100:00000040:3.0:1788872999.815777:0:6517:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000020:00000040:3.0:1788872999.815779:0:6517:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ef0af000 : new refcount 3 00000100:00080000:3.0:1788872999.815791:0:6517:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98a8c37f1000 using connection 192.168.204.139@tcp/0@lo 00000020:00000040:3.0:1788872999.815805:0:6517:0:(genops.c:1231:class_import_get()) import ffff98a8c37f1000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1788872999.815823:0:6517:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f4934380 x1875765327896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872999.815836:0:6517:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b833aeb6] to pc [ptlrpcd_rcv+-1] req@ffff98a9f4934380 x1875765327896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1788872999.815856:0:6517:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 128/128 for lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1788872999.815863:0:6517:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4936d80 x1875765327896576/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872999.815875:0:6517:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:3.0:1788872999.815878:0:6517:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 10000000:01000000:3.0:1788872999.815903:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:3.0:1788872999.815909:0:6517:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a8c4838c00 refcount=3 00010000:00010000:3.0:1788872999.815915:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a8c4838c00/0xe4e6e89fb01dc661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc668 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872999.815935:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a8c4838c00/0xe4e6e89fb01dc661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc668 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1788872999.815945:0:6517:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff98a9f1175400) refs 2 10000000:00000040:3.0:1788872999.815948:0:6517:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff98a8c75cee00) refs 3 10000000:01000000:3.0:1788872999.815950:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788872999.815953:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98a9d0cfb000 from 128 10000000:01000000:3.0:1788872999.815956:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:3.0:1788872999.815960:0:6517:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00010000:00000040:3.0:1788872999.815973:0:6517:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a9c2ab1a00 count: 2 00000020:00000040:3.0:1788872999.815982:0:6517:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98a9fa899c00 with handle 0xe4e6e89fb01dc66f to hash 00010000:00010000:3.0:1788872999.815991:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899c00/0xe4e6e89fb01dc66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872999.816008:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.139@tcp lock: ffff98a9fa899c00/0xe4e6e89fb01dc66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872999.816020:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.139@tcp lock: ffff98a9fa899c00/0xe4e6e89fb01dc66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788872999.816036:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4936d80 x1875765327896832/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872999.816048:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4936d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327896832:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1788872999.816067:0:6517:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4936d80 x1875765327896832/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872999.816075:0:6517:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872999.816106:0:6517:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c6c65c50 x1875765327896832 msgsize 328 00000100:00100000:3.0:1788872999.816111:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872999.816113:0:6517:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788872999.816140:0:6517:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9f4936d80 x1875765327896832/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872999.816166:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e843c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872999.816257:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327896832 00000100:00100000:1.0:1788872999.816265:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327896832 00000020:00000040:1.0:1788872999.816267:0:94381:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:1.0:1788872999.816271:0:94381:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=23 00000100:00000040:1.0:1788872999.816302:0:94381:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788872999.816334:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00000040:1.0:1788872999.816339:0:94381:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:1.0:1788872999.816344:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c6c65c50 x1875765327896832/t0(0) o101->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:170/0 lens 328/0 e 0 to 0 dl 1788873010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.816356:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+23:6517:x1875765327896832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788872999.816368:0:94381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1788872999.816376:0:94381:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff98a9c2ab1100 count: 3 00000020:00000040:1.0:1788872999.816382:0:94381:0:(lustre_handles.c:93:class_handle_hash()) added object ffff98aa002a5600 with handle 0xe4e6e89fb01dc676 to hash 00010000:00010000:1.0:1788872999.816386:0:94381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98aa002a5600/0xe4e6e89fb01dc676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe4e6e89fb01dc66f expref: -99 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788872999.816394:0:94381:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff98a8c2645800 : new locks_count 18 00000020:00000040:1.0:1788872999.816396:0:94381:0:(genops.c:889:class_export_get()) GET export ffff98a8c2645800 refcount=24 00010000:00000040:1.0:1788872999.816538:0:94381:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff98a9c2ab1100) refcount = 3 00010000:00000040:1.0:1788872999.816543:0:94381:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1788872999.816561:0:94381:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98aa002a4000/0xe4e6e89fb01dc668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dc661 expref: 24 pid: 94376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788872999.816582:0:94381:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff98a8c4839e00/0xe4e6e89fb01dc65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.39@tcp remote: 0x1098c8e5828fb556 expref: 9 pid: 94382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872999.816590:0:94381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98aa002a5600/0xe4e6e89fb01dc676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe4e6e89fb01dc66f expref: 24 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872999.816602:0:94381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98aa002a5600/0xe4e6e89fb01dc676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe4e6e89fb01dc66f expref: 24 pid: 94381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788872999.816611:0:94381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98aa002a5600, rc 0) 00010000:00000040:1.0:1788872999.816614:0:94381:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327896832 00000100:00000040:1.0:1788872999.816621:0:94381:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:1.0:1788872999.816625:0:94381:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872999.816645:0:94381:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff98a9f4936d80 x1875765327896832/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872999.816662:0:94381:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 61 to 0@lo 00000100:00000040:1.0:1788872999.816667:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c6c65c50 x1875765327896832/t0(0) o101->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:170/0 lens 328/344 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.816677:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327896832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 322us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872999.816683:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00000040:1.0:1788872999.816686:0:94381:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:1.0:1788872999.816694:0:94381:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 23 00000100:00000040:2.0:1788872999.816837:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4934380 x1875765327896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.816848:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327896704:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1788872999.819835:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4934380 x1875765327896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873024 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.819854:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872999.819910:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c9fe6a00 x1875765327896704 msgsize 520 00000100:00100000:2.0:1788872999.819916:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872999.819953:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4934380 x1875765327896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873024 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.819969:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8465 usecs (9 jiffies) 00000100:00100000:2.0:1788872999.820051:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327896704 00000100:00100000:2.0:1788872999.820060:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327896704 00000020:00000040:2.0:1788872999.820065:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6e0 00000100:00100000:2.0:1788872999.820105:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6092 00000100:00000040:2.0:1788872999.820112:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c9fe6a00 x1875765327896704/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788873019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.820123:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1875765327896704:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:2.0:1788872999.820142:0:8438:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 8 - find 00010000:00000040:2.0:1788872999.820156:0:8438:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1788872999.820163:0:8438:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff98a8c3948000, cookie 0xe4e6e89fb01dc5ff 00010000:00080000:2.0:1788872999.820178:0:8438:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t4294969473 exp ffff98a8c3948000 cur 3936 last 1788872998 00000001:00000040:2.0:1788872999.820194:0:8438:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.139@tcp 00000001:00000040:2.0:1788872999.820200:0:8438:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff98a8c3866800) : new refcount 20 00000020:00000040:2.0:1788872999.820205:0:8438:0:(genops.c:889:class_export_get()) GET export ffff98a8c3948000 refcount=4 00000001:00000040:2.0:1788872999.820207:0:8438:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff98a8c3866800) : new refcount 21 00000001:00000040:2.0:1788872999.820210:0:8438:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff98a8c3866800) : new refcount 20 00002000:00100000:2.0:1788872999.820214:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98a8c3948000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788872999.820218:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788872999.820221:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:2.0:1788872999.820232:0:8438:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff98a9e951ba80 for nid 0@lo - ref 2 00000020:00000040:2.0:1788872999.820503:0:8438:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 9 - import 00000020:00000040:2.0:1788872999.820511:0:8438:0:(genops.c:1244:class_import_put()) import ffff98a9c73c0000 refcount=1 obd=lustre-OST0000 00000020:00000040:2.0:1788872999.820520:0:8438:0:(genops.c:889:class_export_get()) GET export ffff98a8c3948000 refcount=5 00000100:00000040:2.0:1788872999.820523:0:8438:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff98a8c3948000 : new rpc_count 1 00000100:00000040:2.0:1788872999.820530:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:2.0:1788872999.820534:0:8438:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000020:00000040:2.0:1788872999.820537:0:8438:0:(genops.c:889:class_export_get()) GET export ffff98a8c3948000 refcount=6 00000100:00000040:2.0:1788872999.820544:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 63 to 0@lo 00000100:00080000:2.0:1788872999.820584:0:8438:0:(import.c:65:import_set_state_nolock()) ffff98a9c73c0000 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1788872999.820592:0:8438:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c3948000 : new refcount 5 00000020:00000040:2.0:1788872999.820595:0:8438:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff98a8c1cfcd40) now 9 - find 00010000:00000040:2.0:1788872999.820608:0:8438:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969473, transno 0, xid 1875765327896704 00000100:00000040:2.0:1788872999.820618:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 64 to 0@lo 00000100:00000040:2.0:1788872999.820622:0:8438:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872999.820650:0:8438:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff98a9f4934380 x1875765327896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873024 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.820672:0:8438:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 63 to 0@lo 00000100:00000040:2.0:1788872999.820678:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe6a00 x1875765327896704/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788873019 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.820696:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327896704:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 572us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788872999.820704:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6092 00000100:00000040:2.0:1788872999.820707:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c3948000 : new rpc_count 0 00000020:00000040:2.0:1788872999.820718:0:8438:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c3948000 : new refcount 4 00010000:00080000:2.0:1788872999.820956:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9f4934380 x1875765327896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788873024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.820966:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969473 gen 2 00000100:00000040:2.0:1788872999.820971:0:3643:0:(client.c:3168:ptlrpc_free_committed()) @@@ commit (last_committed 4294969473) req@ffff98a9ff54ce00 x1875765327875584/t4294969473(4294969473) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788872977 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.820979:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ff54ce00 x1875765327875584/t4294969473(4294969473) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788872977 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872999.820990:0:3643:0:(genops.c:1244:class_import_put()) import ffff98a8c37f1000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1788872999.821009:0:3643:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=1 replay=1/1 committed=0/0 00000100:00000040:2.0:1788872999.821016:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4934380 x1875765327896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788873024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788872999.821026:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:2.0:1788872999.821029:0:3643:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6cb 00000020:00000040:2.0:1788872999.821032:0:3643:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ef0af000 refcount=4 00000020:00000040:2.0:1788872999.821039:0:3643:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ef0af000 : new refcount 3 00000100:00080000:2.0:1788872999.821044:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788872999.821048:0:3643:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788872999.821050:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969473 gen 2 00000100:00000040:2.0:1788872999.821052:0:3643:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:2.0:1788872999.821054:0:3643:0:(recover.c:53:ptlrpc_replay_next()) import ffff98a8c37f1000 from lustre-OST0000_UUID committed 4294969473 last 0 00000100:00080000:2.0:1788872999.821063:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:2.0:1788872999.821067:0:3643:0:(genops.c:1231:class_import_get()) import ffff98a8c37f1000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1788872999.821181:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934380 x1875765327896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788873024 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.821190:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327896704:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1788872999.821197:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4934380 x1875765327896704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788873024 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872999.821206:0:3643:0:(genops.c:1244:class_import_put()) import ffff98a8c37f1000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00010000:00080000:2.0:1788872999.821225:0:97034:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1788872999.821228:0:97034:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:2.0:1788872999.821234:0:97034:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:2.0:1788872999.821280:0:97034:0:(import.c:65:import_set_state_nolock()) ffff98a8c37f1000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1788872999.821287:0:97034:0:(genops.c:1231:class_import_get()) import ffff98a8c37f1000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1788872999.821431:0:97034:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000022306455] to pc [ptlrpcd_rcv+-1] req@ffff98a8c9fe6d80 x1875765327896960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872999.821529:0:97034:0:(genops.c:1244:class_import_put()) import ffff98a8c37f1000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1788872999.821541:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a8c9fe6d80 x1875765327896960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.821575:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1875765327896960:0@lo:400:ldlm_lock_repla.0 00000100:00000040:2.0:1788872999.821602:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff98a8c9fe6d80 x1875765327896960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873015 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.821610:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872999.821638:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c9fe5500 x1875765327896960 msgsize 224 00000100:00100000:2.0:1788872999.821643:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872999.821666:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a8c9fe6d80 x1875765327896960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873015 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.821686:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8396 usecs (9 jiffies) 00000100:00000040:3.0:1788872999.821973:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4936d80 x1875765327896832/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872999.821985:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4936d80 x1875765327896832/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872999.821992:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4936d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327896832:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1788872999.822001:0:6517:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4936d80 x1875765327896832/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872999.822012:0:6517:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a9fa899c00 refcount=4 00010000:00000040:3.0:1788872999.822025:0:6517:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff98a9fa899c00, remote cookie: 0xe4e6e89fb01dc676, flags: 0x0 00010000:00000040:3.0:1788872999.822034:0:6517:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff98a9c2ab1a00) refcount = 2 00010000:00000040:3.0:1788872999.822038:0:6517:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1788872999.822042:0:6517:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.139@tcp lock: ffff98a8c4838c00/0xe4e6e89fb01dc661 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dc668 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872999.822052:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.139@tcp lock: ffff98a9fa899c00/0xe4e6e89fb01dc66f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc676 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872999.822062:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.139@tcp lock: ffff98a9fa899c00/0xe4e6e89fb01dc66f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe4e6e89fb01dc676 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788872999.822072:0:6517:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4936d80 x1875765327896832/t0(0) o101->MGC192.168.204.139@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788873015 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872999.822082:0:6517:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 10000000:00000040:3.0:1788872999.822091:0:6517:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff98a9f1175400) refs 3 00000020:00000040:3.0:1788872999.822094:0:6517:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a9fa899c00 refcount=3 00000020:00000040:3.0:1788872999.822213:0:6517:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:3.0:1788872999.822230:0:6517:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=5 obd=MGC192.168.204.139@tcp 00000100:00000040:3.0:1788872999.822253:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4936d80 x1875765327897088/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872999.822262:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4936d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327897088:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1788872999.822279:0:6517:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4936d80 x1875765327897088/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872999.822285:0:6517:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788872999.822316:0:6517:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c6c66c50 x1875765327897088 msgsize 304 00000100:00100000:3.0:1788872999.822320:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788872999.822322:0:6517:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788872999.822338:0:6517:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff98a9f4936d80 x1875765327897088/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872999.822369:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff98a9f9e843c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788872999.823500:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327897088 00000100:00100000:1.0:1788872999.823511:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327897088 00000020:00000040:1.0:1788872999.823514:0:94381:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:1.0:1788872999.823519:0:94381:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=24 00000100:00000040:1.0:1788872999.823542:0:94381:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788872999.823598:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00000040:1.0:1788872999.823603:0:94381:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:1.0:1788872999.823610:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c6c66c50 x1875765327897088/t0(0) o256->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:170/0 lens 304/0 e 0 to 0 dl 1788873010 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.823625:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327897088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788872999.823647:0:94381:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:1.0:1788872999.823662:0:94381:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1788872999.823668:0:94381:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788872999.823671:0:94381:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:1.0:1788872999.823677:0:94381:0:(genops.c:889:class_export_get()) GET export ffff98a8c2645800 refcount=25 00000020:00000040:1.0:1788872999.823821:0:94381:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 24 00010000:00000040:1.0:1788872999.823838:0:94381:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327897088 00000100:00000040:1.0:1788872999.823848:0:94381:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 64 to 0@lo 00000100:00000040:1.0:1788872999.823853:0:94381:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788872999.823870:0:94381:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff98a9f4936d80 x1875765327897088/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872999.823884:0:94381:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 63 to 0@lo 00000100:00000040:1.0:1788872999.823888:0:94381:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c6c66c50 x1875765327897088/t0(0) o256->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:170/0 lens 304/240 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.823897:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:6517:x1875765327897088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 274us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788872999.823904:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00000040:1.0:1788872999.823907:0:94381:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:1.0:1788872999.823916:0:94381:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 23 00000100:00100000:1.0:1788872999.823960:0:14545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327896960 00000100:00100000:1.0:1788872999.823965:0:14545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327896960 00000020:00000040:1.0:1788872999.823968:0:14545:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc5ff 00000020:00000040:1.0:1788872999.823971:0:14545:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c3948000 refcount=5 00000100:00000040:1.0:1788872999.823989:0:14545:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1788872999.824032:0:14545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00000040:1.0:1788872999.824035:0:14545:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c3948000 : new rpc_count 1 00000100:00000040:1.0:1788872999.824039:0:14545:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c9fe5500 x1875765327896960/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.824050:0:14545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327896960:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:1.0:1788872999.824059:0:14545:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a8c9fe5500 x1875765327896960/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1788872999.824068:0:14545:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c3948000 : new rpc_count 2 00010000:00080000:1.0:1788872999.824072:0:14545:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a8c9fe5500 x1875765327896960/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788872999.824086:0:14545:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c9fe5500 x1875765327896960/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788872999.824094:0:14545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1875765327896960:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 47us (2454us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872999.824100:0:14545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000100:00000040:1.0:1788872999.824102:0:14545:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c3948000 : new rpc_count 1 00010000:00080000:2.0:1788872999.824512:0:96965:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:3.0:1788872999.824845:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff98a9f4936d80 x1875765327897088/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872999.824856:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff98a9f4936d80 x1875765327897088/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872999.824865:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4936d80 x1875765327897088/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788872999.824872:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4936d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f2e885a0-f180-4b85-9f87-6a01e20afd1a:6517:1875765327897088:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1788872999.824881:0:6517:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4936d80 x1875765327897088/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1788872999.824893:0:6517:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 128, more 0. 10000000:00000040:3.0:1788872999.824907:0:6517:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1788872999.824920:0:6517:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.204.139@tcp has 192.168.204.139@tcp. 10000000:00000040:3.0:1788872999.824947:0:6517:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:3.0:1788872999.824952:0:6517:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff98a9e7bf8800 already not connected (conn 6, was 0): DISCONN 00000100:00000040:3.0:1788872999.824963:0:6517:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 64 to 0@lo 00000100:00000040:3.0:1788872999.824965:0:6517:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 64 to 0@lo 00000100:00000040:3.0:1788872999.824967:0:6517:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.139@tcp -> ffff98a9c86f8940 00010000:00080000:3.0:1788872999.824970:0:6517:0:(ldlm_lib.c:85:import_set_conn()) imp ffff98a9e7bf8800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.204.139@tcp, moved to head 00010000:00000040:3.0:1788872999.824974:0:6517:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 63 to 0@lo 00000100:00080000:3.0:1788872999.824978:0:6517:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:3.0:1788872999.824983:0:6517:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:3.0:1788872999.824985:0:6517:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 63 to 0@lo 00000020:00000040:3.0:1788872999.824988:0:6517:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d5518 00000020:00000040:3.0:1788872999.824991:0:6517:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c5646000 refcount=4 00000100:00000040:3.0:1788872999.824994:0:6517:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 62 to 0@lo 00000100:00000040:3.0:1788872999.825008:0:6517:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 63 to 0@lo 00000020:00000040:3.0:1788872999.825010:0:6517:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c5646000 : new refcount 3 00000100:00080000:3.0:1788872999.825014:0:6517:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98a9e7bf8800 using connection 192.168.204.139@tcp/0@lo 00000020:00000040:3.0:1788872999.825026:0:6517:0:(genops.c:1231:class_import_get()) import ffff98a9e7bf8800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1788872999.825046:0:6517:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98a9f4936a00 x1875765327897216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788872999.825059:0:6517:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a199b9eb] to pc [ptlrpcd_rcv+-1] req@ffff98a9f4936a00 x1875765327897216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1788872999.825075:0:6517:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 128/128 for lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1788872999.825083:0:6517:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4936d80 x1875765327897088/t0(0) o256->MGC192.168.204.139@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788873015 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788872999.825093:0:6517:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000020:00000040:3.0:1788872999.825097:0:6517:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 10000000:01000000:3.0:1788872999.825119:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:3.0:1788872999.825124:0:6517:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff98a9fa899c00 refcount=3 00010000:00010000:3.0:1788872999.825129:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.139@tcp lock: ffff98a9fa899c00/0xe4e6e89fb01dc66f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc676 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788872999.825140:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.139@tcp lock: ffff98a9fa899c00/0xe4e6e89fb01dc66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe4e6e89fb01dc676 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1788872999.825150:0:6517:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff98a9f1175400) refs 3 00000100:00000040:2.0:1788872999.825524:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4936a00 x1875765327897216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.825538:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327897216:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1788872999.825585:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9f4936a00 x1875765327897216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873024 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.825594:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872999.825625:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ff53dc00 x1875765327897216 msgsize 520 00000100:00100000:2.0:1788872999.825630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872999.825650:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4936a00 x1875765327897216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873024 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.825660:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 6692 usecs (7 jiffies) 00000100:00100000:0.0:1788872999.825840:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327897216 00000100:00100000:0.0:1788872999.825847:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327897216 00000020:00000040:0.0:1788872999.825850:0:26192:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d552d 00000100:00100000:0.0:1788872999.825886:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6093 00000100:00000040:0.0:1788872999.825893:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ff53dc00 x1875765327897216/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788873019 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872999.825903:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3643:x1875765327897216:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:0.0:1788872999.825918:0:26192:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 9 - find 00010000:00000040:0.0:1788872999.825939:0:26192:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1788872999.825946:0:26192:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff98a9ee83f800, cookie 0xe4e6e89fb01dc5f8 00010000:00080000:0.0:1788872999.825951:0:26192:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff98a9ee83f800 cur 3936 last 1788872998 00000001:00000040:0.0:1788872999.825965:0:26192:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.204.139@tcp 00000001:00000040:0.0:1788872999.825970:0:26192:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff98a8c3866800) : new refcount 21 00000020:00000040:0.0:1788872999.825975:0:26192:0:(genops.c:889:class_export_get()) GET export ffff98a9ee83f800 refcount=4 00000001:00000040:0.0:1788872999.825977:0:26192:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff98a8c3866800) : new refcount 22 00000001:00000040:0.0:1788872999.825990:0:26192:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff98a8c3866800) : new refcount 21 00002000:00100000:0.0:1788872999.825993:0:26192:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98a9ee83f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788872999.825997:0:26192:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788872999.826000:0:26192:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:0.0:1788872999.826010:0:26192:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff98a9e951ba80 for nid 0@lo - ref 3 00000020:00000040:0.0:1788872999.826019:0:26192:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 10 - import 00000020:00000040:0.0:1788872999.826024:0:26192:0:(genops.c:1244:class_import_put()) import ffff98a9e99a2800 refcount=1 obd=lustre-OST0000 00000020:00000040:0.0:1788872999.826030:0:26192:0:(genops.c:889:class_export_get()) GET export ffff98a9ee83f800 refcount=5 00000100:00000040:0.0:1788872999.826032:0:26192:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff98a9ee83f800 : new rpc_count 1 00000100:00000040:0.0:1788872999.826036:0:26192:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 64 to 0@lo 00000100:00000040:0.0:1788872999.826038:0:26192:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff98a9c86f8940 refcount 64 to 0@lo 00000020:00000040:0.0:1788872999.826040:0:26192:0:(genops.c:889:class_export_get()) GET export ffff98a9ee83f800 refcount=6 00000100:00000040:0.0:1788872999.826045:0:26192:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00080000:0.0:1788872999.826053:0:26192:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a2800 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1788872999.826062:0:26192:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ee83f800 : new refcount 5 00000020:00000040:0.0:1788872999.826065:0:26192:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff98a8c1cfcd40) now 10 - find 00010000:00000040:0.0:1788872999.826077:0:26192:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1875765327897216 00000100:00000040:0.0:1788872999.826083:0:26192:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:0.0:1788872999.826088:0:26192:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788872999.826108:0:26192:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff98a9f4936a00 x1875765327897216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788873024 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788872999.826136:0:26192:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:0.0:1788872999.826140:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53dc00 x1875765327897216/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788873019 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788872999.826148:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3643:x1875765327897216:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 244us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788872999.826154:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6093 00000100:00000040:0.0:1788872999.826156:0:26192:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9ee83f800 : new rpc_count 0 00000020:00000040:0.0:1788872999.826171:0:26192:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ee83f800 : new refcount 4 00010000:00080000:2.0:1788872999.827821:0:96965:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00000040:2.0:1788872999.827832:0:96965:0:(ldlm_lib.c:2874:target_recovery_thread()) 1: request replay stage - 2 clients from t4294969478 00010000:00080000:2.0:1788872999.827836:0:96965:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 4294969478 00010000:00080000:2.0:1788872999.827842:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 1, req_transno: 4294969478, next_transno: 4294969478 00010000:00080000:2.0:1788872999.827845:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969478) 00010000:00080000:2.0:1788872999.827858:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311267456 t4294969478 from 192.168.204.39@tcp req@ffff98a9df5ad880 x1875765311267456/t0(4294969478) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788872999.827880:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9df5ad880 x1875765311267456/t0(4294969478) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1788872999.827915:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x385:0x0] 00010000:00080000:3.0:1788872999.828585:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98a9f4936a00 x1875765327897216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788873024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788872999.828597:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1788872999.828602:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9f4936a00 x1875765327897216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788873024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788872999.828613:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:3.0:1788872999.828622:0:3643:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d5518 00000020:00000040:3.0:1788872999.828627:0:3643:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c5646000 refcount=4 00000020:00000040:3.0:1788872999.828634:0:3643:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c5646000 : new refcount 3 00000100:00080000:3.0:1788872999.828639:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788872999.828643:0:3643:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788872999.828646:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969455 gen 2 00000100:00000040:3.0:1788872999.828649:0:3643:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:3.0:1788872999.828652:0:3643:0:(recover.c:53:ptlrpc_replay_next()) import ffff98a9e7bf8800 from lustre-OST0000_UUID committed 4294969455 last 0 00000100:00080000:3.0:1788872999.828655:0:3643:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:3.0:1788872999.828658:0:3643:0:(genops.c:1231:class_import_get()) import ffff98a9e7bf8800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000001:00000040:2.0:1788872999.830142:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 1 00000020:00000040:2.0:1788872999.830148:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=6 00010000:00000040:2.0:1788872999.830198:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969478, xid 1875765311267456 00000100:00000040:2.0:1788872999.830216:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:2.0:1788872999.830222:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:2.0:1788872999.830282:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:2.0:1788872999.833190:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00000040:2.0:1788872999.833201:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:2.0:1788872999.833214:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 5 00010000:00080000:2.0:1788872999.833220:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969479 00010000:00080000:2.0:1788872999.833226:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969479 00000100:00000040:3.0:1788872999.833531:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4936d80 x1875765311268352 msgsize 440 00000100:00100000:3.0:1788872999.833541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872999.838855:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311268352 00000100:00100000:3.0:1788872999.838871:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311268352 00000020:00000040:3.0:1788872999.838875:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788872999.838881:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=6 00000100:00000040:3.0:1788872999.838909:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788872999.838984:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1049 00000100:00000040:3.0:1788872999.838989:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:3.0:1788872999.838996:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4936d80 x1875765311268352/t0(4294969479) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872999.839009:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311268352:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:3.0:1788872999.839021:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f4936d80 x1875765311268352/t0(4294969479) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788872999.839030:0:8443:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969479, current: 4294969479, replaying 00010000:00000040:3.0:1788872999.839033:0:8443:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:3.0:1788872999.839044:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4936d80 x1875765311268352/t0(4294969479) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872999.839067:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+6:2403:x1875765311268352:12345-192.168.204.39@tcp:10:dd.0 Request processed in 59us (5535us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872999.839075:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1049 00000100:00000040:3.0:1788872999.839077:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788872999.839603:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 1, req_transno: 4294969479, next_transno: 4294969479 00010000:00080000:1.0:1788872999.839610:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969479) 00010000:00080000:1.0:1788872999.839620:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311268352 t4294969479 from 192.168.204.39@tcp req@ffff98a9f4936d80 x1875765311268352/t0(4294969479) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788872999.839637:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f4936d80 x1875765311268352/t0(4294969479) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788872999.839669:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x384:0x0] 00000001:00000040:1.0:1788872999.839857:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 2 00000020:00000040:1.0:1788872999.839861:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=7 00010000:00000040:1.0:1788872999.839911:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969479, xid 1875765311268352 00000100:00000040:1.0:1788872999.839921:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788872999.839938:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788872999.839996:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788872999.840005:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788872999.840011:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788872999.840024:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 6 00010000:00080000:1.0:1788872999.840028:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969480 00010000:00080000:1.0:1788872999.840031:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969480 00000100:00000040:2.0:1788872999.841713:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4936a00 x1875765327897216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788873024 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.841730:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f4936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327897216:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1788872999.841741:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9f4936a00 x1875765327897216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788873024 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788872999.841755:0:3643:0:(genops.c:1244:class_import_put()) import ffff98a9e7bf8800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:3.0:1788872999.841795:0:97035:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1788872999.841800:0:97035:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:3.0:1788872999.841806:0:97035:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:3.0:1788872999.841847:0:97035:0:(import.c:65:import_set_state_nolock()) ffff98a9e7bf8800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:3.0:1788872999.841855:0:97035:0:(genops.c:1231:class_import_get()) import ffff98a9e7bf8800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1788872999.841878:0:97035:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000aa0521e] to pc [ptlrpcd_rcv+-1] req@ffff98a9f4934e00 x1875765327897344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.841921:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9f4934e00 x1875765327897344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.841944:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f4934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1875765327897344:0@lo:400:ldlm_lock_repla.0 00000100:00000040:2.0:1788872999.841970:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff98a9f4934e00 x1875765327897344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873015 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.841977:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788872999.842014:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ff53d880 x1875765327897344 msgsize 224 00000100:00100000:2.0:1788872999.842018:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788872999.842039:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9f4934e00 x1875765327897344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873015 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.842051:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 6686 usecs (7 jiffies) 00000020:00000040:3.0:1788872999.842198:0:97035:0:(genops.c:1244:class_import_put()) import ffff98a9e7bf8800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1788872999.842820:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81d500 x1875765311269120 msgsize 440 00000100:00100000:1.0:1788872999.842829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872999.842900:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311269120 00000100:00100000:0.0:1788872999.842908:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311269120 00000020:00000040:0.0:1788872999.842912:0:24865:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788872999.842916:0:24865:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=7 00000100:00000040:0.0:1788872999.842950:0:24865:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788872999.842997:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1050 00000100:00000040:0.0:1788872999.843002:0:24865:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788872999.843008:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81d500 x1875765311269120/t0(4294969480) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872999.843023:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2403:x1875765311269120:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:0.0:1788872999.843035:0:24865:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ee81d500 x1875765311269120/t0(4294969480) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788872999.843046:0:24865:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969480, current: 4294969480, replaying 00010000:00000040:0.0:1788872999.843049:0:24865:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788872999.843067:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81d500 x1875765311269120/t0(4294969480) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872999.843077:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2403:x1875765311269120:12345-192.168.204.39@tcp:10:dd.0 Request processed in 56us (255us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788872999.843083:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1050 00000100:00000040:0.0:1788872999.843087:0:24865:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:3.0:1788872999.843136:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 1, req_transno: 4294969480, next_transno: 4294969480 00010000:00080000:3.0:1788872999.843141:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969480) 00010000:00080000:3.0:1788872999.843148:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311269120 t4294969480 from 192.168.204.39@tcp req@ffff98a9ee81d500 x1875765311269120/t0(4294969480) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788872999.843163:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ee81d500 x1875765311269120/t0(4294969480) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788872999.843191:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x382:0x0] 00000100:00100000:2.0:1788872999.843640:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327897344 00000100:00100000:2.0:1788872999.843657:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327897344 00000020:00000040:2.0:1788872999.843660:0:26199:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc5f8 00000020:00000040:2.0:1788872999.843664:0:26199:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ee83f800 refcount=5 00000100:00100000:2.0:1788872999.843700:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00000040:2.0:1788872999.843703:0:26199:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9ee83f800 : new rpc_count 1 00000100:00000040:2.0:1788872999.843708:0:26199:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ff53d880 x1875765327897344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.843720:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3643:x1875765327897344:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1788872999.843728:0:26199:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53d880 x1875765327897344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788872999.843737:0:26199:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a9ee83f800 : new rpc_count 2 00010000:00080000:2.0:1788872999.843741:0:26199:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff98a9ff53d880 x1875765327897344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788872999.843749:0:26199:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53d880 x1875765327897344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788872999.843757:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3643:x1875765327897344:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 40us (1743us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788872999.843763:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00000040:2.0:1788872999.843766:0:26199:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9ee83f800 : new rpc_count 1 00000001:00000040:3.0:1788872999.843820:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 3 00000020:00000040:3.0:1788872999.843824:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=8 00010000:00000040:3.0:1788872999.843864:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969480, xid 1875765311269120 00000100:00000040:3.0:1788872999.843875:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.843881:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872999.843939:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:3.0:1788872999.843947:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788872999.843953:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:3.0:1788872999.843965:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 7 00010000:00080000:3.0:1788872999.843969:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969481 00010000:00080000:3.0:1788872999.843972:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969481 00000100:00000040:3.0:1788872999.848037:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4934a80 x1875765311271040 msgsize 440 00000100:00100000:3.0:1788872999.848054:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872999.848128:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311271040 00000100:00100000:1.0:1788872999.848138:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311271040 00000020:00000040:1.0:1788872999.848142:0:24869:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:1.0:1788872999.848146:0:24869:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=8 00000100:00000040:1.0:1788872999.848170:0:24869:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788872999.848222:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1051 00000100:00000040:1.0:1788872999.848227:0:24869:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:1.0:1788872999.848235:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4934a80 x1875765311271040/t0(4294969481) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.848249:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4934a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2403:x1875765311271040:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:1.0:1788872999.848263:0:24869:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f4934a80 x1875765311271040/t0(4294969481) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788872999.848272:0:24869:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969481, current: 4294969481, replaying 00010000:00000040:1.0:1788872999.848276:0:24869:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:1.0:1788872999.854048:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934a80 x1875765311271040/t0(4294969481) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.854079:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4934a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+8:2403:x1875765311271040:12345-192.168.204.39@tcp:10:dd.0 Request processed in 5830us (6042us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872999.854090:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1051 00000100:00000040:1.0:1788872999.854094:0:24869:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:3.0:1788872999.856430:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969481, next_transno: 4294969481 00010000:00080000:3.0:1788872999.856443:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969481) 00010000:00080000:3.0:1788872999.856459:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311271040 t4294969481 from 192.168.204.39@tcp req@ffff98a9f4934a80 x1875765311271040/t0(4294969481) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788872999.856487:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f4934a80 x1875765311271040/t0(4294969481) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788872999.856526:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x383:0x0] 00000001:00000040:3.0:1788872999.856726:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 4 00000020:00000040:3.0:1788872999.856730:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=9 00010000:00000040:3.0:1788872999.856765:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969481, xid 1875765311271040 00000100:00000040:3.0:1788872999.856776:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.856783:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872999.856844:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:3.0:1788872999.856858:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788872999.856870:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:3.0:1788872999.856883:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 8 00010000:00080000:3.0:1788872999.856888:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00010000:00080000:3.0:1788872999.856892:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00000100:00000040:2.0:1788872999.867092:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ff53df80 x1875765311271168 msgsize 440 00000100:00100000:2.0:1788872999.867108:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872999.870610:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311271168 00000100:00100000:0.0:1788872999.870626:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311271168 00000020:00000040:0.0:1788872999.870630:0:24866:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788872999.870636:0:24866:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=9 00000100:00000040:0.0:1788872999.870661:0:24866:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788872999.870708:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1052 00000100:00000040:0.0:1788872999.870713:0:24866:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788872999.870727:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ff53df80 x1875765311271168/t0(4294969482) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872999.870742:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2403:x1875765311271168:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:0.0:1788872999.870754:0:24866:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53df80 x1875765311271168/t0(4294969482) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788872999.870765:0:24866:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969482, current: 4294969482, replaying 00010000:00000040:0.0:1788872999.870768:0:24866:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788872999.870783:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53df80 x1875765311271168/t0(4294969482) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872999.870792:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+9:2403:x1875765311271168:12345-192.168.204.39@tcp:10:dd.0 Request processed in 54us (3705us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788872999.870799:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1052 00000100:00000040:0.0:1788872999.870802:0:24866:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:3.0:1788872999.870867:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969482, next_transno: 4294969482 00010000:00080000:3.0:1788872999.870876:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969482) 00010000:00080000:3.0:1788872999.870884:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311271168 t4294969482 from 192.168.204.39@tcp req@ffff98a9ff53df80 x1875765311271168/t0(4294969482) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788872999.870899:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53df80 x1875765311271168/t0(4294969482) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788872999.870939:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x386:0x0] 00000001:00000040:3.0:1788872999.871132:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 5 00000020:00000040:3.0:1788872999.871135:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=10 00010000:00000040:3.0:1788872999.871170:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969482, xid 1875765311271168 00000100:00000040:3.0:1788872999.871181:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.871187:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872999.871248:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:3.0:1788872999.871257:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788872999.871263:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:3.0:1788872999.871271:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 9 00010000:00080000:3.0:1788872999.871275:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00010000:00080000:3.0:1788872999.871279:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00000100:00000040:3.0:1788872999.874460:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4934000 x1875765311272448 msgsize 440 00000100:00100000:3.0:1788872999.874476:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872999.874581:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311272448 00000100:00100000:0.0:1788872999.874590:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311272448 00000020:00000040:0.0:1788872999.874593:0:24855:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788872999.874598:0:24855:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=10 00000100:00000040:0.0:1788872999.874628:0:24855:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788872999.874672:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1053 00000100:00000040:0.0:1788872999.874676:0:24855:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788872999.874684:0:24855:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4934000 x1875765311272448/t0(4294969483) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872999.874697:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2403:x1875765311272448:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:0.0:1788872999.874709:0:24855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f4934000 x1875765311272448/t0(4294969483) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788872999.874744:0:24855:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969483, current: 4294969483, replaying 00010000:00000040:0.0:1788872999.874748:0:24855:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788872999.874762:0:24855:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934000 x1875765311272448/t0(4294969483) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872999.874771:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2403:x1875765311272448:12345-192.168.204.39@tcp:10:dd.0 Request processed in 75us (311us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788872999.874778:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1053 00000100:00000040:0.0:1788872999.874782:0:24855:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:3.0:1788872999.875066:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969483, next_transno: 4294969483 00010000:00080000:3.0:1788872999.875071:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969483) 00010000:00080000:3.0:1788872999.875079:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311272448 t4294969483 from 192.168.204.39@tcp req@ffff98a9f4934000 x1875765311272448/t0(4294969483) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788872999.875095:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f4934000 x1875765311272448/t0(4294969483) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788872999.875127:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x388:0x0] 00000001:00000040:3.0:1788872999.875333:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 6 00000020:00000040:3.0:1788872999.875338:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=11 00010000:00000040:3.0:1788872999.875378:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969483, xid 1875765311272448 00000100:00000040:3.0:1788872999.875390:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.875396:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872999.875486:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:3.0:1788872999.875496:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788872999.875502:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:3.0:1788872999.875512:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 10 00010000:00080000:3.0:1788872999.875516:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00010000:00080000:3.0:1788872999.875520:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00000100:00000040:0.0:1788872999.889077:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5af480 x1875765311273344 msgsize 440 00000100:00100000:0.0:1788872999.889096:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872999.889290:0:25436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311273344 00000100:00100000:1.0:1788872999.889301:0:25436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311273344 00000020:00000040:1.0:1788872999.889304:0:25436:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:1.0:1788872999.889311:0:25436:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=11 00000100:00000040:1.0:1788872999.889336:0:25436:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788872999.889384:0:25436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1054 00000100:00000040:1.0:1788872999.889388:0:25436:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:1.0:1788872999.889396:0:25436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5af480 x1875765311273344/t0(4294969484) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.889408:0:25436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2403:x1875765311273344:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:1.0:1788872999.889420:0:25436:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9df5af480 x1875765311273344/t0(4294969484) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788872999.889430:0:25436:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969484, current: 4294969484, replaying 00010000:00000040:1.0:1788872999.889434:0:25436:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:1.0:1788872999.889452:0:25436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5af480 x1875765311273344/t0(4294969484) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.889461:0:25436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2403:x1875765311273344:12345-192.168.204.39@tcp:10:dd.0 Request processed in 55us (385us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872999.889469:0:25436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1054 00000100:00000040:1.0:1788872999.889472:0:25436:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:3.0:1788872999.889486:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969484, next_transno: 4294969484 00010000:00080000:3.0:1788872999.889490:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969484) 00010000:00080000:3.0:1788872999.889499:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311273344 t4294969484 from 192.168.204.39@tcp req@ffff98a9df5af480 x1875765311273344/t0(4294969484) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788872999.889515:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9df5af480 x1875765311273344/t0(4294969484) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788872999.889574:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x389:0x0] 00000001:00000040:3.0:1788872999.889792:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 7 00000020:00000040:3.0:1788872999.889796:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=12 00010000:00000040:3.0:1788872999.889831:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969484, xid 1875765311273344 00000100:00000040:3.0:1788872999.889841:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.889847:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872999.889892:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:3.0:1788872999.889901:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788872999.889906:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:3.0:1788872999.889914:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 11 00010000:00080000:3.0:1788872999.889917:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00010000:00080000:3.0:1788872999.889940:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00000100:00000040:2.0:1788872999.894729:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ff53d500 x1875765311275520 msgsize 440 00000100:00100000:2.0:1788872999.894745:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872999.894962:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311275520 00000100:00100000:1.0:1788872999.894979:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311275520 00000020:00000040:1.0:1788872999.894983:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:1.0:1788872999.894988:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=12 00000100:00000040:1.0:1788872999.895015:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788872999.895068:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1055 00000100:00000040:1.0:1788872999.895073:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:1.0:1788872999.895080:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ff53d500 x1875765311275520/t0(4294969485) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.895094:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+12:2403:x1875765311275520:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:1.0:1788872999.895107:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53d500 x1875765311275520/t0(4294969485) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788872999.895116:0:8443:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969485, current: 4294969485, replaying 00010000:00000040:1.0:1788872999.895120:0:8443:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:1.0:1788872999.895141:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53d500 x1875765311275520/t0(4294969485) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.895149:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+12:2403:x1875765311275520:12345-192.168.204.39@tcp:10:dd.0 Request processed in 57us (421us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872999.895156:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1055 00000100:00000040:1.0:1788872999.895159:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:0.0:1788872999.895505:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969485, next_transno: 4294969485 00010000:00080000:0.0:1788872999.895511:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969485) 00010000:00080000:0.0:1788872999.895521:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311275520 t4294969485 from 192.168.204.39@tcp req@ffff98a9ff53d500 x1875765311275520/t0(4294969485) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788872999.895540:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53d500 x1875765311275520/t0(4294969485) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788872999.895762:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x387:0x0] 00000001:00000040:1.0:1788872999.895977:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 8 00000020:00000040:1.0:1788872999.895981:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=13 00010000:00000040:1.0:1788872999.896016:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969485, xid 1875765311275520 00000100:00000040:1.0:1788872999.896028:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788872999.896034:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788872999.896445:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788872999.896457:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788872999.896470:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788872999.896479:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 12 00010000:00080000:1.0:1788872999.896484:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00010000:00080000:1.0:1788872999.896488:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00000100:00000040:1.0:1788872999.899999:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81dc00 x1875765311276160 msgsize 440 00000100:00100000:1.0:1788872999.900015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872999.900463:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311276160 00000100:00100000:2.0:1788872999.900474:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311276160 00000020:00000040:2.0:1788872999.900477:0:24865:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:2.0:1788872999.900483:0:24865:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=13 00000100:00000040:2.0:1788872999.900523:0:24865:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788872999.900654:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1056 00000100:00000040:2.0:1788872999.900658:0:24865:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:2.0:1788872999.900666:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81dc00 x1875765311276160/t0(4294969486) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872999.900681:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+13:2403:x1875765311276160:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:2.0:1788872999.900694:0:24865:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ee81dc00 x1875765311276160/t0(4294969486) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788872999.900789:0:24865:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969486, current: 4294969486, replaying 00010000:00000040:2.0:1788872999.900794:0:24865:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:2.0:1788872999.903832:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81dc00 x1875765311276160/t0(4294969486) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872999.903849:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+13:2403:x1875765311276160:12345-192.168.204.39@tcp:10:dd.0 Request processed in 3170us (3849us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788872999.903862:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1056 00000100:00000040:2.0:1788872999.903866:0:24865:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788872999.905003:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969486, next_transno: 4294969486 00010000:00080000:1.0:1788872999.905010:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969486) 00010000:00080000:1.0:1788872999.905022:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311276160 t4294969486 from 192.168.204.39@tcp req@ffff98a9ee81dc00 x1875765311276160/t0(4294969486) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788872999.905047:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ee81dc00 x1875765311276160/t0(4294969486) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788872999.905082:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38a:0x0] 00000001:00000040:1.0:1788872999.905249:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 9 00000020:00000040:1.0:1788872999.905253:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=14 00010000:00000040:1.0:1788872999.905287:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969486, xid 1875765311276160 00000100:00000040:1.0:1788872999.905297:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788872999.905305:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788872999.908670:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788872999.908695:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788872999.908717:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788872999.908733:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 13 00010000:00080000:1.0:1788872999.908740:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00010000:00080000:1.0:1788872999.908746:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00000100:00000040:1.0:1788872999.915674:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81c000 x1875765311277440 msgsize 440 00000100:00100000:1.0:1788872999.915692:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788872999.915870:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311277440 00000100:00100000:2.0:1788872999.915881:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311277440 00000020:00000040:2.0:1788872999.915885:0:8442:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:2.0:1788872999.915890:0:8442:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=14 00000100:00000040:2.0:1788872999.915914:0:8442:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788872999.915968:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1057 00000100:00000040:2.0:1788872999.915974:0:8442:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:2.0:1788872999.915982:0:8442:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81c000 x1875765311277440/t0(4294969487) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872999.915996:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+14:2403:x1875765311277440:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:2.0:1788872999.916023:0:8442:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ee81c000 x1875765311277440/t0(4294969487) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788872999.916038:0:8442:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969487, current: 4294969487, replaying 00010000:00000040:2.0:1788872999.916041:0:8442:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:2.0:1788872999.916055:0:8442:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81c000 x1875765311277440/t0(4294969487) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788872999.916064:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0804304d-5904-48ad-87f2-bcbc7642a62a+14:2403:x1875765311277440:12345-192.168.204.39@tcp:10:dd.0 Request processed in 70us (391us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788872999.916072:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1057 00010000:00080000:1.0:1788872999.916072:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969487, next_transno: 4294969487 00000100:00000040:2.0:1788872999.916076:0:8442:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788872999.916083:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969487) 00010000:00080000:1.0:1788872999.916090:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311277440 t4294969487 from 192.168.204.39@tcp req@ffff98a9ee81c000 x1875765311277440/t0(4294969487) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788872999.916106:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ee81c000 x1875765311277440/t0(4294969487) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788872999.916137:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38b:0x0] 00000001:00000040:1.0:1788872999.916301:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 10 00000020:00000040:1.0:1788872999.916304:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=15 00010000:00000040:1.0:1788872999.916339:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969487, xid 1875765311277440 00000100:00000040:1.0:1788872999.916350:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788872999.916355:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788872999.916409:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788872999.916419:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788872999.916425:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788872999.916434:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 14 00010000:00080000:1.0:1788872999.916438:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00010000:00080000:1.0:1788872999.916442:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00000100:00000040:2.0:1788872999.921693:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ff53c700 x1875765311278720 msgsize 440 00000100:00100000:2.0:1788872999.921717:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872999.921824:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311278720 00000100:00100000:0.0:1788872999.921834:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311278720 00000020:00000040:0.0:1788872999.921838:0:24866:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788872999.921843:0:24866:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=15 00000100:00000040:0.0:1788872999.921867:0:24866:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788872999.921912:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1058 00000100:00000040:0.0:1788872999.921917:0:24866:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788872999.921936:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ff53c700 x1875765311278720/t0(4294969488) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872999.921950:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+15:2403:x1875765311278720:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:0.0:1788872999.921975:0:24866:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53c700 x1875765311278720/t0(4294969488) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788872999.921984:0:24866:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969488, current: 4294969488, replaying 00010000:00000040:0.0:1788872999.921988:0:24866:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788872999.922007:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53c700 x1875765311278720/t0(4294969488) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872999.922015:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+15:2403:x1875765311278720:12345-192.168.204.39@tcp:10:dd.0 Request processed in 68us (323us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788872999.922022:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1058 00000100:00000040:0.0:1788872999.922025:0:24866:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:3.0:1788872999.922173:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969488, next_transno: 4294969488 00010000:00080000:3.0:1788872999.922177:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969488) 00010000:00080000:3.0:1788872999.922186:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311278720 t4294969488 from 192.168.204.39@tcp req@ffff98a9ff53c700 x1875765311278720/t0(4294969488) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788872999.922202:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53c700 x1875765311278720/t0(4294969488) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788872999.922237:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38d:0x0] 00000001:00000040:3.0:1788872999.922695:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 11 00000020:00000040:3.0:1788872999.922700:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=16 00010000:00000040:3.0:1788872999.922878:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969488, xid 1875765311278720 00000100:00000040:3.0:1788872999.922890:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.922896:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872999.922986:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:3.0:1788872999.922997:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788872999.923003:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:3.0:1788872999.923012:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 15 00010000:00080000:3.0:1788872999.923016:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00010000:00080000:3.0:1788872999.923021:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00000100:00000040:2.0:1788872999.926777:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ff53fb80 x1875765311279488 msgsize 440 00000100:00100000:2.0:1788872999.926796:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872999.926863:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311279488 00000100:00100000:0.0:1788872999.926876:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311279488 00000020:00000040:0.0:1788872999.926879:0:24855:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788872999.926885:0:24855:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=16 00000100:00000040:0.0:1788872999.926913:0:24855:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788872999.926969:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1059 00000100:00000040:0.0:1788872999.926973:0:24855:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788872999.926981:0:24855:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ff53fb80 x1875765311279488/t0(4294969489) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872999.926994:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+16:2403:x1875765311279488:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:0.0:1788872999.927005:0:24855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53fb80 x1875765311279488/t0(4294969489) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788872999.927015:0:24855:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969489, current: 4294969489, replaying 00010000:00000040:0.0:1788872999.927018:0:24855:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788872999.927035:0:24855:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53fb80 x1875765311279488/t0(4294969489) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872999.927057:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+16:2403:x1875765311279488:12345-192.168.204.39@tcp:10:dd.0 Request processed in 65us (282us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788872999.927065:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1059 00000100:00000040:0.0:1788872999.927068:0:24855:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788872999.927180:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969489, next_transno: 4294969489 00010000:00080000:1.0:1788872999.927185:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969489) 00010000:00080000:1.0:1788872999.927193:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311279488 t4294969489 from 192.168.204.39@tcp req@ffff98a9ff53fb80 x1875765311279488/t0(4294969489) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788872999.927208:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53fb80 x1875765311279488/t0(4294969489) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788872999.927239:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38c:0x0] 00000001:00000040:1.0:1788872999.927424:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 12 00000020:00000040:1.0:1788872999.927428:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=17 00010000:00000040:1.0:1788872999.927466:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969489, xid 1875765311279488 00000100:00000040:1.0:1788872999.927482:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788872999.927488:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788872999.927536:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788872999.927544:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788872999.927583:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788872999.927592:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 16 00010000:00080000:1.0:1788872999.927596:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00010000:00080000:1.0:1788872999.927599:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00000100:00000040:3.0:1788872999.933480:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4937b80 x1875765311280896 msgsize 440 00000100:00100000:3.0:1788872999.933500:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872999.933670:0:25436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311280896 00000100:00100000:1.0:1788872999.933690:0:25436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311280896 00000020:00000040:1.0:1788872999.933694:0:25436:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:1.0:1788872999.933700:0:25436:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=17 00000100:00000040:1.0:1788872999.933724:0:25436:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788872999.933772:0:25436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1060 00000100:00000040:1.0:1788872999.933776:0:25436:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:1.0:1788872999.933784:0:25436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4937b80 x1875765311280896/t0(4294969490) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.933799:0:25436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+17:2403:x1875765311280896:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:1.0:1788872999.933810:0:25436:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f4937b80 x1875765311280896/t0(4294969490) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788872999.933820:0:25436:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969490, current: 4294969490, replaying 00010000:00000040:1.0:1788872999.933823:0:25436:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:1.0:1788872999.933844:0:25436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4937b80 x1875765311280896/t0(4294969490) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.933852:0:25436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+17:2403:x1875765311280896:12345-192.168.204.39@tcp:10:dd.0 Request processed in 57us (374us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872999.933859:0:25436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1060 00000100:00000040:1.0:1788872999.933875:0:25436:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:3.0:1788872999.933983:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969490, next_transno: 4294969490 00010000:00080000:3.0:1788872999.933987:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969490) 00010000:00080000:3.0:1788872999.933995:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311280896 t4294969490 from 192.168.204.39@tcp req@ffff98a9f4937b80 x1875765311280896/t0(4294969490) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788872999.934010:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f4937b80 x1875765311280896/t0(4294969490) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788872999.934047:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38e:0x0] 00000001:00000040:3.0:1788872999.934222:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 13 00000020:00000040:3.0:1788872999.934226:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=18 00010000:00000040:3.0:1788872999.934256:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969490, xid 1875765311280896 00000100:00000040:3.0:1788872999.934265:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.934271:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872999.934318:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:3.0:1788872999.934326:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788872999.934331:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:3.0:1788872999.934340:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 17 00010000:00080000:3.0:1788872999.934345:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00010000:00080000:3.0:1788872999.934348:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00000100:00000040:3.0:1788872999.946041:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4936a00 x1875765311281408 msgsize 440 00000100:00100000:3.0:1788872999.946058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872999.946338:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311281408 00000100:00100000:1.0:1788872999.946349:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311281408 00000020:00000040:1.0:1788872999.946353:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:1.0:1788872999.946358:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=18 00000100:00000040:1.0:1788872999.946380:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788872999.946421:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1061 00000100:00000040:1.0:1788872999.946426:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:1.0:1788872999.946433:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4936a00 x1875765311281408/t0(4294969491) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.946446:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+18:2403:x1875765311281408:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:1.0:1788872999.946457:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f4936a00 x1875765311281408/t0(4294969491) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788872999.946465:0:8443:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969491, current: 4294969491, replaying 00010000:00000040:1.0:1788872999.946468:0:8443:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:1.0:1788872999.946478:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4936a00 x1875765311281408/t0(4294969491) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.946487:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+18:2403:x1875765311281408:12345-192.168.204.39@tcp:10:dd.0 Request processed in 43us (446us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872999.946494:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1061 00000100:00000040:1.0:1788872999.946497:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:3.0:1788872999.947149:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969491, next_transno: 4294969491 00010000:00080000:3.0:1788872999.947155:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969491) 00010000:00080000:3.0:1788872999.947166:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311281408 t4294969491 from 192.168.204.39@tcp req@ffff98a9f4936a00 x1875765311281408/t0(4294969491) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788872999.947183:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f4936a00 x1875765311281408/t0(4294969491) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788872999.947215:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x390:0x0] 00000001:00000040:3.0:1788872999.947394:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 14 00000020:00000040:3.0:1788872999.947398:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=19 00010000:00000040:3.0:1788872999.947429:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969491, xid 1875765311281408 00000100:00000040:3.0:1788872999.947439:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.947445:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872999.947512:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:3.0:1788872999.947523:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788872999.947530:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:3.0:1788872999.947539:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 18 00010000:00080000:3.0:1788872999.947544:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00010000:00080000:3.0:1788872999.947574:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00000100:00000040:3.0:1788872999.952004:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f4934380 x1875765311282048 msgsize 440 00000100:00100000:3.0:1788872999.952022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872999.952190:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311282048 00000100:00100000:1.0:1788872999.952201:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311282048 00000020:00000040:1.0:1788872999.952204:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:1.0:1788872999.952210:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=19 00000100:00000040:1.0:1788872999.952236:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788872999.952278:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1062 00000100:00000040:1.0:1788872999.952283:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:1.0:1788872999.952303:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f4934380 x1875765311282048/t0(4294969492) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.952316:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f4934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+19:2403:x1875765311282048:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:1.0:1788872999.952327:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f4934380 x1875765311282048/t0(4294969492) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788872999.952336:0:8441:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969492, current: 4294969492, replaying 00010000:00000040:1.0:1788872999.952339:0:8441:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:1.0:1788872999.952354:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f4934380 x1875765311282048/t0(4294969492) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.952362:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f4934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+19:2403:x1875765311282048:12345-192.168.204.39@tcp:10:dd.0 Request processed in 48us (360us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872999.952369:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1062 00000100:00000040:1.0:1788872999.952372:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788872999.952392:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969492, next_transno: 4294969492 00010000:00080000:1.0:1788872999.952396:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969492) 00010000:00080000:1.0:1788872999.952404:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311282048 t4294969492 from 192.168.204.39@tcp req@ffff98a9f4934380 x1875765311282048/t0(4294969492) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788872999.952419:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f4934380 x1875765311282048/t0(4294969492) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788872999.952449:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38f:0x0] 00000001:00000040:1.0:1788872999.958229:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 15 00000020:00000040:1.0:1788872999.958242:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=20 00010000:00000040:1.0:1788872999.958289:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969492, xid 1875765311282048 00000100:00000040:1.0:1788872999.958304:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788872999.958312:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788872999.958384:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788872999.958396:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788872999.958407:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788872999.958420:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 19 00010000:00080000:1.0:1788872999.958426:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00010000:00080000:1.0:1788872999.958431:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00000100:00000040:0.0:1788872999.961838:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5ae680 x1875765311283968 msgsize 440 00000100:00100000:0.0:1788872999.961856:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872999.961955:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311283968 00000100:00100000:1.0:1788872999.961965:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311283968 00000020:00000040:1.0:1788872999.961968:0:24869:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:1.0:1788872999.961972:0:24869:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=20 00000100:00000040:1.0:1788872999.961995:0:24869:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788872999.962043:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1063 00000100:00000040:1.0:1788872999.962048:0:24869:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:1.0:1788872999.962055:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5ae680 x1875765311283968/t0(4294969493) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.962069:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+20:2403:x1875765311283968:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:1.0:1788872999.962080:0:24869:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9df5ae680 x1875765311283968/t0(4294969493) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788872999.962090:0:24869:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969493, current: 4294969493, replaying 00010000:00000040:1.0:1788872999.962093:0:24869:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:1.0:1788872999.962112:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ae680 x1875765311283968/t0(4294969493) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.962121:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+20:2403:x1875765311283968:12345-192.168.204.39@tcp:10:dd.0 Request processed in 54us (284us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872999.962127:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1063 00000100:00000040:1.0:1788872999.962130:0:24869:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:3.0:1788872999.962201:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969493, next_transno: 4294969493 00010000:00080000:3.0:1788872999.962205:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969493) 00010000:00080000:3.0:1788872999.962213:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311283968 t4294969493 from 192.168.204.39@tcp req@ffff98a9df5ae680 x1875765311283968/t0(4294969493) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788872999.962230:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9df5ae680 x1875765311283968/t0(4294969493) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788872999.962261:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x391:0x0] 00000001:00000040:3.0:1788872999.962813:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 16 00000020:00000040:3.0:1788872999.962817:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=21 00010000:00000040:3.0:1788872999.962856:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969493, xid 1875765311283968 00000100:00000040:3.0:1788872999.962868:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.962875:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872999.962932:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:3.0:1788872999.962941:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788872999.962947:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:3.0:1788872999.962957:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 20 00010000:00080000:3.0:1788872999.962961:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00010000:00080000:3.0:1788872999.962965:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00000100:00000040:0.0:1788872999.966145:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5aea00 x1875765311285248 msgsize 440 00000100:00100000:0.0:1788872999.966162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872999.966259:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311285248 00000100:00100000:3.0:1788872999.966279:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311285248 00000020:00000040:3.0:1788872999.966282:0:24866:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788872999.966288:0:24866:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=21 00000100:00000040:3.0:1788872999.966314:0:24866:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788872999.966365:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1064 00000100:00000040:3.0:1788872999.966370:0:24866:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:3.0:1788872999.966378:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5aea00 x1875765311285248/t0(4294969494) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872999.966391:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+21:2403:x1875765311285248:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:3.0:1788872999.966404:0:24866:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9df5aea00 x1875765311285248/t0(4294969494) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788872999.966423:0:24866:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969494, current: 4294969494, replaying 00010000:00000040:3.0:1788872999.966426:0:24866:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:3.0:1788872999.966443:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5aea00 x1875765311285248/t0(4294969494) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872999.966452:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+21:2403:x1875765311285248:12345-192.168.204.39@tcp:10:dd.0 Request processed in 63us (308us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872999.966459:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1064 00000100:00000040:3.0:1788872999.966462:0:24866:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788872999.966490:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969494, next_transno: 4294969494 00010000:00080000:1.0:1788872999.966501:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969494) 00010000:00080000:1.0:1788872999.966509:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311285248 t4294969494 from 192.168.204.39@tcp req@ffff98a9df5aea00 x1875765311285248/t0(4294969494) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788872999.966525:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9df5aea00 x1875765311285248/t0(4294969494) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788872999.966581:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x393:0x0] 00000001:00000040:1.0:1788872999.966815:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 17 00000020:00000040:1.0:1788872999.966819:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=22 00010000:00000040:1.0:1788872999.966856:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969494, xid 1875765311285248 00000100:00000040:1.0:1788872999.966867:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788872999.966872:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788872999.966932:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788872999.966941:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788872999.966946:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788872999.966955:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 21 00010000:00080000:1.0:1788872999.966958:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00010000:00080000:1.0:1788872999.966962:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00000100:00000040:1.0:1788872999.970821:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ee81ea00 x1875765311285376 msgsize 440 00000100:00100000:1.0:1788872999.970839:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872999.970943:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311285376 00000100:00100000:3.0:1788872999.970954:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311285376 00000020:00000040:3.0:1788872999.970957:0:24855:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788872999.970963:0:24855:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=22 00000100:00000040:3.0:1788872999.970989:0:24855:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788872999.971076:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1065 00000100:00000040:3.0:1788872999.971081:0:24855:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:3.0:1788872999.971089:0:24855:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ee81ea00 x1875765311285376/t0(4294969495) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872999.971120:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ee81ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+22:2403:x1875765311285376:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:3.0:1788872999.971133:0:24855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ee81ea00 x1875765311285376/t0(4294969495) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788872999.971141:0:24855:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969495, current: 4294969495, replaying 00010000:00000040:3.0:1788872999.971145:0:24855:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:3.0:1788872999.971162:0:24855:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ee81ea00 x1875765311285376/t0(4294969495) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872999.971172:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ee81ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+22:2403:x1875765311285376:12345-192.168.204.39@tcp:10:dd.0 Request processed in 56us (352us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872999.971180:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1065 00000100:00000040:3.0:1788872999.971183:0:24855:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788872999.971224:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969495, next_transno: 4294969495 00010000:00080000:1.0:1788872999.971229:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969495) 00010000:00080000:1.0:1788872999.971238:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311285376 t4294969495 from 192.168.204.39@tcp req@ffff98a9ee81ea00 x1875765311285376/t0(4294969495) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788872999.971256:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ee81ea00 x1875765311285376/t0(4294969495) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788872999.971287:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x392:0x0] 00000001:00000040:1.0:1788872999.971480:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 18 00000020:00000040:1.0:1788872999.971484:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=23 00010000:00000040:1.0:1788872999.971518:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969495, xid 1875765311285376 00000100:00000040:1.0:1788872999.971527:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788872999.971533:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788872999.971626:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788872999.971635:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788872999.972370:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788872999.972383:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 22 00010000:00080000:1.0:1788872999.972388:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00010000:00080000:1.0:1788872999.972392:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00000100:00000040:3.0:1788872999.977776:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587dc00 x1875765311287168 msgsize 440 00000100:00100000:3.0:1788872999.977793:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788872999.977824:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311287168 00000100:00100000:3.0:1788872999.977834:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311287168 00000020:00000040:3.0:1788872999.977837:0:24856:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788872999.977842:0:24856:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=23 00000100:00000040:3.0:1788872999.977868:0:24856:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788872999.977909:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1066 00000100:00000040:3.0:1788872999.977914:0:24856:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:3.0:1788872999.977933:0:24856:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587dc00 x1875765311287168/t0(4294969496) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872999.977947:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+23:2403:x1875765311287168:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:3.0:1788872999.977959:0:24856:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587dc00 x1875765311287168/t0(4294969496) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788872999.977975:0:24856:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969496, current: 4294969496, replaying 00010000:00000040:3.0:1788872999.977978:0:24856:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:3.0:1788872999.977991:0:24856:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587dc00 x1875765311287168/t0(4294969496) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788872999.978000:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+23:2403:x1875765311287168:12345-192.168.204.39@tcp:10:dd.0 Request processed in 55us (224us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788872999.978008:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1066 00000100:00000040:3.0:1788872999.978011:0:24856:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:3.0:1788872999.978031:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969496, next_transno: 4294969496 00010000:00080000:3.0:1788872999.978035:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969496) 00010000:00080000:3.0:1788872999.978042:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311287168 t4294969496 from 192.168.204.39@tcp req@ffff98a9f587dc00 x1875765311287168/t0(4294969496) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788872999.978056:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587dc00 x1875765311287168/t0(4294969496) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788872999.978084:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x394:0x0] 00000001:00000040:3.0:1788872999.978250:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 19 00000020:00000040:3.0:1788872999.978254:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=24 00010000:00000040:3.0:1788872999.978288:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969496, xid 1875765311287168 00000100:00000040:3.0:1788872999.978299:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.978305:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872999.978345:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:3.0:1788872999.978353:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788872999.978358:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:3.0:1788872999.978367:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 23 00010000:00080000:3.0:1788872999.978371:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00010000:00080000:3.0:1788872999.978375:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00000100:00000040:3.0:1788872999.980295:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587d180 x1875765311287680 msgsize 440 00000100:00100000:3.0:1788872999.980312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788872999.980391:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311287680 00000100:00100000:0.0:1788872999.980400:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311287680 00000020:00000040:0.0:1788872999.980403:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788872999.980407:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=24 00000100:00000040:0.0:1788872999.980428:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788872999.980472:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1067 00000100:00000040:0.0:1788872999.980476:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788872999.980484:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587d180 x1875765311287680/t0(4294969497) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872999.980497:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+24:2403:x1875765311287680:12345-192.168.204.39@tcp:10:dd.0 00000020:00000040:0.0:1788872999.980508:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587d180 x1875765311287680/t0(4294969497) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788872999.980518:0:8443:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969497, current: 4294969497, replaying 00010000:00000040:0.0:1788872999.980521:0:8443:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788872999.980539:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587d180 x1875765311287680/t0(4294969497) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788872999.980579:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+24:2403:x1875765311287680:12345-192.168.204.39@tcp:10:dd.0 Request processed in 53us (255us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788872999.980599:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1067 00000100:00000040:0.0:1788872999.980601:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:3.0:1788872999.980682:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969497, next_transno: 4294969497 00010000:00080000:3.0:1788872999.980686:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969497) 00010000:00080000:3.0:1788872999.980693:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311287680 t4294969497 from 192.168.204.39@tcp req@ffff98a9f587d180 x1875765311287680/t0(4294969497) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788872999.980709:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587d180 x1875765311287680/t0(4294969497) o10->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 440/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788872999.980737:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x395:0x0] 00000001:00000040:3.0:1788872999.980893:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 20 00000020:00000040:3.0:1788872999.980897:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=25 00010000:00000040:3.0:1788872999.980942:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969497, xid 1875765311287680 00000100:00000040:3.0:1788872999.980953:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788872999.980959:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788872999.981004:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:3.0:1788872999.981012:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788872999.981016:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:3.0:1788872999.981025:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 24 00010000:00080000:3.0:1788872999.981028:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00010000:00080000:3.0:1788872999.981032:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00000100:00000040:3.0:1788872999.987990:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587f100 x1875765311288064 msgsize 1512 00000100:00100000:3.0:1788872999.988011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788872999.988113:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311288064 00000100:00100000:1.0:1788872999.988123:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311288064 00000020:00000040:1.0:1788872999.988126:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:1.0:1788872999.988131:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=25 00000100:00000040:1.0:1788872999.988154:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788872999.988205:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1068 00000100:00000040:1.0:1788872999.988210:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:1.0:1788872999.988217:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587f100 x1875765311288064/t0(4294969498) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 1512/0 e 0 to 0 dl 1788873010 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.988229:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2403:x1875765311288064:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:1.0:1788872999.988241:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587f100 x1875765311288064/t0(4294969498) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 1512/0 e 0 to 0 dl 1788873010 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788872999.988250:0:8441:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969498, current: 4294969498, replaying 00010000:00000040:1.0:1788872999.988254:0:8441:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:1.0:1788872999.988275:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587f100 x1875765311288064/t0(4294969498) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 1512/0 e 0 to 0 dl 1788873010 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788872999.988296:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+25:2403:x1875765311288064:12345-192.168.204.39@tcp:4:dd.0 Request processed in 69us (308us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788872999.988304:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1068 00000100:00000040:1.0:1788872999.988308:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:2.0:1788872999.988357:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969498, next_transno: 4294969498 00010000:00080000:2.0:1788872999.988361:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969498) 00010000:00080000:2.0:1788872999.988369:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311288064 t4294969498 from 192.168.204.39@tcp req@ffff98a9f587f100 x1875765311288064/t0(4294969498) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 1512/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788872999.988387:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587f100 x1875765311288064/t0(4294969498) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:170/0 lens 1512/0 e 0 to 0 dl 1788873010 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1788872999.988428:0:96965:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:2.0:1788872999.988543:0:96965:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:2.0:1788872999.988650:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788872999.988683:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:2.0:1788872999.988687:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1788872999.989007:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 21 00000020:00000040:2.0:1788872999.989016:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=26 00010000:00000040:2.0:1788872999.990681:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969498, xid 1875765311288064 00000100:00000040:2.0:1788872999.990702:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:2.0:1788872999.990711:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:2.0:1788872999.990758:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:2.0:1788872999.990772:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788872999.990781:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:2.0:1788872999.990794:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 25 00010000:00080000:2.0:1788872999.990799:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00010000:00080000:2.0:1788872999.990804:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00000100:00000040:0.0:1788873000.007434:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5ad180 x1875765311288320 msgsize 1512 00000100:00100000:0.0:1788873000.007452:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788873000.007643:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311288320 00000100:00100000:0.0:1788873000.007655:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311288320 00000020:00000040:0.0:1788873000.007659:0:24869:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788873000.007664:0:24869:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=26 00000100:00000040:0.0:1788873000.007688:0:24869:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788873000.007749:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1069 00000100:00000040:0.0:1788873000.007754:0:24869:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788873000.007761:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5ad180 x1875765311288320/t0(4294969499) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.007775:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+26:2403:x1875765311288320:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:0.0:1788873000.007786:0:24869:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9df5ad180 x1875765311288320/t0(4294969499) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788873000.007797:0:24869:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969499, current: 4294969499, replaying 00010000:00000040:0.0:1788873000.007801:0:24869:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788873000.007813:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ad180 x1875765311288320/t0(4294969499) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.007821:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+26:2403:x1875765311288320:12345-192.168.204.39@tcp:4:dd.0 Request processed in 50us (389us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788873000.007828:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1069 00000100:00000040:0.0:1788873000.007831:0:24869:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:0.0:1788873000.007846:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969499, next_transno: 4294969499 00010000:00080000:0.0:1788873000.007860:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969499) 00010000:00080000:0.0:1788873000.007868:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311288320 t4294969499 from 192.168.204.39@tcp req@ffff98a9df5ad180 x1875765311288320/t0(4294969499) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788873000.007884:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9df5ad180 x1875765311288320/t0(4294969499) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788873000.007993:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1788873000.008025:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:0.0:1788873000.008029:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1788873000.008309:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 22 00000020:00000040:0.0:1788873000.008314:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=27 00010000:00000040:0.0:1788873000.009010:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969499, xid 1875765311288320 00000100:00000040:0.0:1788873000.009024:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:0.0:1788873000.009031:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788873000.009111:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:0.0:1788873000.009121:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788873000.009127:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:0.0:1788873000.009137:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 26 00010000:00080000:0.0:1788873000.009142:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969500 00010000:00080000:0.0:1788873000.009145:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969500 00000100:00000040:3.0:1788873000.017472:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587e300 x1875765311288576 msgsize 1512 00000100:00100000:3.0:1788873000.017493:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788873000.017691:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311288576 00000100:00100000:0.0:1788873000.017703:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311288576 00000020:00000040:0.0:1788873000.017706:0:24866:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788873000.017769:0:24866:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=27 00000100:00000040:0.0:1788873000.017797:0:24866:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788873000.017852:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1070 00000100:00000040:0.0:1788873000.017857:0:24866:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788873000.017865:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587e300 x1875765311288576/t0(4294969500) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.017898:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2403:x1875765311288576:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:0.0:1788873000.017912:0:24866:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587e300 x1875765311288576/t0(4294969500) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788873000.017933:0:24866:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969500, current: 4294969500, replaying 00010000:00000040:0.0:1788873000.017937:0:24866:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788873000.018186:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587e300 x1875765311288576/t0(4294969500) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.018195:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+27:2403:x1875765311288576:12345-192.168.204.39@tcp:4:dd.0 Request processed in 301us (726us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788873000.018203:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1070 00000100:00000040:0.0:1788873000.018206:0:24866:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788873000.018250:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969500, next_transno: 4294969500 00010000:00080000:1.0:1788873000.018256:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969500) 00010000:00080000:1.0:1788873000.018266:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311288576 t4294969500 from 192.168.204.39@tcp req@ffff98a9f587e300 x1875765311288576/t0(4294969500) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.018284:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587e300 x1875765311288576/t0(4294969500) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.018404:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788873000.018435:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:1.0:1788873000.018439:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000020:00000040:1.0:1788873000.018453:0:96965:0:(tgt_handler.c:2952:tgt_brw_write()) Checksum 1024 from 12345-192.168.204.39@tcp OK: ba658f91 00000001:00000040:1.0:1788873000.019353:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 23 00000020:00000040:1.0:1788873000.019360:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=28 00010000:00000040:1.0:1788873000.019753:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969500, xid 1875765311288576 00000100:00000040:1.0:1788873000.019768:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788873000.019775:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788873000.019835:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788873000.019847:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788873000.019858:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788873000.019872:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 27 00010000:00080000:1.0:1788873000.019878:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969501 00010000:00080000:1.0:1788873000.019881:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969501 00000100:00000040:3.0:1788873000.022484:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587d500 x1875765311288832 msgsize 1512 00000100:00100000:3.0:1788873000.022503:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788873000.023279:0:25437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311288832 00000100:00100000:0.0:1788873000.023292:0:25437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311288832 00000020:00000040:0.0:1788873000.023296:0:25437:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788873000.023302:0:25437:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=28 00000100:00000040:0.0:1788873000.023332:0:25437:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788873000.023424:0:25437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1071 00000100:00000040:0.0:1788873000.023429:0:25437:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788873000.023437:0:25437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587d500 x1875765311288832/t0(4294969501) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.023451:0:25437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+28:2403:x1875765311288832:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:0.0:1788873000.023462:0:25437:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587d500 x1875765311288832/t0(4294969501) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788873000.023471:0:25437:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969501, current: 4294969501, replaying 00010000:00000040:0.0:1788873000.023487:0:25437:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788873000.023507:0:25437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587d500 x1875765311288832/t0(4294969501) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.023515:0:25437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+28:2403:x1875765311288832:12345-192.168.204.39@tcp:4:dd.0 Request processed in 67us (1032us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788873000.023521:0:25437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1071 00000100:00000040:0.0:1788873000.023524:0:25437:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788873000.023593:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969501, next_transno: 4294969501 00010000:00080000:1.0:1788873000.023603:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969501) 00010000:00080000:1.0:1788873000.023611:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311288832 t4294969501 from 192.168.204.39@tcp req@ffff98a9f587d500 x1875765311288832/t0(4294969501) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.023626:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587d500 x1875765311288832/t0(4294969501) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.023751:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788873000.023782:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:1.0:1788873000.023786:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1788873000.024036:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 24 00000020:00000040:1.0:1788873000.024040:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=29 00010000:00000040:1.0:1788873000.024844:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969501, xid 1875765311288832 00000100:00000040:1.0:1788873000.024858:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788873000.024865:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788873000.024933:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788873000.024945:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788873000.024953:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788873000.024965:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 28 00010000:00080000:1.0:1788873000.024970:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969502 00010000:00080000:1.0:1788873000.024974:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969502 00000100:00000040:0.0:1788873000.027262:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df5ace00 x1875765311289088 msgsize 1512 00000100:00100000:0.0:1788873000.027277:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788873000.027357:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311289088 00000100:00100000:3.0:1788873000.027381:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311289088 00000020:00000040:3.0:1788873000.027385:0:24856:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.027390:0:24856:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=29 00000100:00000040:3.0:1788873000.027427:0:24856:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788873000.027475:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1072 00000100:00000040:3.0:1788873000.027479:0:24856:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:3.0:1788873000.027487:0:24856:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df5ace00 x1875765311289088/t0(4294969502) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788873000.027501:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+29:2403:x1875765311289088:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:3.0:1788873000.027512:0:24856:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9df5ace00 x1875765311289088/t0(4294969502) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788873000.027522:0:24856:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969502, current: 4294969502, replaying 00010000:00000040:3.0:1788873000.027526:0:24856:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:3.0:1788873000.027544:0:24856:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df5ace00 x1875765311289088/t0(4294969502) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788873000.027624:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969502, next_transno: 4294969502 00010000:00080000:0.0:1788873000.027628:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969502) 00010000:00080000:0.0:1788873000.027636:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311289088 t4294969502 from 192.168.204.39@tcp req@ffff98a9df5ace00 x1875765311289088/t0(4294969502) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788873000.027652:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9df5ace00 x1875765311289088/t0(4294969502) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788873000.027761:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1788873000.027791:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:0.0:1788873000.027795:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1788873000.028070:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 25 00000020:00000040:0.0:1788873000.028076:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=30 00000100:00100000:3.0:1788873000.028277:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+30:2403:x1875765311289088:12345-192.168.204.39@tcp:4:dd.0 Request processed in 776us (1013us total) trans 4294969502 rc 0/0 00000100:00100000:3.0:1788873000.028286:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1072 00000100:00000040:3.0:1788873000.028289:0:24856:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00000040:0.0:1788873000.028740:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969502, xid 1875765311289088 00000100:00000040:0.0:1788873000.028753:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:0.0:1788873000.028760:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788873000.028848:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:0.0:1788873000.028859:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788873000.028866:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:0.0:1788873000.028876:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 29 00010000:00080000:0.0:1788873000.028889:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969503 00010000:00080000:0.0:1788873000.028893:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969503 00000100:00000040:2.0:1788873000.032075:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ff53d180 x1875765311289344 msgsize 1512 00000100:00100000:2.0:1788873000.032097:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788873000.032190:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311289344 00000100:00100000:0.0:1788873000.032202:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311289344 00000020:00000040:0.0:1788873000.032205:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788873000.032210:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=30 00000100:00000040:0.0:1788873000.032239:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788873000.032291:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1073 00000100:00000040:0.0:1788873000.032296:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788873000.032303:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ff53d180 x1875765311289344/t0(4294969503) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.032316:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+30:2403:x1875765311289344:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:0.0:1788873000.032330:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53d180 x1875765311289344/t0(4294969503) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788873000.032339:0:8443:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969503, current: 4294969503, replaying 00010000:00000040:0.0:1788873000.032342:0:8443:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788873000.032362:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53d180 x1875765311289344/t0(4294969503) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.032372:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+30:2403:x1875765311289344:12345-192.168.204.39@tcp:4:dd.0 Request processed in 59us (298us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788873000.032379:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1073 00000100:00000040:0.0:1788873000.032382:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788873000.032444:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969503, next_transno: 4294969503 00010000:00080000:1.0:1788873000.032448:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969503) 00010000:00080000:1.0:1788873000.032456:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311289344 t4294969503 from 192.168.204.39@tcp req@ffff98a9ff53d180 x1875765311289344/t0(4294969503) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.032472:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53d180 x1875765311289344/t0(4294969503) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.032615:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788873000.032652:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:1.0:1788873000.032662:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1788873000.032934:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 26 00000020:00000040:1.0:1788873000.032939:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=31 00010000:00000040:1.0:1788873000.033373:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969503, xid 1875765311289344 00000100:00000040:1.0:1788873000.033388:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788873000.033394:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788873000.033444:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788873000.033454:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788873000.033461:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788873000.033473:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 30 00010000:00080000:1.0:1788873000.033478:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969504 00010000:00080000:1.0:1788873000.033482:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969504 00000100:00000040:3.0:1788873000.036138:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587c000 x1875765311289600 msgsize 1512 00000100:00100000:3.0:1788873000.036153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873000.036248:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311289600 00000100:00100000:2.0:1788873000.036257:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311289600 00000020:00000040:2.0:1788873000.036261:0:24865:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:2.0:1788873000.036267:0:24865:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=31 00000100:00000040:2.0:1788873000.036291:0:24865:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788873000.036346:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1074 00000100:00000040:2.0:1788873000.036351:0:24865:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:2.0:1788873000.036359:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587c000 x1875765311289600/t0(4294969504) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788873000.036372:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+31:2403:x1875765311289600:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:2.0:1788873000.036383:0:24865:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587c000 x1875765311289600/t0(4294969504) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788873000.036392:0:24865:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969504, current: 4294969504, replaying 00010000:00000040:2.0:1788873000.036396:0:24865:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:2.0:1788873000.036415:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587c000 x1875765311289600/t0(4294969504) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788873000.036443:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+31:2403:x1875765311289600:12345-192.168.204.39@tcp:4:dd.0 Request processed in 73us (306us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788873000.036450:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1074 00000100:00000040:2.0:1788873000.036453:0:24865:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:0.0:1788873000.036580:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969504, next_transno: 4294969504 00010000:00080000:0.0:1788873000.036585:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969504) 00010000:00080000:0.0:1788873000.036593:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311289600 t4294969504 from 192.168.204.39@tcp req@ffff98a9f587c000 x1875765311289600/t0(4294969504) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788873000.036622:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587c000 x1875765311289600/t0(4294969504) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788873000.036721:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1788873000.036751:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:0.0:1788873000.036755:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1788873000.037014:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 27 00000020:00000040:0.0:1788873000.037019:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=32 00010000:00000040:0.0:1788873000.037388:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969504, xid 1875765311289600 00000100:00000040:0.0:1788873000.037401:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:0.0:1788873000.037475:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788873000.040213:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1ce00 x1875765311289856 msgsize 1512 00000100:00100000:1.0:1788873000.040229:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:0.0:1788873000.040365:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:0.0:1788873000.040384:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00000100:00100000:3.0:1788873000.040444:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311289856 00000100:00100000:3.0:1788873000.040453:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311289856 00000020:00000040:3.0:1788873000.040455:0:24869:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.040460:0:24869:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=33 00010000:00000040:1.0:1788873000.040500:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788873000.040512:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 32 00010000:00080000:1.0:1788873000.040518:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969505 00010000:00080000:1.0:1788873000.040522:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969505 00000100:00100000:3.0:1788873000.040524:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1075 00000100:00000040:3.0:1788873000.040529:0:24869:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:3.0:1788873000.040576:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1ce00 x1875765311289856/t0(4294969505) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788873000.040592:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+32:2403:x1875765311289856:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:3.0:1788873000.040604:0:24869:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f5c1ce00 x1875765311289856/t0(4294969505) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788873000.040612:0:24869:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969505, current: 4294969505, replaying 00010000:00000040:3.0:1788873000.040615:0:24869:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:3.0:1788873000.040622:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1ce00 x1875765311289856/t0(4294969505) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788873000.040631:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+32:2403:x1875765311289856:12345-192.168.204.39@tcp:4:dd.0 Request processed in 43us (419us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873000.040637:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1075 00000100:00000040:3.0:1788873000.040640:0:24869:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788873000.040805:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969505, next_transno: 4294969505 00010000:00080000:1.0:1788873000.040809:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969505) 00010000:00080000:1.0:1788873000.040816:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311289856 t4294969505 from 192.168.204.39@tcp req@ffff98a9f5c1ce00 x1875765311289856/t0(4294969505) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.040831:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f5c1ce00 x1875765311289856/t0(4294969505) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.040932:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788873000.040961:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:1.0:1788873000.040964:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1788873000.041208:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 28 00000020:00000040:1.0:1788873000.041212:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=33 00010000:00000040:1.0:1788873000.041830:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969505, xid 1875765311289856 00000100:00000040:1.0:1788873000.041844:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788873000.041851:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788873000.041902:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788873000.041910:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788873000.041916:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788873000.041936:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 32 00010000:00080000:1.0:1788873000.041941:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969506 00010000:00080000:1.0:1788873000.041945:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969506 00000100:00000040:1.0:1788873000.044512:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1d180 x1875765311290112 msgsize 1512 00000100:00100000:1.0:1788873000.044534:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873000.045345:0:24867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311290112 00000100:00100000:2.0:1788873000.045359:0:24867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311290112 00000020:00000040:2.0:1788873000.045362:0:24867:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:2.0:1788873000.045368:0:24867:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=33 00000100:00000040:2.0:1788873000.045397:0:24867:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788873000.045843:0:24867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1076 00000100:00000040:2.0:1788873000.045849:0:24867:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:2.0:1788873000.045858:0:24867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1d180 x1875765311290112/t0(4294969506) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788873000.045874:0:24867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+33:2403:x1875765311290112:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:2.0:1788873000.045886:0:24867:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f5c1d180 x1875765311290112/t0(4294969506) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788873000.045896:0:24867:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969506, current: 4294969506, replaying 00010000:00000040:2.0:1788873000.045900:0:24867:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:2.0:1788873000.045930:0:24867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1d180 x1875765311290112/t0(4294969506) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788873000.045940:0:24867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0804304d-5904-48ad-87f2-bcbc7642a62a+33:2403:x1875765311290112:12345-192.168.204.39@tcp:4:dd.0 Request processed in 69us (1429us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788873000.045947:0:24867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1076 00000100:00000040:2.0:1788873000.045950:0:24867:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788873000.046041:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969506, next_transno: 4294969506 00010000:00080000:1.0:1788873000.046045:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969506) 00010000:00080000:1.0:1788873000.046054:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311290112 t4294969506 from 192.168.204.39@tcp req@ffff98a9f5c1d180 x1875765311290112/t0(4294969506) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.046070:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f5c1d180 x1875765311290112/t0(4294969506) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.046183:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788873000.046223:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:1.0:1788873000.046227:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1788873000.046939:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 29 00000020:00000040:1.0:1788873000.046945:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=34 00010000:00000040:1.0:1788873000.046982:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969506, xid 1875765311290112 00000100:00000040:1.0:1788873000.046995:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788873000.047002:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788873000.047062:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788873000.047081:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788873000.047087:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788873000.047099:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 33 00010000:00080000:1.0:1788873000.047104:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969507 00010000:00080000:1.0:1788873000.047109:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969507 00000100:00000040:3.0:1788873000.049815:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587ed80 x1875765311290368 msgsize 1512 00000100:00100000:3.0:1788873000.049831:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788873000.050017:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311290368 00000100:00100000:0.0:1788873000.050029:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311290368 00000020:00000040:0.0:1788873000.050033:0:24855:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788873000.050038:0:24855:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=34 00000100:00000040:0.0:1788873000.050066:0:24855:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788873000.050117:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1077 00000100:00000040:0.0:1788873000.050122:0:24855:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788873000.050129:0:24855:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587ed80 x1875765311290368/t0(4294969507) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.050142:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+34:2403:x1875765311290368:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:0.0:1788873000.050154:0:24855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587ed80 x1875765311290368/t0(4294969507) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788873000.050163:0:24855:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969507, current: 4294969507, replaying 00010000:00000040:0.0:1788873000.050166:0:24855:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788873000.050203:0:24855:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587ed80 x1875765311290368/t0(4294969507) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.050213:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+34:2403:x1875765311290368:12345-192.168.204.39@tcp:4:dd.0 Request processed in 73us (399us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788873000.050221:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1077 00000100:00000040:0.0:1788873000.050225:0:24855:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788873000.050842:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969507, next_transno: 4294969507 00010000:00080000:1.0:1788873000.050847:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969507) 00010000:00080000:1.0:1788873000.050856:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311290368 t4294969507 from 192.168.204.39@tcp req@ffff98a9f587ed80 x1875765311290368/t0(4294969507) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.050874:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587ed80 x1875765311290368/t0(4294969507) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.050987:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788873000.051020:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:1.0:1788873000.051023:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1788873000.051271:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 30 00000020:00000040:1.0:1788873000.051275:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=35 00010000:00000040:1.0:1788873000.051858:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969507, xid 1875765311290368 00000100:00000040:1.0:1788873000.051871:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788873000.051877:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788873000.051946:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788873000.051958:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788873000.051967:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788873000.051979:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 34 00010000:00080000:1.0:1788873000.051985:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969508 00010000:00080000:1.0:1788873000.051988:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969508 00000100:00000040:2.0:1788873000.054257:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ff53ca80 x1875765311290624 msgsize 1512 00000100:00100000:2.0:1788873000.054282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788873000.054368:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311290624 00000100:00100000:3.0:1788873000.054378:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311290624 00000020:00000040:3.0:1788873000.054381:0:24856:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.054386:0:24856:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=35 00000100:00000040:3.0:1788873000.054421:0:24856:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788873000.054467:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1078 00000100:00000040:3.0:1788873000.054471:0:24856:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:3.0:1788873000.054478:0:24856:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ff53ca80 x1875765311290624/t0(4294969508) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788873000.054492:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+35:2403:x1875765311290624:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:3.0:1788873000.054513:0:24856:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53ca80 x1875765311290624/t0(4294969508) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788873000.054522:0:24856:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969508, current: 4294969508, replaying 00010000:00000040:3.0:1788873000.054525:0:24856:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:3.0:1788873000.054576:0:24856:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53ca80 x1875765311290624/t0(4294969508) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788873000.054586:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+35:2403:x1875765311290624:12345-192.168.204.39@tcp:4:dd.0 Request processed in 96us (330us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873000.054594:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1078 00000100:00000040:3.0:1788873000.054597:0:24856:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:2.0:1788873000.054782:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969508, next_transno: 4294969508 00010000:00080000:2.0:1788873000.054787:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969508) 00010000:00080000:2.0:1788873000.054795:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311290624 t4294969508 from 192.168.204.39@tcp req@ffff98a9ff53ca80 x1875765311290624/t0(4294969508) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788873000.054812:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53ca80 x1875765311290624/t0(4294969508) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788873000.054932:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788873000.054962:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:2.0:1788873000.054965:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1788873000.055206:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 31 00000020:00000040:2.0:1788873000.055211:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=36 00010000:00000040:2.0:1788873000.055582:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969508, xid 1875765311290624 00000100:00000040:2.0:1788873000.055597:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:2.0:1788873000.055604:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:2.0:1788873000.055661:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:2.0:1788873000.055671:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788873000.055793:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:2.0:1788873000.055804:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 35 00010000:00080000:2.0:1788873000.055809:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969509 00010000:00080000:2.0:1788873000.055813:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969509 00000100:00000040:0.0:1788873000.065649:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c4d14380 x1875765311290880 msgsize 1512 00000100:00100000:0.0:1788873000.065666:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873000.066059:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311290880 00000100:00100000:2.0:1788873000.066071:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311290880 00000020:00000040:2.0:1788873000.066075:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:2.0:1788873000.066080:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=36 00000100:00000040:2.0:1788873000.066105:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788873000.066159:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1079 00000100:00000040:2.0:1788873000.066164:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:2.0:1788873000.066172:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c4d14380 x1875765311290880/t0(4294969509) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788873000.066199:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+36:2403:x1875765311290880:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:2.0:1788873000.066212:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a8c4d14380 x1875765311290880/t0(4294969509) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788873000.066221:0:8443:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969509, current: 4294969509, replaying 00010000:00000040:2.0:1788873000.066225:0:8443:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:2.0:1788873000.066245:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c4d14380 x1875765311290880/t0(4294969509) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788873000.066254:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+36:2403:x1875765311290880:12345-192.168.204.39@tcp:4:dd.0 Request processed in 58us (606us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788873000.066261:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1079 00000100:00000040:2.0:1788873000.066264:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:0.0:1788873000.066321:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969509, next_transno: 4294969509 00010000:00080000:0.0:1788873000.066326:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969509) 00010000:00080000:0.0:1788873000.066334:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311290880 t4294969509 from 192.168.204.39@tcp req@ffff98a8c4d14380 x1875765311290880/t0(4294969509) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788873000.066349:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a8c4d14380 x1875765311290880/t0(4294969509) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788873000.066459:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1788873000.066494:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:0.0:1788873000.066497:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1788873000.066776:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 32 00000020:00000040:0.0:1788873000.066780:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=37 00010000:00000040:0.0:1788873000.067544:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969509, xid 1875765311290880 00000100:00000040:0.0:1788873000.067591:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:0.0:1788873000.067598:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788873000.067643:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:0.0:1788873000.067654:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788873000.067662:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:0.0:1788873000.067674:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 36 00010000:00080000:0.0:1788873000.067679:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969510 00010000:00080000:0.0:1788873000.067692:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969510 00000100:00000040:3.0:1788873000.072833:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587ea00 x1875765311291136 msgsize 1512 00000100:00100000:3.0:1788873000.072851:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873000.072963:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311291136 00000100:00100000:2.0:1788873000.072974:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311291136 00000020:00000040:2.0:1788873000.072977:0:24865:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:2.0:1788873000.072983:0:24865:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=37 00000100:00000040:2.0:1788873000.073013:0:24865:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788873000.073073:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1080 00000100:00000040:2.0:1788873000.073078:0:24865:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:2.0:1788873000.073086:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587ea00 x1875765311291136/t0(4294969510) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788873000.073099:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+37:2403:x1875765311291136:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:2.0:1788873000.073112:0:24865:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587ea00 x1875765311291136/t0(4294969510) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788873000.073122:0:24865:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969510, current: 4294969510, replaying 00010000:00000040:2.0:1788873000.073133:0:24865:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:2.0:1788873000.073149:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587ea00 x1875765311291136/t0(4294969510) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788873000.073157:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+37:2403:x1875765311291136:12345-192.168.204.39@tcp:4:dd.0 Request processed in 60us (325us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788873000.073164:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1080 00000100:00000040:2.0:1788873000.073168:0:24865:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:0.0:1788873000.073252:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969510, next_transno: 4294969510 00010000:00080000:0.0:1788873000.073257:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969510) 00010000:00080000:0.0:1788873000.073266:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311291136 t4294969510 from 192.168.204.39@tcp req@ffff98a9f587ea00 x1875765311291136/t0(4294969510) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788873000.073283:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587ea00 x1875765311291136/t0(4294969510) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788873000.073383:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1788873000.073425:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:0.0:1788873000.073428:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1788873000.073781:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 33 00000020:00000040:0.0:1788873000.073786:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=38 00010000:00000040:0.0:1788873000.075057:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969510, xid 1875765311291136 00000100:00000040:0.0:1788873000.075076:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:0.0:1788873000.075084:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788873000.075150:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:0.0:1788873000.075162:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788873000.075171:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:0.0:1788873000.075184:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 37 00010000:00080000:0.0:1788873000.075191:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969511 00010000:00080000:0.0:1788873000.075195:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969511 00000100:00000040:1.0:1788873000.085447:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f5c1d880 x1875765311291392 msgsize 1512 00000100:00100000:1.0:1788873000.085461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788873000.085649:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311291392 00000100:00100000:3.0:1788873000.085659:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311291392 00000020:00000040:3.0:1788873000.085663:0:24869:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.085667:0:24869:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=38 00000100:00000040:3.0:1788873000.085694:0:24869:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788873000.085753:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1081 00000100:00000040:3.0:1788873000.085758:0:24869:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:3.0:1788873000.085765:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f5c1d880 x1875765311291392/t0(4294969511) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788873000.085777:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+38:2403:x1875765311291392:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:3.0:1788873000.085788:0:24869:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f5c1d880 x1875765311291392/t0(4294969511) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788873000.085796:0:24869:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969511, current: 4294969511, replaying 00010000:00000040:3.0:1788873000.085805:0:24869:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:3.0:1788873000.085819:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f5c1d880 x1875765311291392/t0(4294969511) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788873000.085826:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+38:2403:x1875765311291392:12345-192.168.204.39@tcp:4:dd.0 Request processed in 51us (381us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873000.085833:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1081 00000100:00000040:3.0:1788873000.085836:0:24869:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:0.0:1788873000.086739:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969511, next_transno: 4294969511 00010000:00080000:0.0:1788873000.086746:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969511) 00010000:00080000:0.0:1788873000.086758:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311291392 t4294969511 from 192.168.204.39@tcp req@ffff98a9f5c1d880 x1875765311291392/t0(4294969511) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788873000.086776:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f5c1d880 x1875765311291392/t0(4294969511) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788873000.086881:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1788873000.086910:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:0.0:1788873000.086913:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1788873000.087166:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 34 00000020:00000040:0.0:1788873000.087171:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=39 00010000:00000040:0.0:1788873000.087801:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969511, xid 1875765311291392 00000100:00000040:0.0:1788873000.087816:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:0.0:1788873000.087823:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:0.0:1788873000.087933:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:0.0:1788873000.087943:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788873000.087951:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:0.0:1788873000.087961:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 38 00010000:00080000:0.0:1788873000.087966:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969512 00010000:00080000:0.0:1788873000.087970:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969512 00000100:00000040:2.0:1788873000.101449:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ff53c000 x1875765311291648 msgsize 1512 00000100:00100000:2.0:1788873000.101464:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788873000.101533:0:24866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311291648 00000100:00100000:0.0:1788873000.101545:0:24866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311291648 00000020:00000040:0.0:1788873000.101914:0:24866:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788873000.101935:0:24866:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=39 00000100:00000040:0.0:1788873000.101964:0:24866:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788873000.102013:0:24866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1082 00000100:00000040:0.0:1788873000.102019:0:24866:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788873000.102028:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ff53c000 x1875765311291648/t0(4294969512) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.102042:0:24866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+39:2403:x1875765311291648:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:0.0:1788873000.102058:0:24866:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53c000 x1875765311291648/t0(4294969512) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788873000.102070:0:24866:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969512, current: 4294969512, replaying 00010000:00000040:0.0:1788873000.102083:0:24866:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788873000.102144:0:24866:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53c000 x1875765311291648/t0(4294969512) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.102155:0:24866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+39:2403:x1875765311291648:12345-192.168.204.39@tcp:4:dd.0 Request processed in 115us (707us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788873000.102163:0:24866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1082 00000100:00000040:0.0:1788873000.102166:0:24866:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788873000.105838:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969512, next_transno: 4294969512 00010000:00080000:1.0:1788873000.105848:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969512) 00010000:00080000:1.0:1788873000.105867:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311291648 t4294969512 from 192.168.204.39@tcp req@ffff98a9ff53c000 x1875765311291648/t0(4294969512) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.105892:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53c000 x1875765311291648/t0(4294969512) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.106006:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788873000.106037:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:1.0:1788873000.106040:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1788873000.106470:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 35 00000020:00000040:1.0:1788873000.106476:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=40 00010000:00000040:1.0:1788873000.106769:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969512, xid 1875765311291648 00000100:00000040:1.0:1788873000.106782:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788873000.106788:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788873000.106848:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788873000.106860:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788873000.106868:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788873000.106880:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 39 00010000:00080000:1.0:1788873000.106885:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969513 00010000:00080000:1.0:1788873000.106889:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969513 00000100:00000040:3.0:1788873000.109217:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587f480 x1875765311291904 msgsize 1512 00000100:00100000:3.0:1788873000.109231:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:1.0:1788873000.109687:0:24855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311291904 00000100:00100000:1.0:1788873000.109707:0:24855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311291904 00000020:00000040:1.0:1788873000.109711:0:24855:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:1.0:1788873000.109715:0:24855:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=40 00000100:00000040:1.0:1788873000.109743:0:24855:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788873000.109794:0:24855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1083 00000100:00000040:1.0:1788873000.109798:0:24855:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:1.0:1788873000.109806:0:24855:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587f480 x1875765311291904/t0(4294969513) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788873000.109838:0:24855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+40:2403:x1875765311291904:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:1.0:1788873000.109849:0:24855:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587f480 x1875765311291904/t0(4294969513) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788873000.109858:0:24855:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969513, current: 4294969513, replaying 00010000:00000040:1.0:1788873000.109861:0:24855:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:1.0:1788873000.109875:0:24855:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587f480 x1875765311291904/t0(4294969513) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788873000.109884:0:24855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+40:2403:x1875765311291904:12345-192.168.204.39@tcp:4:dd.0 Request processed in 49us (668us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788873000.109890:0:24855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1083 00000100:00000040:1.0:1788873000.109894:0:24855:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:1.0:1788873000.109909:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969513, next_transno: 4294969513 00010000:00080000:1.0:1788873000.109913:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969513) 00010000:00080000:1.0:1788873000.109931:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311291904 t4294969513 from 192.168.204.39@tcp req@ffff98a9f587f480 x1875765311291904/t0(4294969513) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.109946:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587f480 x1875765311291904/t0(4294969513) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788873000.110040:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788873000.110069:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:1.0:1788873000.110072:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1788873000.110314:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 36 00000020:00000040:1.0:1788873000.110319:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=41 00010000:00000040:1.0:1788873000.110772:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969513, xid 1875765311291904 00000100:00000040:1.0:1788873000.110786:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:1.0:1788873000.110803:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:1.0:1788873000.110891:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:1.0:1788873000.110902:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788873000.110909:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:1.0:1788873000.110927:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 40 00010000:00080000:1.0:1788873000.110932:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969514 00010000:00080000:1.0:1788873000.110936:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969514 00000100:00000040:3.0:1788873000.116494:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587e680 x1875765311292160 msgsize 1512 00000100:00100000:3.0:1788873000.116512:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873000.120605:0:24856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311292160 00000100:00100000:2.0:1788873000.120619:0:24856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311292160 00000020:00000040:2.0:1788873000.120622:0:24856:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:2.0:1788873000.120628:0:24856:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=41 00000100:00000040:2.0:1788873000.120656:0:24856:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788873000.120717:0:24856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1084 00000100:00000040:2.0:1788873000.120722:0:24856:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:2.0:1788873000.120729:0:24856:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587e680 x1875765311292160/t0(4294969514) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788873000.120742:0:24856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+41:2403:x1875765311292160:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:2.0:1788873000.120754:0:24856:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587e680 x1875765311292160/t0(4294969514) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788873000.120763:0:24856:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969514, current: 4294969514, replaying 00010000:00000040:2.0:1788873000.120767:0:24856:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:2.0:1788873000.120780:0:24856:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587e680 x1875765311292160/t0(4294969514) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788873000.120789:0:24856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+41:2403:x1875765311292160:12345-192.168.204.39@tcp:4:dd.0 Request processed in 48us (4295us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788873000.120805:0:24856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1084 00000100:00000040:2.0:1788873000.120809:0:24856:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:2.0:1788873000.120824:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969514, next_transno: 4294969514 00010000:00080000:2.0:1788873000.120828:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969514) 00010000:00080000:2.0:1788873000.120836:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311292160 t4294969514 from 192.168.204.39@tcp req@ffff98a9f587e680 x1875765311292160/t0(4294969514) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788873000.120851:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587e680 x1875765311292160/t0(4294969514) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788873000.120959:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788873000.120998:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:2.0:1788873000.121001:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1788873000.121280:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 37 00000020:00000040:2.0:1788873000.121285:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=42 00010000:00000040:2.0:1788873000.121879:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969514, xid 1875765311292160 00000100:00000040:2.0:1788873000.121892:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:2.0:1788873000.121899:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:2.0:1788873000.121998:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:2.0:1788873000.122008:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788873000.122015:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:2.0:1788873000.122026:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 41 00010000:00080000:2.0:1788873000.122032:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969515 00010000:00080000:2.0:1788873000.122036:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969515 00000100:00000040:2.0:1788873000.141050:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ff53e680 x1875765311292416 msgsize 1512 00000100:00100000:2.0:1788873000.141067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788873000.141749:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311292416 00000100:00100000:0.0:1788873000.141760:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311292416 00000020:00000040:0.0:1788873000.141762:0:8443:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:0.0:1788873000.141768:0:8443:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=42 00000100:00000040:0.0:1788873000.141794:0:8443:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788873000.141844:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1085 00000100:00000040:0.0:1788873000.141848:0:8443:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:0.0:1788873000.141856:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ff53e680 x1875765311292416/t0(4294969515) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.141869:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+42:2403:x1875765311292416:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:0.0:1788873000.141881:0:8443:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53e680 x1875765311292416/t0(4294969515) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788873000.141890:0:8443:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969515, current: 4294969515, replaying 00010000:00000040:0.0:1788873000.141893:0:8443:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:0.0:1788873000.141907:0:8443:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53e680 x1875765311292416/t0(4294969515) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788873000.141926:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+42:2403:x1875765311292416:12345-192.168.204.39@tcp:4:dd.0 Request processed in 50us (867us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788873000.141934:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1085 00000100:00000040:0.0:1788873000.141946:0:8443:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:2.0:1788873000.142038:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969515, next_transno: 4294969515 00010000:00080000:2.0:1788873000.142043:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969515) 00010000:00080000:2.0:1788873000.142057:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311292416 t4294969515 from 192.168.204.39@tcp req@ffff98a9ff53e680 x1875765311292416/t0(4294969515) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788873000.142073:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9ff53e680 x1875765311292416/t0(4294969515) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788873000.142172:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788873000.142204:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:2.0:1788873000.142208:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1788873000.142839:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 38 00000020:00000040:2.0:1788873000.142844:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=43 00010000:00000040:2.0:1788873000.142879:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969515, xid 1875765311292416 00000100:00000040:2.0:1788873000.142890:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:2.0:1788873000.142896:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:2.0:1788873000.142991:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:2.0:1788873000.143001:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788873000.143008:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:2.0:1788873000.143018:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 42 00010000:00080000:2.0:1788873000.143023:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969516 00010000:00080000:2.0:1788873000.143027:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969516 00000100:00000040:3.0:1788873000.148898:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587c380 x1875765311292672 msgsize 1512 00000100:00100000:3.0:1788873000.148913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873000.149168:0:24865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311292672 00000100:00100000:2.0:1788873000.149178:0:24865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311292672 00000020:00000040:2.0:1788873000.149181:0:24865:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:2.0:1788873000.149186:0:24865:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=43 00000100:00000040:2.0:1788873000.149212:0:24865:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788873000.149259:0:24865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1086 00000100:00000040:2.0:1788873000.149263:0:24865:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:2.0:1788873000.149270:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587c380 x1875765311292672/t0(4294969516) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788873000.149283:0:24865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+43:2403:x1875765311292672:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:2.0:1788873000.149306:0:24865:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587c380 x1875765311292672/t0(4294969516) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788873000.149315:0:24865:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969516, current: 4294969516, replaying 00010000:00000040:2.0:1788873000.149318:0:24865:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:2.0:1788873000.149332:0:24865:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587c380 x1875765311292672/t0(4294969516) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788873000.149343:0:24865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0804304d-5904-48ad-87f2-bcbc7642a62a+43:2403:x1875765311292672:12345-192.168.204.39@tcp:4:dd.0 Request processed in 61us (445us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788873000.149351:0:24865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1086 00000100:00000040:2.0:1788873000.149354:0:24865:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:2.0:1788873000.149370:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969516, next_transno: 4294969516 00010000:00080000:2.0:1788873000.149373:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969516) 00010000:00080000:2.0:1788873000.149380:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311292672 t4294969516 from 192.168.204.39@tcp req@ffff98a9f587c380 x1875765311292672/t0(4294969516) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788873000.149394:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587c380 x1875765311292672/t0(4294969516) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788873000.149491:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788873000.149520:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:2.0:1788873000.149524:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1788873000.149770:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 39 00000020:00000040:2.0:1788873000.149774:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=44 00010000:00000040:2.0:1788873000.150273:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969516, xid 1875765311292672 00000100:00000040:2.0:1788873000.150286:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:2.0:1788873000.150291:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:2.0:1788873000.150339:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:2.0:1788873000.150347:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788873000.150360:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:2.0:1788873000.150370:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 43 00010000:00080000:2.0:1788873000.150374:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969517 00010000:00080000:2.0:1788873000.150378:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969517 00000100:00000040:0.0:1788873000.152899:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c4d16680 x1875765311292928 msgsize 1512 00000100:00100000:0.0:1788873000.152927:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788873000.153013:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311292928 00000100:00100000:3.0:1788873000.153022:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311292928 00000020:00000040:3.0:1788873000.153025:0:24869:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.153029:0:24869:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=44 00000100:00000040:3.0:1788873000.153053:0:24869:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788873000.153100:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1087 00000100:00000040:3.0:1788873000.153104:0:24869:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:3.0:1788873000.153111:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c4d16680 x1875765311292928/t0(4294969517) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788873000.153126:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+44:2403:x1875765311292928:12345-192.168.204.39@tcp:4:dd.0 00000020:00000040:3.0:1788873000.153137:0:24869:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a8c4d16680 x1875765311292928/t0(4294969517) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788873000.153146:0:24869:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969517, current: 4294969517, replaying 00010000:00000040:3.0:1788873000.153150:0:24869:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:3.0:1788873000.153183:0:24869:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c4d16680 x1875765311292928/t0(4294969517) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788873000.153192:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+44:2403:x1875765311292928:12345-192.168.204.39@tcp:4:dd.0 Request processed in 69us (293us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873000.153200:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1087 00000100:00000040:3.0:1788873000.153203:0:24869:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00010000:00080000:2.0:1788873000.153249:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969517, next_transno: 4294969517 00010000:00080000:2.0:1788873000.153254:0:96965:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969517) 00010000:00080000:2.0:1788873000.153262:0:96965:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1875765311292928 t4294969517 from 192.168.204.39@tcp req@ffff98a8c4d16680 x1875765311292928/t0(4294969517) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788873000.153279:0:96965:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a8c4d16680 x1875765311292928/t0(4294969517) o4->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 1512/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788873000.153377:0:96965:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788873000.153417:0:96965:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 5239 MB/s 00000020:00000040:2.0:1788873000.153422:0:96965:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1788873000.153691:0:96965:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff98a8c394c000 : new cb_count 40 00000020:00000040:2.0:1788873000.153695:0:96965:0:(genops.c:889:class_export_get()) GET export ffff98a8c394c000 refcount=45 00010000:00000040:3.0:1788873000.154604:0:96965:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969477, transno 4294969517, xid 1875765311292928 00000100:00000040:3.0:1788873000.154618:0:96965:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9f6986700 refcount 11 to 192.168.204.39@tcp 00000100:00000040:3.0:1788873000.154625:0:96965:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.39@tcp 00000100:00000040:3.0:1788873000.154671:0:96965:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9f6986700 refcount 10 to 192.168.204.39@tcp 00010000:00080000:3.0:1788873000.154681:0:96965:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788873000.154689:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:3.0:1788873000.154700:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 44 00010000:00080000:3.0:1788873000.154714:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969518 00010000:00080000:3.0:1788873000.154718:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969518 00000100:00000040:3.0:1788873000.161977:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587f800 x1875765311296768 msgsize 328 00000100:00100000:3.0:1788873000.161991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:3.0:1788873000.162027:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587ce00 x1875765311296896 msgsize 328 00000100:00100000:3.0:1788873000.162032:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:3.0:1788873000.162051:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587c700 x1875765311297024 msgsize 328 00000100:00100000:3.0:1788873000.162056:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:3.0:1788873000.162069:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587d880 x1875765311297152 msgsize 328 00000100:00100000:3.0:1788873000.162073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:3.0:1788873000.162085:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587fb80 x1875765311297280 msgsize 328 00000100:00100000:3.0:1788873000.162090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:3.0:1788873000.162107:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587df80 x1875765311297408 msgsize 328 00000100:00100000:3.0:1788873000.162112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:3.0:1788873000.162128:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f587ca80 x1875765311297536 msgsize 328 00000100:00100000:3.0:1788873000.162144:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00000040:3.0:1788873000.162166:0:3639:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f0177100 x1875765311297664 msgsize 328 00000100:00100000:3.0:1788873000.162171:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788873000.162197:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311296768 00000100:00100000:3.0:1788873000.162206:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311296768 00000020:00000040:3.0:1788873000.162209:0:26183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.162213:0:26183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=45 00000100:00100000:3.0:1788873000.162252:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311296896 00000100:00100000:3.0:1788873000.162255:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311296896 00000020:00000040:3.0:1788873000.162257:0:26183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.162258:0:26183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=46 00000100:00100000:3.0:1788873000.162275:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311297024 00000100:00100000:3.0:1788873000.162278:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311297024 00000020:00000040:3.0:1788873000.162279:0:26183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.162281:0:26183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=47 00000100:00100000:3.0:1788873000.162295:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311297152 00000100:00100000:3.0:1788873000.162297:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311297152 00000020:00000040:3.0:1788873000.162299:0:26183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.162301:0:26183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=48 00000100:00100000:3.0:1788873000.162312:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311297280 00000100:00100000:3.0:1788873000.162314:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311297280 00000020:00000040:3.0:1788873000.162316:0:26183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.162317:0:26183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=49 00000100:00100000:3.0:1788873000.162337:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311297408 00000100:00100000:3.0:1788873000.162340:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311297408 00000020:00000040:3.0:1788873000.162342:0:26183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.162344:0:26183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=50 00000100:00100000:3.0:1788873000.162358:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311297536 00000100:00100000:3.0:1788873000.162360:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311297536 00000020:00000040:3.0:1788873000.162362:0:26183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.162364:0:26183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=51 00000100:00100000:3.0:1788873000.162377:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311297664 00000100:00100000:3.0:1788873000.162379:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311297664 00000020:00000040:3.0:1788873000.162387:0:26183:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc606 00000020:00000040:3.0:1788873000.162389:0:26183:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c394c000 refcount=52 00000100:00100000:3.0:1788873000.162425:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6094 00000100:00000040:3.0:1788873000.162429:0:26183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 1 00000100:00000040:3.0:1788873000.162437:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587f800 x1875765311296768/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162451:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311296768:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1788873000.162463:0:26183:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587f800 x1875765311296768/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788873000.162473:0:26183:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00010000:00080000:3.0:1788873000.162477:0:26183:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9f587f800 x1875765311296768/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788873000.162492:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587f800 x1875765311296768/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162501:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311296768:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 52us (524us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873000.162508:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6094 00000100:00000040:3.0:1788873000.162510:0:26183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00000100:00100000:3.0:1788873000.162519:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6095 00000100:00000040:3.0:1788873000.162522:0:26183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 2 00000100:00000040:3.0:1788873000.162526:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587ce00 x1875765311296896/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162536:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311296896:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1788873000.162542:0:26183:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587ce00 x1875765311296896/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788873000.162579:0:26183:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 3 00010000:00080000:3.0:1788873000.162583:0:26183:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9f587ce00 x1875765311296896/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788873000.162592:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587ce00 x1875765311296896/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162601:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311296896:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 66us (572us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873000.162607:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6095 00000100:00000040:3.0:1788873000.162610:0:26183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 2 00000100:00100000:3.0:1788873000.162619:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6096 00000100:00000040:3.0:1788873000.162622:0:26183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 3 00000100:00000040:3.0:1788873000.162626:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587c700 x1875765311297024/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162636:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311297024:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1788873000.162642:0:26183:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587c700 x1875765311297024/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788873000.162648:0:26183:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 4 00010000:00080000:3.0:1788873000.162651:0:26183:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9f587c700 x1875765311297024/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788873000.162659:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587c700 x1875765311297024/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162667:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311297024:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 33us (614us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873000.162678:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6096 00000100:00000040:3.0:1788873000.162680:0:26183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 3 00000100:00100000:3.0:1788873000.162690:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6097 00000100:00000040:3.0:1788873000.162692:0:26183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 4 00000100:00000040:3.0:1788873000.162696:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587d880 x1875765311297152/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162720:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311297152:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1788873000.162727:0:26183:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587d880 x1875765311297152/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788873000.162734:0:26183:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 5 00010000:00080000:3.0:1788873000.162738:0:26183:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9f587d880 x1875765311297152/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788873000.162745:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587d880 x1875765311297152/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162754:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311297152:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 36us (683us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873000.162759:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6097 00000100:00000040:3.0:1788873000.162762:0:26183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 4 00000100:00100000:3.0:1788873000.162770:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6098 00000100:00000040:3.0:1788873000.162773:0:26183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 5 00000100:00000040:3.0:1788873000.162777:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587fb80 x1875765311297280/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162787:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311297280:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1788873000.162801:0:26183:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587fb80 x1875765311297280/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788873000.162808:0:26183:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 6 00010000:00080000:3.0:1788873000.162812:0:26183:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9f587fb80 x1875765311297280/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788873000.162820:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587fb80 x1875765311297280/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162828:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311297280:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 42us (740us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873000.162834:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6098 00000100:00000040:3.0:1788873000.162836:0:26183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 5 00000100:00100000:3.0:1788873000.162844:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6099 00000100:00000040:3.0:1788873000.162847:0:26183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 6 00000100:00000040:3.0:1788873000.162850:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587df80 x1875765311297408/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162860:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311297408:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1788873000.162866:0:26183:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587df80 x1875765311297408/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788873000.162873:0:26183:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 7 00010000:00080000:3.0:1788873000.162876:0:26183:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9f587df80 x1875765311297408/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788873000.162884:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587df80 x1875765311297408/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162903:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311297408:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 44us (794us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873000.162910:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6099 00000100:00000040:3.0:1788873000.162912:0:26183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 6 00000100:00100000:3.0:1788873000.162931:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6100 00000100:00000040:3.0:1788873000.162934:0:26183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 7 00000100:00000040:3.0:1788873000.162938:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f587ca80 x1875765311297536/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162949:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f587ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311297536:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1788873000.162956:0:26183:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f587ca80 x1875765311297536/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788873000.162963:0:26183:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 8 00010000:00080000:3.0:1788873000.162967:0:26183:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9f587ca80 x1875765311297536/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788873000.162974:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f587ca80 x1875765311297536/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.162980:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f587ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311297536:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 34us (851us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873000.162986:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6100 00000100:00000040:3.0:1788873000.162988:0:26183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 7 00000100:00100000:3.0:1788873000.162996:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6101 00000100:00000040:3.0:1788873000.162999:0:26183:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 8 00000100:00000040:3.0:1788873000.163003:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f0177100 x1875765311297664/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.163020:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311297664:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1788873000.163027:0:26183:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff98a9f0177100 x1875765311297664/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788873000.163035:0:26183:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff98a8c394c000 : new rpc_count 9 00010000:00080000:3.0:1788873000.163038:0:26183:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9f0177100 x1875765311297664/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788873000.163047:0:26183:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f0177100 x1875765311297664/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873000.163055:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0804304d-5904-48ad-87f2-bcbc7642a62a+52:2403:x1875765311297664:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 38us (887us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873000.163061:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6101 00000100:00000040:3.0:1788873000.163063:0:26183:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c394c000 : new rpc_count 8 00010000:00080000:3.0:1788873000.163111:0:96965:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294969518 00010000:00080000:3.0:1788873000.163115:0:96965:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00010000:00000040:3.0:1788873000.163121:0:96965:0:(ldlm_lib.c:2881:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:3.0:1788873000.163124:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788873000.163126:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788873000.163131:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9f587f800 x1875765311296768/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788873000.163140:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1788873000.180808:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 7 00000020:00000040:3.0:1788873000.180831:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 51 00010000:00080000:3.0:1788873000.180835:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873000.190649:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873000.190671:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9f587ce00 x1875765311296896/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873000.190685:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788873000.190688:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 6 00000020:00000040:2.0:1788873000.192023:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 50 00010000:00080000:2.0:1788873000.192031:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873000.192033:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873000.192044:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9f587c700 x1875765311297024/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873000.192054:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788873000.192057:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 5 00000020:00000040:2.0:1788873000.192063:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 49 00010000:00080000:2.0:1788873000.192074:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873000.192076:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873000.192082:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9f587d880 x1875765311297152/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873000.192089:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788873000.192091:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 4 00000020:00000040:2.0:1788873000.192096:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 48 00010000:00080000:2.0:1788873000.192098:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873000.192099:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873000.192103:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9f587fb80 x1875765311297280/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873000.192110:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788873000.192111:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 3 00000020:00000040:2.0:1788873000.192116:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 47 00010000:00080000:2.0:1788873000.192117:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873000.192119:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873000.192123:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9f587df80 x1875765311297408/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873000.192129:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788873000.192131:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 2 00000020:00000040:2.0:1788873000.192135:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 46 00010000:00080000:2.0:1788873000.192137:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873000.192138:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873000.192142:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9f587ca80 x1875765311297536/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873000.192149:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788873000.192151:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 1 00000020:00000040:2.0:1788873000.192155:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 45 00010000:00080000:2.0:1788873000.192157:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873000.192158:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873000.192168:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9f0177100 x1875765311297664/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:171/0 lens 328/0 e 0 to 0 dl 1788873011 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873000.192175:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1788873000.192177:0:96965:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff98a8c394c000 : new rpc_count 0 00000020:00000040:2.0:1788873000.192182:0:96965:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 44 00010000:00080000:2.0:1788873000.192184:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 40000000:00000040:0.0:1788873000.229963:0:97064:0:(lproc_fid.c:547:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 00010000:00010000:2.0:1788873000.255806:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1788873001.063042:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff98a9e9b9cd40) now 10 - health_check_show 00000020:00000040:1.0:1788873001.063057:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff98a9e9b9cd40) now 10 - health_check_show 00000020:00000040:1.0:1788873001.063061:0:97112:0:(obd_config.c:994:class_incref()) incref MDS (ffff98a9f9df8000) now 4 - health_check_show 00000020:00000040:1.0:1788873001.063071:0:97112:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff98a9f9df8000) now 4 - health_check_show 00000020:00000040:1.0:1788873001.063073:0:97112:0:(obd_config.c:994:class_incref()) incref MGC192.168.204.139@tcp (ffff98a9e9b999c0) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063076:0:97112:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.204.139@tcp (ffff98a9e9b999c0) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063078:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff98a9f67119c0) now 12 - health_check_show 00000020:00000040:1.0:1788873001.063081:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff98a9f67119c0) now 12 - health_check_show 00000020:00000040:1.0:1788873001.063083:0:97112:0:(obd_config.c:994:class_incref()) incref MGS (ffff98a9e9998000) now 8 - health_check_show 00000020:00000040:1.0:1788873001.063087:0:97112:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff98a9e9998000) now 8 - health_check_show 00000020:00000040:1.0:1788873001.063090:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff98a9f9dfb380) now 5 - health_check_show 00000020:00000040:1.0:1788873001.063092:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff98a9f9dfb380) now 5 - health_check_show 00000020:00000040:1.0:1788873001.063095:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff98a9f9df99c0) now 12 - health_check_show 00000020:00000040:1.0:1788873001.063097:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff98a9f9df99c0) now 12 - health_check_show 00000020:00000040:1.0:1788873001.063099:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff98a9f9dfcd40) now 5 - health_check_show 00000020:00000040:1.0:1788873001.063101:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff98a9f9dfcd40) now 5 - health_check_show 00000020:00000040:1.0:1788873001.063104:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff98a9fa790000) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063106:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff98a9fa790000) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063108:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff98a9e9b0b380) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063111:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff98a9e9b0b380) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063113:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff98a9f5580000) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063122:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff98a9f5580000) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063124:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff98a9f55819c0) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063126:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff98a9f55819c0) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063129:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff98a9e999cd40) now 5 - health_check_show 00000020:00000040:1.0:1788873001.063131:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff98a9e999cd40) now 5 - health_check_show 00000020:00000040:1.0:1788873001.063133:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff98a9e99999c0) now 16 - health_check_show 00000020:00000040:1.0:1788873001.063135:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff98a9e99999c0) now 16 - health_check_show 00000020:00000040:1.0:1788873001.063137:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff98a9e999b380) now 5 - health_check_show 00000020:00000040:1.0:1788873001.063139:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff98a9e999b380) now 5 - health_check_show 00000020:00000040:1.0:1788873001.063142:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff98a8c1cf8000) now 5 - health_check_show 00000020:00000040:1.0:1788873001.063144:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff98a8c1cf8000) now 5 - health_check_show 00000020:00000040:1.0:1788873001.063147:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff98a9e9b0cd40) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063149:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff98a9e9b0cd40) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063152:0:97112:0:(obd_config.c:994:class_incref()) incref OSS (ffff98a9f5583380) now 4 - health_check_show 00000020:00000040:1.0:1788873001.063158:0:97112:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff98a9f5583380) now 4 - health_check_show 00000020:00000040:1.0:1788873001.063160:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff98a8c1cfcd40) now 10 - health_check_show 00000020:00000040:1.0:1788873001.063327:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff98a8c1cfcd40) now 10 - health_check_show 00000020:00000040:1.0:1788873001.063331:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff98a8c1cfb380) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063333:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff98a8c1cfb380) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063335:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff98a9f6714d40) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063338:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff98a9f6714d40) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063340:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff98a8c72e8000) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063342:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff98a8c72e8000) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063344:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff98a9e9b08000) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063346:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff98a9e9b08000) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063348:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff98a8c30019c0) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063352:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff98a8c30019c0) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063362:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - health_check_show 00000020:00000040:1.0:1788873001.063445:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - health_check_show 00000020:00000040:1.0:1788873001.063448:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff98a8c340cd40) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063451:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff98a8c340cd40) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063453:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff98a8c34099c0) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063454:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff98a8c34099c0) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063457:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff98a9e9b099c0) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063458:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff98a9e9b099c0) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063461:0:97112:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff98a9f6713380) now 6 - health_check_show 00000020:00000040:1.0:1788873001.063462:0:97112:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff98a9f6713380) now 6 - health_check_show 00010000:00010000:3.0:1788873001.274861:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873002.298325:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1788873002.689768:0:75631:0:(genops.c:1231:class_import_get()) import ffff98a9dfe90800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1788873002.689822:0:75631:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000084acdc3f] to pc [ptlrpcd_00_02+2] req@ffff98a9ff53f800 x1875765327897472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873002.689877:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:2.0:1788873002.689895:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ff53f800 x1875765327897472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873002.689908:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327897472:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1788873002.689940:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ff53f800 x1875765327897472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873018 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873002.689949:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873002.689996:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff98a9ff53ce00 x1875765327897472 msgsize 224 00000100:00100000:2.0:1788873002.690001:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788873002.690025:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ff53f800 x1875765327897472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873018 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873002.690038:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 7113 usecs (8 jiffies) 00000100:00100000:2.0:1788873002.690064:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327897472 00000100:00100000:2.0:1788873002.690071:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327897472 00000020:00000040:2.0:1788873002.690074:0:8439:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d553b 00000020:00000040:2.0:1788873002.690079:0:8439:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c45cb000 refcount=5 00000020:00000040:2.0:1788873002.690094:0:8439:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:2.0:1788873002.690119:0:8439:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1788873002.690145:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2258 00000100:00000040:2.0:1788873002.690159:0:8439:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9c45cb000 : new rpc_count 1 00000100:00000040:2.0:1788873002.690165:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9ff53ce00 x1875765327897472/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:173/0 lens 224/0 e 0 to 0 dl 1788873013 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873002.690176:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327897472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788873002.690211:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00010000:00000040:2.0:1788873002.690223:0:8439:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875765327897472 00000100:00000040:2.0:1788873002.690231:0:8439:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:2.0:1788873002.690236:0:8439:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873002.690254:0:8439:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9ff53f800 x1875765327897472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873018 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873002.690272:0:8439:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:2.0:1788873002.690277:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53ce00 x1875765327897472/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:173/0 lens 224/368 e 0 to 0 dl 1788873013 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873002.690285:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327897472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873002.690291:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2258 00000100:00000040:2.0:1788873002.690294:0:8439:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9c45cb000 : new rpc_count 0 00000020:00000040:2.0:1788873002.690303:0:8439:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c45cb000 : new refcount 4 00000100:00080000:2.0:1788873002.690317:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1788873002.690321:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:2.0:1788873002.690363:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:2.0:1788873002.690369:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ff53f800 x1875765327897472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1788873002.690379:0:3647:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:2.0:1788873002.690383:0:3647:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1788873002.690391:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53f800 x1875765327897472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873018 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873002.690405:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327897472:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1788873002.690412:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ff53f800 x1875765327897472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788873018 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788873002.690421:0:3647:0:(genops.c:1244:class_import_put()) import ffff98a9dfe90800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:2.0:1788873003.325136:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1788873003.711380:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788873003.711401:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9e98d3800 refcount=4 obd=MGC192.168.204.139@tcp 00000100:00000040:2.0:1788873003.711431:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging f2e885a0-f180-4b85-9f87-6a01e20afd1a->MGS req@ffff98a9ff53f800 x1875765327897600/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788873003.711448:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000084acdc3f] to pc [ptlrpcd_00_03+3] req@ffff98a9ff53f800 x1875765327897600/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.711472:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788873003.711478:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9efadc000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1788873003.711485:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff98a9ff53f480 x1875765327897728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788873003.711495:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f289263b] to pc [ptlrpcd_00_00+0] req@ffff98a9ff53f480 x1875765327897728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.711511:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788873003.711516:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a8c2644800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788873003.711522:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff98a9ff53c380 x1875765327897856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788873003.711531:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000046418f57] to pc [ptlrpcd_00_01+1] req@ffff98a9ff53c380 x1875765327897856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.711576:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788873003.711583:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9df8c9800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788873003.711592:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff98a9ff53f100 x1875765327897984/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788873003.711600:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000085a6b702] to pc [ptlrpcd_00_02+2] req@ffff98a9ff53f100 x1875765327897984/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788873003.711607:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788873003.711610:0:82775:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1788873003.711612:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788873003.711618:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9dfe90800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1788873003.711623:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff98a9df436d80 x1875765327898112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788873003.711631:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005664c9fc] to pc [ptlrpcd_00_03+3] req@ffff98a9df436d80 x1875765327898112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.711637:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788873003.711641:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9dfe96800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1788873003.711647:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff98a9df434a80 x1875765327898240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788873003.711655:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000026723ba0] to pc [ptlrpcd_00_00+0] req@ffff98a9df434a80 x1875765327898240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.711661:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788873003.711665:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a8c9e82800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788873003.711680:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff98a9df437b80 x1875765327898368/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788873003.711689:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000be129dba] to pc [ptlrpcd_00_01+1] req@ffff98a9df437b80 x1875765327898368/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788873003.711696:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788873003.711699:0:82775:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1788873003.711701:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788873003.711705:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9e021b000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788873003.711711:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff98a9df434380 x1875765327898496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788873003.711718:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000056f1b902] to pc [ptlrpcd_00_02+2] req@ffff98a9df434380 x1875765327898496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.711724:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788873003.711727:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a8ca9bc000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1788873003.711733:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff98a9df436300 x1875765327898624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788873003.711741:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e34fd12f] to pc [ptlrpcd_00_03+3] req@ffff98a9df436300 x1875765327898624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.711748:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788873003.711752:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a9ef237000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1788873003.711760:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff98a9df437480 x1875765327898752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788873003.711768:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000502f14d9] to pc [ptlrpcd_00_00+0] req@ffff98a9df437480 x1875765327898752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.711784:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788873003.711788:0:82775:0:(genops.c:1231:class_import_get()) import ffff98a8c1f5c800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1788873003.711797:0:82775:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff98a9df435f80 x1875765327898880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788873003.711805:0:82775:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000de1c6726] to pc [ptlrpcd_00_01+1] req@ffff98a9df435f80 x1875765327898880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.711814:0:82775:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 1 (3945) 00000100:00000040:2.0:1788873003.711835:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ff53f800 x1875765327897600/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.711860:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327897600:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.711890:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ff53f800 x1875765327897600/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.711898:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.711947:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff98a8c6c67450 x1875765327897600 msgsize 224 00000100:00100000:2.0:1788873003.711952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788873003.711954:0:3647:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788873003.711976:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ff53f800 x1875765327897600/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712005:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df436d80 x1875765327898112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.712013:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327898112:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.712028:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df436d80 x1875765327898112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712036:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.712049:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df434000 x1875765327898112 msgsize 224 00000100:00100000:2.0:1788873003.712058:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788873003.712075:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df436d80 x1875765327898112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712084:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 7096 usecs (8 jiffies) 00000100:00000040:2.0:1788873003.712090:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df436300 x1875765327898624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.712099:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327898624:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.712113:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df436300 x1875765327898624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712119:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.712134:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df437800 x1875765327898624 msgsize 224 00000100:00100000:2.0:1788873003.712137:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788873003.712150:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df436300 x1875765327898624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712159:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8613 usecs (9 jiffies) 00000100:00100000:2.0:1788873003.712173:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00000040:2.0:1788873003.712178:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ff53f100 x1875765327897984/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.712187:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327897984:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.712201:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ff53f100 x1875765327897984/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712207:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.712222:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df435180 x1875765327897984 msgsize 224 00000100:00100000:2.0:1788873003.712226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788873003.712242:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ff53f100 x1875765327897984/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712251:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1528811 usecs (1529 jiffies) 00000100:00000040:2.0:1788873003.712257:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df434380 x1875765327898496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.712271:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327898496:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.712285:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df434380 x1875765327898496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712292:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.712304:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df435c00 x1875765327898496 msgsize 224 00000100:00100000:2.0:1788873003.712308:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788873003.712321:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df434380 x1875765327898496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712330:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6340 usecs (7 jiffies) 00000100:00000040:2.0:1788873003.712350:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ff53f480 x1875765327897728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.712360:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327897728:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.712372:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ff53f480 x1875765327897728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712380:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.712392:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df435500 x1875765327897728 msgsize 224 00000100:00100000:2.0:1788873003.712395:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788873003.712408:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ff53f480 x1875765327897728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712418:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8818 usecs (9 jiffies) 00000100:00000040:2.0:1788873003.712424:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df434a80 x1875765327898240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.712432:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327898240:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.712443:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df434a80 x1875765327898240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712459:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.712473:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df436a00 x1875765327898240 msgsize 224 00000100:00100000:2.0:1788873003.712476:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788873003.712490:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df434a80 x1875765327898240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712499:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 129571 usecs (130 jiffies) 00000100:00000040:2.0:1788873003.712505:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df437480 x1875765327898752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.712514:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327898752:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.712530:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df437480 x1875765327898752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712537:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.712571:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df434e00 x1875765327898752 msgsize 224 00000100:00100000:2.0:1788873003.712575:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788873003.712587:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df437480 x1875765327898752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712596:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 7877 usecs (8 jiffies) 00000100:00100000:2.0:1788873003.712604:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00000040:2.0:1788873003.712608:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9ff53c380 x1875765327897856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.712616:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9ff53c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327897856:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.712627:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9ff53c380 x1875765327897856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712634:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.712646:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df434700 x1875765327897856 msgsize 224 00000100:00100000:2.0:1788873003.712649:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788873003.712662:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9ff53c380 x1875765327897856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712678:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8795 usecs (9 jiffies) 00000100:00000040:2.0:1788873003.712683:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df437b80 x1875765327898368/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.712691:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327898368:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.712705:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df437b80 x1875765327898368/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712711:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.712723:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df435880 x1875765327898368 msgsize 224 00000100:00100000:2.0:1788873003.712727:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788873003.712740:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df437b80 x1875765327898368/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712749:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5145 usecs (6 jiffies) 00000100:00000040:2.0:1788873003.712754:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df435f80 x1875765327898880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.712762:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327898880:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.712776:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df435f80 x1875765327898880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712783:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.712793:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff98a9df437100 x1875765327898880 msgsize 224 00000100:00100000:2.0:1788873003.712796:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788873003.712807:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df435f80 x1875765327898880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.712814:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 1071 usecs (2 jiffies) 00000100:00100000:2.0:1788873003.712838:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327897600 00000100:00100000:2.0:1788873003.712846:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327897600 00000020:00000040:2.0:1788873003.712861:0:94377:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db61c 00000020:00000040:2.0:1788873003.712882:0:94377:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c2645800 refcount=24 00000100:00000040:2.0:1788873003.712903:0:94377:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788873003.712929:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00000040:2.0:1788873003.712933:0:94377:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c2645800 : new rpc_count 1 00000100:00000040:2.0:1788873003.712937:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a8c6c67450 x1875765327897600/t0(0) o400->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:174/0 lens 224/0 e 0 to 0 dl 1788873014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.712947:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327897600:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788873003.712964:0:94377:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327897600 00000100:00000040:2.0:1788873003.712972:0:94377:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:2.0:1788873003.712976:0:94377:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.712993:0:94377:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9ff53f800 x1875765327897600/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.713009:0:94377:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:2.0:1788873003.713013:0:94377:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a8c6c67450 x1875765327897600/t0(0) o400->f2e885a0-f180-4b85-9f87-6a01e20afd1a@0@lo:174/0 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713021:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327897600:12345-0@lo:400:kworker.0 Request processed in 75us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873003.713027:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00000040:2.0:1788873003.713030:0:94377:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c2645800 : new rpc_count 0 00000020:00000040:2.0:1788873003.713039:0:94377:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c2645800 : new refcount 23 00000100:00100000:2.0:1788873003.713065:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327898112 00000100:00100000:2.0:1788873003.713068:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327898112 00000020:00000040:2.0:1788873003.713070:0:26192:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d553b 00000020:00000040:2.0:1788873003.713073:0:26192:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9c45cb000 refcount=5 00000100:00100000:2.0:1788873003.713094:0:26192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327898496 00000100:00100000:2.0:1788873003.713097:0:26192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327898496 00000020:00000040:2.0:1788873003.713099:0:26192:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6ee 00000020:00000040:2.0:1788873003.713101:0:26192:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9dfe94000 refcount=5 00000020:00000040:2.0:1788873003.713112:0:26192:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00100000:2.0:1788873003.713141:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00000040:2.0:1788873003.713144:0:26192:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9c45cb000 : new rpc_count 1 00000100:00000040:2.0:1788873003.713147:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df434000 x1875765327898112/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:174/0 lens 224/0 e 0 to 0 dl 1788873014 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713156:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327898112:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788873003.713167:0:26192:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875765327898112 00000100:00000040:2.0:1788873003.713172:0:26192:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:2.0:1788873003.713175:0:26192:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.713191:0:26192:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9df436d80 x1875765327898112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.713202:0:26192:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:2.0:1788873003.713205:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df434000 x1875765327898112/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:174/0 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713212:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327898112:12345-0@lo:400:kworker.0 Request processed in 58us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873003.713217:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00000040:2.0:1788873003.713219:0:26192:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9c45cb000 : new rpc_count 0 00000020:00000040:2.0:1788873003.713223:0:26192:0:(genops.c:900:class_export_put()) PUTting export ffff98a9c45cb000 : new refcount 4 00000100:00100000:2.0:1788873003.713230:0:26192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800 00000100:00000040:2.0:1788873003.713232:0:26192:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9dfe94000 : new rpc_count 1 00000100:00000040:2.0:1788873003.713235:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df435c00 x1875765327898496/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:174/0 lens 224/0 e 0 to 0 dl 1788873014 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713242:0:26192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327898496:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788873003.713249:0:26192:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875765327898496 00000100:00000040:2.0:1788873003.713252:0:26192:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:2.0:1788873003.713255:0:26192:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.713273:0:26192:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9df434380 x1875765327898496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.713283:0:26192:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:2.0:1788873003.713286:0:26192:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df435c00 x1875765327898496/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:174/0 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713293:0:26192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327898496:12345-0@lo:400:kworker.0 Request processed in 52us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873003.713298:0:26192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800 00000100:00000040:2.0:1788873003.713300:0:26192:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9dfe94000 : new rpc_count 0 00000020:00000040:2.0:1788873003.713305:0:26192:0:(genops.c:900:class_export_put()) PUTting export ffff98a9dfe94000 : new refcount 4 00000100:00100000:2.0:1788873003.713317:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327898624 00000100:00100000:2.0:1788873003.713321:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327898624 00000020:00000040:2.0:1788873003.713322:0:66979:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db814 00000020:00000040:2.0:1788873003.713324:0:66979:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9df96b800 refcount=5 00000100:00000040:2.0:1788873003.713333:0:66979:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788873003.713342:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327897728 00000100:00100000:2.0:1788873003.713344:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327897728 00000020:00000040:2.0:1788873003.713345:0:66979:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db806 00000020:00000040:2.0:1788873003.713347:0:66979:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9f0834000 refcount=5 00000020:00000040:2.0:1788873003.713354:0:66979:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff98a9e99999c0) now 16 - evictor 00000100:00100000:2.0:1788873003.713361:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327898240 00000100:00100000:2.0:1788873003.713363:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327898240 00000020:00000040:2.0:1788873003.713365:0:66979:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db80d 00000020:00000040:2.0:1788873003.713366:0:66979:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9f0835000 refcount=5 00000100:00100000:2.0:1788873003.713374:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327898752 00000100:00100000:2.0:1788873003.713376:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327898752 00000020:00000040:2.0:1788873003.713377:0:66979:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc637 00000020:00000040:2.0:1788873003.713379:0:66979:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98aa002c0800 refcount=5 00000100:00100000:2.0:1788873003.713389:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327897856 00000100:00100000:2.0:1788873003.713392:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327897856 00000020:00000040:2.0:1788873003.713393:0:66979:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01d55b9 00000020:00000040:2.0:1788873003.713395:0:66979:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a8c37f4800 refcount=5 00000020:00000040:2.0:1788873003.713406:0:66979:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff98a9f9df99c0) now 12 - evictor 00000100:00100000:2.0:1788873003.713418:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327898880 00000100:00100000:2.0:1788873003.713420:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327898880 00000020:00000040:2.0:1788873003.713422:0:66979:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01dc64c 00000020:00000040:2.0:1788873003.713424:0:66979:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9df968800 refcount=5 00000100:00100000:2.0:1788873003.713437:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00000040:2.0:1788873003.713440:0:66979:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9df96b800 : new rpc_count 1 00000100:00000040:2.0:1788873003.713443:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df437800 x1875765327898624/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:174/0 lens 224/0 e 0 to 0 dl 1788873014 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713452:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327898624:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788873003.713460:0:66979:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327898624 00000100:00000040:2.0:1788873003.713464:0:66979:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:2.0:1788873003.713467:0:66979:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.713482:0:66979:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9df436300 x1875765327898624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.713493:0:66979:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:2.0:1788873003.713496:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df437800 x1875765327898624/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:174/0 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713504:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327898624:12345-0@lo:400:kworker.0 Request processed in 53us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873003.713510:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00000040:2.0:1788873003.713512:0:66979:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9df96b800 : new rpc_count 0 00000020:00000040:2.0:1788873003.713517:0:66979:0:(genops.c:900:class_export_put()) PUTting export ffff98a9df96b800 : new refcount 4 00000100:00100000:2.0:1788873003.713527:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00000040:2.0:1788873003.713529:0:66979:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9f0834000 : new rpc_count 1 00000100:00000040:2.0:1788873003.713532:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df435500 x1875765327897728/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:174/0 lens 224/0 e 0 to 0 dl 1788873014 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713541:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327897728:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788873003.713584:0:66979:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327897728 00000100:00000040:2.0:1788873003.713588:0:66979:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:2.0:1788873003.713592:0:66979:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.713607:0:66979:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9ff53f480 x1875765327897728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.713624:0:66979:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:2.0:1788873003.713628:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df435500 x1875765327897728/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:174/0 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713635:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327897728:12345-0@lo:400:kworker.0 Request processed in 96us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873003.713641:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00000040:2.0:1788873003.713643:0:66979:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9f0834000 : new rpc_count 0 00000020:00000040:2.0:1788873003.713649:0:66979:0:(genops.c:900:class_export_put()) PUTting export ffff98a9f0834000 : new refcount 4 00000100:00100000:2.0:1788873003.713657:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00000040:2.0:1788873003.713659:0:66979:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9f0835000 : new rpc_count 1 00000100:00000040:2.0:1788873003.713662:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df436a00 x1875765327898240/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:174/0 lens 224/0 e 0 to 0 dl 1788873014 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713671:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327898240:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788873003.713679:0:66979:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327898240 00000100:00000040:2.0:1788873003.713683:0:66979:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:2.0:1788873003.713686:0:66979:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.713698:0:66979:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9df434a80 x1875765327898240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.713709:0:66979:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:2.0:1788873003.713713:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df436a00 x1875765327898240/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:174/0 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713732:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327898240:12345-0@lo:400:kworker.0 Request processed in 62us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873003.713738:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00000040:2.0:1788873003.713741:0:66979:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9f0835000 : new rpc_count 0 00000020:00000040:2.0:1788873003.713749:0:66979:0:(genops.c:900:class_export_put()) PUTting export ffff98a9f0835000 : new refcount 4 00000100:00100000:2.0:1788873003.713757:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00000040:2.0:1788873003.713760:0:66979:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98aa002c0800 : new rpc_count 1 00000100:00000040:2.0:1788873003.713764:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df434e00 x1875765327898752/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:174/0 lens 224/0 e 0 to 0 dl 1788873014 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713773:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327898752:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788873003.713781:0:66979:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327898752 00000100:00000040:2.0:1788873003.713785:0:66979:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:2.0:1788873003.713789:0:66979:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.713804:0:66979:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9df437480 x1875765327898752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.713815:0:66979:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:2.0:1788873003.713819:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df434e00 x1875765327898752/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:174/0 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713827:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875765327898752:12345-0@lo:400:kworker.0 Request processed in 55us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873003.713832:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00000040:2.0:1788873003.713835:0:66979:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98aa002c0800 : new rpc_count 0 00000020:00000040:2.0:1788873003.713840:0:66979:0:(genops.c:900:class_export_put()) PUTting export ffff98aa002c0800 : new refcount 4 00000100:00100000:2.0:1788873003.713859:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00000040:2.0:1788873003.713862:0:66979:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a8c37f4800 : new rpc_count 1 00000100:00000040:2.0:1788873003.713865:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df434700 x1875765327897856/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:174/0 lens 224/0 e 0 to 0 dl 1788873014 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713881:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327897856:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788873003.713891:0:66979:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327897856 00000100:00000040:2.0:1788873003.713895:0:66979:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:2.0:1788873003.713898:0:66979:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.713912:0:66979:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9ff53c380 x1875765327897856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.713922:0:66979:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:2.0:1788873003.713925:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df434700 x1875765327897856/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:174/0 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713932:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327897856:12345-0@lo:400:kworker.0 Request processed in 54us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873003.713937:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00000040:2.0:1788873003.713939:0:66979:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a8c37f4800 : new rpc_count 0 00000020:00000040:2.0:1788873003.713947:0:66979:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c37f4800 : new refcount 4 00000100:00100000:2.0:1788873003.713956:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00000040:2.0:1788873003.713958:0:66979:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9df968800 : new rpc_count 1 00000100:00000040:2.0:1788873003.713961:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df437100 x1875765327898880/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:174/0 lens 224/0 e 0 to 0 dl 1788873014 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.713968:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327898880:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788873003.713976:0:66979:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327898880 00000100:00000040:2.0:1788873003.713979:0:66979:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:2.0:1788873003.713982:0:66979:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.713996:0:66979:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9df435f80 x1875765327898880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714008:0:66979:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:2.0:1788873003.714020:0:66979:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df437100 x1875765327898880/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:174/0 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714027:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327898880:12345-0@lo:400:kworker.0 Request processed in 59us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873003.714032:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00000040:2.0:1788873003.714034:0:66979:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9df968800 : new rpc_count 0 00000020:00000040:2.0:1788873003.714040:0:66979:0:(genops.c:900:class_export_put()) PUTting export ffff98a9df968800 : new refcount 4 00000100:00100000:2.0:1788873003.714057:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327897984 00000100:00100000:2.0:1788873003.714061:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327897984 00000020:00000040:2.0:1788873003.714063:0:30614:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db67e 00000020:00000040:2.0:1788873003.714066:0:30614:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9cb5ec800 refcount=7 00000100:00000040:2.0:1788873003.714077:0:30614:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1788873003.714094:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327898368 00000100:00100000:2.0:1788873003.714097:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327898368 00000020:00000040:2.0:1788873003.714098:0:30614:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6b6 00000020:00000040:2.0:1788873003.714100:0:30614:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ff63e800 refcount=5 00000100:00100000:2.0:1788873003.714114:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4090 00000100:00000040:2.0:1788873003.714117:0:30614:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9cb5ec800 : new rpc_count 1 00000100:00000040:2.0:1788873003.714120:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df435180 x1875765327897984/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:174/0 lens 224/0 e 0 to 0 dl 1788873014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714131:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327897984:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788873003.714270:0:30614:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084298, transno 0, xid 1875765327897984 00000100:00000040:2.0:1788873003.714275:0:30614:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:2.0:1788873003.714278:0:30614:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.714294:0:30614:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9ff53f100 x1875765327897984/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714307:0:30614:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:2.0:1788873003.714311:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df435180 x1875765327897984/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:174/0 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714329:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875765327897984:12345-0@lo:400:kworker.0 Request processed in 199us (2105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873003.714335:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4090 00000100:00000040:2.0:1788873003.714337:0:30614:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9cb5ec800 : new rpc_count 0 00000020:00000040:2.0:1788873003.714343:0:30614:0:(genops.c:900:class_export_put()) PUTting export ffff98a9cb5ec800 : new refcount 6 00000100:00100000:2.0:1788873003.714352:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4091 00000100:00000040:2.0:1788873003.714355:0:30614:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9ff63e800 : new rpc_count 1 00000100:00000040:2.0:1788873003.714358:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9df435880 x1875765327898368/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:174/0 lens 224/0 e 0 to 0 dl 1788873014 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714368:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327898368:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788873003.714377:0:30614:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327898368 00000100:00000040:2.0:1788873003.714382:0:30614:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:2.0:1788873003.714385:0:30614:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788873003.714400:0:30614:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff98a9df437b80 x1875765327898368/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714411:0:30614:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:2.0:1788873003.714415:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df435880 x1875765327898368/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:174/0 lens 224/224 e 0 to 0 dl 1788873014 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714422:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327898368:12345-0@lo:400:kworker.0 Request processed in 56us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873003.714428:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4091 00000100:00000040:2.0:1788873003.714430:0:30614:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9ff63e800 : new rpc_count 0 00000020:00000040:2.0:1788873003.714434:0:30614:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ff63e800 : new refcount 4 00000100:00000040:2.0:1788873003.714492:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084298 00000100:00000040:2.0:1788873003.714499:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ff53f100 x1875765327897984/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714519:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53f100 x1875765327897984/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714527:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327897984:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.714539:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:2.0:1788873003.714543:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df434380 x1875765327898496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714567:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df434380 x1875765327898496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714574:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327898496:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.714585:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ff53f800 x1875765327897600/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714593:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53f800 x1875765327897600/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714600:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327897600:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.714610:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:2.0:1788873003.714613:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df436d80 x1875765327898112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714620:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df436d80 x1875765327898112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714626:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327898112:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.714635:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788873003.714638:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df436300 x1875765327898624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714650:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df436300 x1875765327898624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714657:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327898624:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.714662:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ff53f100 x1875765327897984/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788873003.714671:0:3647:0:(genops.c:1244:class_import_put()) import ffff98a9df8c9800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788873003.714680:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df434380 x1875765327898496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788873003.714686:0:3647:0:(genops.c:1244:class_import_put()) import ffff98a9e021b000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788873003.714693:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ff53f800 x1875765327897600/t0(0) o400->MGC192.168.204.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788873003.714699:0:3647:0:(genops.c:1244:class_import_put()) import ffff98a9e98d3800 refcount=3 obd=MGC192.168.204.139@tcp 00000100:00000040:2.0:1788873003.714703:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df436d80 x1875765327898112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788873003.714711:0:3647:0:(genops.c:1244:class_import_put()) import ffff98a9dfe90800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1788873003.714716:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df436300 x1875765327898624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788873003.714723:0:3647:0:(genops.c:1244:class_import_put()) import ffff98a8ca9bc000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00080000:2.0:1788873003.714741:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1788873003.714746:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff98a9f9df99c0) now 12 - evictor 00000100:00080000:2.0:1788873003.714749:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1788873003.714751:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff98a9e99999c0) now 16 - evictor 00000100:00080000:2.0:1788873003.714754:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1788873003.714756:0:6516:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff98a8c1cf99c0) now 10 - evictor 00000100:00000040:2.0:1788873003.714773:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788873003.714778:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ff53c380 x1875765327897856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714790:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53c380 x1875765327897856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714798:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327897856:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.714806:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788873003.714809:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df437b80 x1875765327898368/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714816:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df437b80 x1875765327898368/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714823:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327898368:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.714831:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788873003.714834:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df435f80 x1875765327898880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714842:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df435f80 x1875765327898880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714861:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327898880:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.714870:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788873003.714874:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9ff53f480 x1875765327897728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714882:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9ff53f480 x1875765327897728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714889:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9ff53f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327897728:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.714898:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788873003.714906:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df434a80 x1875765327898240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714914:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df434a80 x1875765327898240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714921:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327898240:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.714933:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788873003.714936:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df437480 x1875765327898752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788873003.714943:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df437480 x1875765327898752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873003.714950:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1875765327898752:0@lo:400:kworker.0 00000100:00000040:2.0:1788873003.714955:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ff53c380 x1875765327897856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788873003.714962:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a8c2644800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788873003.714966:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df437b80 x1875765327898368/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788873003.714972:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a8c9e82800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788873003.714976:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df435f80 x1875765327898880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788873003.714983:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a8c1f5c800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1788873003.714988:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9ff53f480 x1875765327897728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788873003.714994:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9efadc000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1788873003.714998:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df434a80 x1875765327898240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788873003.715014:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9dfe96800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1788873003.715019:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df437480 x1875765327898752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788873019 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788873003.715025:0:3644:0:(genops.c:1244:class_import_put()) import ffff98a9ef237000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000001:00080000:3.0:1788873003.723304:0:96949:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969517 is committed 00000001:00000040:3.0:1788873003.723316:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 39 00000020:00000040:3.0:1788873003.723320:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 43 00000001:00000040:3.0:1788873003.723326:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 38 00000020:00000040:3.0:1788873003.723328:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 42 00000001:00000040:3.0:1788873003.723332:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 37 00000020:00000040:3.0:1788873003.723334:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 41 00000001:00000040:3.0:1788873003.723337:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 36 00000020:00000040:3.0:1788873003.723338:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 40 00000001:00000040:3.0:1788873003.723342:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 35 00000020:00000040:3.0:1788873003.723344:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 39 00000001:00000040:3.0:1788873003.723349:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 34 00000020:00000040:3.0:1788873003.723351:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 38 00000001:00000040:3.0:1788873003.723355:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 33 00000020:00000040:3.0:1788873003.723356:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 37 00000001:00000040:3.0:1788873003.723362:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 32 00000020:00000040:3.0:1788873003.723364:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 36 00000001:00000040:3.0:1788873003.723372:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 31 00000020:00000040:3.0:1788873003.723373:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 35 00000001:00000040:3.0:1788873003.723380:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 30 00000020:00000040:3.0:1788873003.723382:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 34 00000001:00000040:3.0:1788873003.723386:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 29 00000020:00000040:3.0:1788873003.723388:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 33 00000001:00000040:3.0:1788873003.723393:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 28 00000020:00000040:3.0:1788873003.723396:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 32 00000001:00000040:3.0:1788873003.723400:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 27 00000020:00000040:3.0:1788873003.723402:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 31 00000001:00000040:3.0:1788873003.723406:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 26 00000020:00000040:3.0:1788873003.723408:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 30 00000001:00000040:3.0:1788873003.723412:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 25 00000020:00000040:3.0:1788873003.723424:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 29 00000001:00000040:3.0:1788873003.723431:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 24 00000020:00000040:3.0:1788873003.723432:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 28 00000001:00000040:3.0:1788873003.723437:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 23 00000020:00000040:3.0:1788873003.723439:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 27 00000001:00000040:3.0:1788873003.723443:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 22 00000020:00000040:3.0:1788873003.723444:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 26 00000001:00000040:3.0:1788873003.723448:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 21 00000020:00000040:3.0:1788873003.723450:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 25 00000001:00000040:3.0:1788873003.723453:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 20 00000020:00000040:3.0:1788873003.723455:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 24 00000001:00000040:3.0:1788873003.723460:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 19 00000020:00000040:3.0:1788873003.723462:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 23 00000001:00000040:3.0:1788873003.723466:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 18 00000020:00000040:3.0:1788873003.723468:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 22 00000001:00000040:3.0:1788873003.723471:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 17 00000020:00000040:3.0:1788873003.723473:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 21 00000001:00000040:3.0:1788873003.723476:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 16 00000020:00000040:3.0:1788873003.723478:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 20 00000001:00000040:3.0:1788873003.723481:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 15 00000020:00000040:3.0:1788873003.723483:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 19 00000001:00000040:3.0:1788873003.723489:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 14 00000020:00000040:3.0:1788873003.723491:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 18 00000001:00000040:3.0:1788873003.723494:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 13 00000020:00000040:3.0:1788873003.723496:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 17 00000001:00000040:3.0:1788873003.723499:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 12 00000020:00000040:3.0:1788873003.723501:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 16 00000001:00000040:3.0:1788873003.723505:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 11 00000020:00000040:3.0:1788873003.723506:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 15 00000001:00000040:3.0:1788873003.723510:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 10 00000020:00000040:3.0:1788873003.723517:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 14 00000001:00000040:3.0:1788873003.723523:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 9 00000020:00000040:3.0:1788873003.723525:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 13 00000001:00000040:3.0:1788873003.723529:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 8 00000020:00000040:3.0:1788873003.723530:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 12 00000001:00000040:3.0:1788873003.723533:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 7 00000020:00000040:3.0:1788873003.723535:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 11 00000001:00000040:3.0:1788873003.723538:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 6 00000020:00000040:3.0:1788873003.723540:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 10 00000001:00000040:3.0:1788873003.723544:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 5 00000020:00000040:3.0:1788873003.723545:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 9 00000001:00000040:3.0:1788873003.723581:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 4 00000020:00000040:3.0:1788873003.723583:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 8 00000001:00000040:3.0:1788873003.723588:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 3 00000020:00000040:3.0:1788873003.723590:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 7 00000001:00000040:3.0:1788873003.723595:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 2 00000020:00000040:3.0:1788873003.723596:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 6 00000001:00000040:3.0:1788873003.723600:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 1 00000020:00000040:3.0:1788873003.723602:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 5 00000001:00000040:3.0:1788873003.723605:0:96949:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff98a8c394c000 : new cb_count 0 00000020:00000040:3.0:1788873003.723607:0:96949:0:(genops.c:900:class_export_put()) PUTting export ffff98a8c394c000 : new refcount 4 00000020:00000040:2.0:1788873004.219770:0:94388:0:(genops.c:1231:class_import_get()) import ffff98a8c9e82800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788873004.219884:0:94388:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000502f14d9] to pc [ptlrpcd_00_02+2] req@ffff98a9df437480 x1875765327899008/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788873004.219938:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff98a9df437480 x1875765327899008/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873004.219953:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327899008:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1788873004.219986:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff98a9df437480 x1875765327899008/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873020 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788873004.219996:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788873004.220053:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff98a9f0175180 x1875765327899008 msgsize 224 00000100:00100000:3.0:1788873004.220058:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788873004.220092:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff98a9df437480 x1875765327899008/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873020 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788873004.220107:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5106 usecs (6 jiffies) 00000100:00100000:3.0:1788873004.220436:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327899008 00000100:00100000:3.0:1788873004.220444:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327899008 00000020:00000040:3.0:1788873004.220448:0:30614:0:(genops.c:825:class_conn2export()) looking for export cookie 0xe4e6e89fb01db6b6 00000020:00000040:3.0:1788873004.220523:0:30614:0:(lustre_handles.c:147:class_handle2object()) GET export ffff98a9ff63e800 refcount=5 00000100:00000040:3.0:1788873004.220763:0:30614:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1788873004.220948:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4092 00000100:00000040:3.0:1788873004.220954:0:30614:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff98a9ff63e800 : new rpc_count 1 00000100:00000040:3.0:1788873004.220960:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff98a9f0175180 x1875765327899008/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:175/0 lens 224/0 e 0 to 0 dl 1788873015 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873004.220974:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327899008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788873004.221044:0:30614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00010000:00000040:3.0:1788873004.221068:0:30614:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1875765327899008 00000100:00000040:3.0:1788873004.221081:0:30614:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff98a9c86f8940 refcount 66 to 0@lo 00000100:00000040:3.0:1788873004.221087:0:30614:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788873004.221123:0:30614:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff98a9df437480 x1875765327899008/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873020 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788873004.221154:0:30614:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff98a9c86f8940 refcount 65 to 0@lo 00000100:00000040:3.0:1788873004.221160:0:30614:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9f0175180 x1875765327899008/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:175/0 lens 224/368 e 0 to 0 dl 1788873015 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873004.221168:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875765327899008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 198us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873004.221176:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4092 00000100:00000040:3.0:1788873004.221179:0:30614:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff98a9ff63e800 : new rpc_count 0 00000020:00000040:3.0:1788873004.221190:0:30614:0:(genops.c:900:class_export_put()) PUTting export ffff98a9ff63e800 : new refcount 4 00000100:00000040:1.0:1788873004.221261:0:3646:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788873004.221269:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff98a9df437480 x1875765327899008/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788873004.221280:0:3646:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352901 avail=317198 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023685 state=0: rc = 0 00000100:00000040:1.0:1788873004.221288:0:3646:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff98a9df437480 x1875765327899008/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873020 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788873004.221295:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1875765327899008:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788873004.221302:0:3646:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff98a9df437480 x1875765327899008/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788873020 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788873004.221313:0:3646:0:(genops.c:1244:class_import_put()) import ffff98a8c9e82800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00010000:00010000:2.0:1788873004.344957:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788873004.428051:0:97306:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788873004.728739:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873004.728774:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327899264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788873004.728906:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873004.728983:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327899264 00000100:00100000:0.0:1788873004.728991:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327899264 00000100:00100000:0.0:1788873004.729043:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4093 00000100:00100000:0.0:1788873004.729052:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327899264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873004.729099:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:0.0:1788873004.729158:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327899264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873004.729165:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4093 00000100:00100000:0.0:1788873004.729214:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327899264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788873004.730086:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327899136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873004.730282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873004.730413:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327899136 00000100:00100000:3.0:1788873004.730420:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327899136 00000100:00100000:3.0:1788873004.730467:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2259 00000100:00100000:3.0:1788873004.730478:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327899136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873004.730503:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788873004.730575:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327899136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873004.730584:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2259 00000100:00100000:1.0:1788873004.730602:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327899136:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788873004.731237:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788873004.731242:0:82775:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:0.0:1788873004.731260:0:82775:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788873004.731263:0:82775:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1788873004.731296:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327899776:0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.731347:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873004.731412:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327900288:0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.731444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873004.731484:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788873004.731490:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327899392:0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.731525:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873004.731589:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327899904:0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.731616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873004.731650:0:26183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327899776 00000100:00100000:0.0:1788873004.731654:0:26183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327899776 00000100:00100000:0.0:1788873004.731710:0:26183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:0.0:1788873004.731718:0:26183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327899776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.732005:0:26183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327899776:12345-0@lo:400:kworker.0 Request processed in 288us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873004.732013:0:26183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00100000:0.0:1788873004.732036:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327900288 00000100:00100000:0.0:1788873004.732039:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327900288 00000100:00100000:0.0:1788873004.732064:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327899904 00000100:00100000:0.0:1788873004.732067:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327899904 00000100:00100000:0.0:1788873004.732083:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:0.0:1788873004.732090:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327900288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.732184:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327900288:12345-0@lo:400:kworker.0 Request processed in 94us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873004.732191:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00100000:0.0:1788873004.732203:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1788873004.732209:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327899904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.732237:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327899904:12345-0@lo:400:kworker.0 Request processed in 28us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873004.732243:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1788873004.732262:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327899392 00000100:00100000:0.0:1788873004.732272:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327899392 00000100:00100000:0.0:1788873004.732299:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788873004.732305:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327899392:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788873004.732423:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788873004.732488:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3644:x1875765327899392:12345-0@lo:400:kworker.0 Request processed in 183us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873004.732495:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788873004.732992:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327899520:0@lo:400:kworker.0 00000100:00100000:1.0:1788873004.733036:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873004.733058:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327900032:0@lo:400:kworker.0 00000100:00100000:1.0:1788873004.733079:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873004.733099:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788873004.733106:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327899648:0@lo:400:kworker.0 00000100:00100000:1.0:1788873004.733198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873004.733216:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c4d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327900160:0@lo:400:kworker.0 00000100:00100000:1.0:1788873004.733240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873004.733399:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3644:1875765327899392:0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.733421:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327899904:0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.733982:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327899776:0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.734001:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327900288:0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.734297:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327899520 00000100:00100000:0.0:1788873004.734304:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327899520 00000100:00100000:0.0:1788873004.734884:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327900032 00000100:00100000:0.0:1788873004.734889:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327900032 00000100:00100000:0.0:1788873004.734915:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327899648 00000100:00100000:0.0:1788873004.734919:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327899648 00000100:00100000:0.0:1788873004.734934:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327900160 00000100:00100000:0.0:1788873004.734937:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327900160 00000100:00100000:0.0:1788873004.734955:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1788873004.734964:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327899520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.735066:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875765327899520:12345-0@lo:400:kworker.0 Request processed in 102us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873004.735074:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1788873004.735093:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:0.0:1788873004.735100:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327900032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873004.735213:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:1.0:1788873004.735224:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f5c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327899648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873004.736687:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:2.0:1788873004.736706:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327900160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873004.737037:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875765327899648:12345-0@lo:400:kworker.0 Request processed in 1814us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873004.737045:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00100000:1.0:1788873004.737108:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1875765327899648:0@lo:400:kworker.0 00000100:00100000:1.0:1788873004.738280:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1875765327899520:0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.738619:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f5c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327900032:12345-0@lo:400:kworker.0 Request processed in 3516us (5534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873004.738636:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:1.0:1788873004.738859:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327900032:0@lo:400:kworker.0 00000100:00100000:2.0:1788873004.739257:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327900160:12345-0@lo:400:kworker.0 Request processed in 2555us (6012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873004.739266:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:1.0:1788873004.740952:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c4d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327900160:0@lo:400:kworker.0 00000100:00100000:0.0:1788873004.820773:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788873004.820845:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788873004.820924:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873004.821080:0:94376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311297792 00000100:00100000:2.0:1788873004.821091:0:94376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311297792 00000100:00100000:2.0:1788873004.821150:0:94376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 222 00000100:00100000:2.0:1788873004.821162:0:94376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311297792:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788873004.821234:0:94376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c67645b7-2296-4087-92b1-886500c47477+10:2404:x1875765311297792:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 75us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873004.821242:0:94376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 222 00000100:00100000:3.0:1788873004.830697:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311298048 00000100:00100000:3.0:1788873004.830710:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311298048 00000100:00100000:3.0:1788873004.830811:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311297920 00000100:00100000:3.0:1788873004.830814:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311297920 00000100:00100000:1.0:1788873004.830882:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1560 00000100:00100000:1.0:1788873004.830895:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2404:x1875765311298048:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788873004.830981:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2404:x1875765311298048:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 89us (10135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873004.830988:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1560 00000100:00100000:0.0:1788873004.830994:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788873004.831027:0:26193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311298176 00000100:00100000:0.0:1788873004.831031:0:26193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311298176 00000100:00080000:2.0:1788873004.831253:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788873004.831259:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788873004.831261:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788873004.831482:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1561 00000100:00100000:3.0:1788873004.831490:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2404:x1875765311297920:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788873004.831525:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2404:x1875765311297920:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 37us (10600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873004.831531:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1561 00000100:00100000:0.0:1788873004.831761:0:26193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2802 00000100:00100000:0.0:1788873004.831769:0:26193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311298176:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788873004.831798:0:26193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2404:x1875765311298176:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 30us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873004.831804:0:26193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2802 00010000:00010000:3.0:1788873005.369728:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788873005.460214:0:97358:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788873005.460461:0:97358:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788873006.204745:0:97408:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788873006.204987:0:97408:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788873006.393064:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873007.417325:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873007.806093:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788873007.806119:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327900416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788873007.806360:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873007.806507:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327900416 00000100:00100000:3.0:1788873007.806517:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327900416 00000100:00100000:3.0:1788873007.806601:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260 00000100:00100000:3.0:1788873007.806612:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327900416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788873007.806655:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788873007.806706:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875765327900416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873007.806713:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260 00000100:00100000:3.0:1788873007.806760:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1875765327900416:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788873007.807233:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788873008.444919:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788873009.339138:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788873009.339166:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327900544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788873009.339295:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788873009.339343:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327900544 00000100:00100000:2.0:1788873009.339350:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327900544 00000100:00100000:2.0:1788873009.339406:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4094 00000100:00100000:2.0:1788873009.339416:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327900544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788873009.339449:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:2.0:1788873009.339495:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327900544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873009.339502:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4094 00000100:00100000:2.0:1788873009.339576:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327900544:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788873009.464821:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788873009.849209:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788873009.849224:0:86506:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:3.0:1788873009.849241:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788873009.849244:0:86506:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1788873009.849286:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327900800:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.849352:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873009.849387:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327901312:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.849409:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873009.849422:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327901824:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.849446:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873009.849482:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788873009.849497:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327900928:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.849528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873009.849544:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327901440:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.849585:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873009.849615:0:26184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327901440 00000100:00100000:3.0:1788873009.849637:0:26184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327901440 00000100:00100000:3.0:1788873009.849716:0:26184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:3.0:1788873009.849737:0:26184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327901440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.849789:0:26184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327901440:12345-0@lo:400:kworker.0 Request processed in 65us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873009.849796:0:26184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00100000:3.0:1788873009.849849:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327901440:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.849896:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327900800 00000100:00100000:3.0:1788873009.849900:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327900800 00000100:00100000:3.0:1788873009.849923:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327901312 00000100:00100000:3.0:1788873009.849925:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327901312 00000100:00100000:3.0:1788873009.849939:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327901824 00000100:00100000:3.0:1788873009.849942:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327901824 00000100:00100000:3.0:1788873009.849955:0:66190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327900928 00000100:00100000:3.0:1788873009.849957:0:66190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327900928 00000100:00100000:3.0:1788873009.849971:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:3.0:1788873009.849976:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327900800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850026:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327900800:12345-0@lo:400:kworker.0 Request processed in 50us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873009.850033:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:3.0:1788873009.850044:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:3.0:1788873009.850050:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327901312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850080:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327901312:12345-0@lo:400:kworker.0 Request processed in 31us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873009.850085:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:3.0:1788873009.850095:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1788873009.850100:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327901824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850137:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327901824:12345-0@lo:400:kworker.0 Request processed in 37us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873009.850143:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1788873009.850153:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:3.0:1788873009.850158:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327900928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850182:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327900928:12345-0@lo:400:kworker.0 Request processed in 24us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873009.850187:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00100000:3.0:1788873009.850205:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327901056:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873009.850247:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327901568:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873009.850283:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788873009.850289:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327900672:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850314:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873009.850338:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327901184:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850358:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873009.850373:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327901696:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850393:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873009.850435:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327901568 00000100:00100000:3.0:1788873009.850439:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327901568 00000100:00100000:3.0:1788873009.850455:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327901696 00000100:00100000:3.0:1788873009.850458:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327901696 00000100:00100000:3.0:1788873009.850469:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:3.0:1788873009.850474:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327901568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850516:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875765327901568:12345-0@lo:400:kworker.0 Request processed in 40us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873009.850523:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:3.0:1788873009.850533:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:3.0:1788873009.850539:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327901696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850587:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875765327901696:12345-0@lo:400:kworker.0 Request processed in 47us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873009.850592:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00100000:3.0:1788873009.850609:0:26185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327901184 00000100:00100000:3.0:1788873009.850612:0:26185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327901184 00000100:00100000:3.0:1788873009.850634:0:26185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804 00000100:00100000:3.0:1788873009.850640:0:26185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327901184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850667:0:26185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1875765327901184:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873009.850673:0:26185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804 00000100:00100000:3.0:1788873009.850700:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327901184:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850709:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1875765327901696:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850717:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875765327901568:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850757:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327900928:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850766:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327900800:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850775:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327901312:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850784:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327901824:0@lo:400:kworker.0 00000100:00100000:3.0:1788873009.850803:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788873009.850809:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9f0984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327901952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788873009.850844:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788873009.850888:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788873009.850893:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788873009.850895:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788873009.850915:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327901952 00000100:00100000:3.0:1788873009.850919:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327901952 00000100:00100000:3.0:1788873009.850944:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261 00000100:00100000:3.0:1788873009.850950:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327901952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873009.850971:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788873009.851005:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327901952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873009.851011:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261 00000100:00100000:3.0:1788873009.851043:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327901952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788873009.852013:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327901056 00000100:00100000:0.0:1788873009.852021:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327901056 00000100:00100000:0.0:1788873009.852066:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4095 00000100:00100000:0.0:1788873009.852074:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327901056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788873009.852141:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327901056:12345-0@lo:400:kworker.0 Request processed in 68us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873009.852147:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4095 00000100:00100000:0.0:1788873009.852179:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327901056:0@lo:400:kworker.0 00000100:00100000:2.0:1788873009.852393:0:94382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327900672 00000100:00100000:2.0:1788873009.852398:0:94382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327900672 00000100:00100000:2.0:1788873009.852434:0:94382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788873009.852441:0:94382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327900672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873009.852479:0:94382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3646:x1875765327900672:12345-0@lo:400:kworker.0 Request processed in 39us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873009.852496:0:94382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788873009.852540:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9f0174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3646:1875765327900672:0@lo:400:kworker.0 00000100:00100000:2.0:1788873009.860714:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327902080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788873009.860789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788873009.860904:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327902080 00000100:00100000:0.0:1788873009.860924:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327902080 00000100:00100000:0.0:1788873009.860977:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4096 00000100:00100000:0.0:1788873009.860985:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327902080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788873009.861014:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:0.0:1788873009.861073:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875765327902080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873009.861080:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4096 00000100:00100000:2.0:1788873009.861453:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1875765327902080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788873009.932683:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873009.932739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873009.932770:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873009.932806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788873009.932941:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311298560 00000100:00100000:3.0:1788873009.932956:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311298560 00000100:00100000:3.0:1788873009.933022:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311298432 00000100:00100000:3.0:1788873009.933026:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311298432 00000100:00100000:3.0:1788873009.933052:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1568 00000100:00100000:3.0:1788873009.933063:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2406:x1875765311298560:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788873009.933135:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2406:x1875765311298560:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 74us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873009.933142:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1568 00000100:00100000:3.0:1788873009.933158:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1569 00000100:00100000:3.0:1788873009.933164:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2406:x1875765311298432:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788873009.933208:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2406:x1875765311298432:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 44us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873009.933215:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1569 00000100:00080000:3.0:1788873009.933338:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788873009.933342:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788873009.933367:0:26187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311298688 00000100:00100000:3.0:1788873009.933370:0:26187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311298688 00000100:00100000:3.0:1788873009.933401:0:26187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2805 00000100:00100000:3.0:1788873009.933408:0:26187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2406:x1875765311298688:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788873009.933439:0:26187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2406:x1875765311298688:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 31us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873009.933445:0:26187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2805 00000100:00080000:3.0:1788873009.933459:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788873009.933523:0:94381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311298304 00000100:00100000:1.0:1788873009.933527:0:94381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311298304 00000100:00100000:1.0:1788873009.933585:0:94381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 224 00000100:00100000:1.0:1788873009.933592:0:94381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311298304:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:1.0:1788873009.933617:0:94381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311298304:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 27us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873009.933623:0:94381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 224 00010000:00010000:3.0:1788873010.488927:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788873011.511814:0:97601:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg439-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00010000:00010000:3.0:1788873011.522328:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788873012.545250:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788873012.920860:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327902208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788873012.920961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873012.921253:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327902208 00000100:00100000:1.0:1788873012.921263:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327902208 00000100:00100000:1.0:1788873012.921339:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2262 00000100:00100000:1.0:1788873012.921350:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327902208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788873012.921381:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788873012.921428:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327902208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873012.921434:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2262 00000100:00080000:3.0:1788873012.921526:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788873012.921604:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327902208:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1788873013.024445:0:97649:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00010000:00010000:3.0:1788873013.562195:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873014.457115:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788873014.457142:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327902336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788873014.457232:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873014.458381:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327902336 00000100:00100000:1.0:1788873014.458396:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327902336 00000100:00100000:1.0:1788873014.458502:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4097 00000100:00100000:1.0:1788873014.458517:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327902336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788873014.458617:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445482496 avail 1299243008 00000100:00100000:1.0:1788873014.458715:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875765327902336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 203us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873014.458723:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4097 00000100:00100000:0.0:1788873014.461519:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1875765327902336:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788873014.585327:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788873014.667714:0:97697:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success 00000100:00100000:0.0:1788873014.968891:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327902464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788873014.968987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873014.969347:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788873014.969363:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327902592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873014.969393:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788873014.969468:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788873014.969472:0:86506:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:1.0:1788873014.969488:0:86506:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788873014.969491:0:86506:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1788873014.969523:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327902720:0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.969583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873014.969610:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327903232:0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.969647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873014.969667:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327903744:0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.969690:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873014.969707:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788873014.969713:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327903104:0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.969741:0:94377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327902720 00000100:00100000:1.0:1788873014.969748:0:94377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327902720 00000100:00100000:1.0:1788873014.969793:0:94377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788873014.969802:0:94377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327902720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.969858:0:94377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2e885a0-f180-4b85-9f87-6a01e20afd1a+24:3647:x1875765327902720:12345-0@lo:400:kworker.0 Request processed in 57us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873014.969865:0:94377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788873014.969910:0:26182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327903232 00000100:00100000:1.0:1788873014.969914:0:26182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327903232 00000100:00100000:1.0:1788873014.969949:0:26182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:1.0:1788873014.969969:0:26182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327903232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.970314:0:26182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765327903232:12345-0@lo:400:kworker.0 Request processed in 346us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873014.970321:0:26182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806 00000100:00100000:1.0:1788873014.970511:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873014.970580:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327902592 00000100:00100000:3.0:1788873014.970585:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327902592 00000100:00100000:3.0:1788873014.970640:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2263 00000100:00100000:3.0:1788873014.970647:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327902592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788873014.970670:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788873014.970716:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c5a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765327902592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873014.970722:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2263 00000100:00100000:3.0:1788873014.970743:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327902848:0@lo:400:kworker.0 00000100:00100000:3.0:1788873014.970769:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873014.970789:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327903360:0@lo:400:kworker.0 00000100:00100000:3.0:1788873014.970808:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873014.970825:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a9df456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327903872:0@lo:400:kworker.0 00000100:00100000:3.0:1788873014.970845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873014.970880:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788873014.970885:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327902976:0@lo:400:kworker.0 00000100:00100000:3.0:1788873014.970907:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788873014.970924:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327903488:0@lo:400:kworker.0 00000100:00100000:3.0:1788873014.970953:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327903744 00000100:00100000:3.0:1788873014.970956:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327903744 00000100:00100000:0.0:1788873014.972242:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327902848 00000100:00100000:0.0:1788873014.972250:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327902848 00000100:00100000:3.0:1788873014.972767:0:66979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327903360 00000100:00100000:3.0:1788873014.972772:0:66979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327903360 00000100:00100000:0.0:1788873014.975509:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327903872 00000100:00100000:0.0:1788873014.975524:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327903872 00000100:00100000:0.0:1788873014.975575:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327902976 00000100:00100000:0.0:1788873014.975578:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327902976 00000100:00100000:0.0:1788873014.975598:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:0.0:1788873014.975609:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327903744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873014.975826:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327902464 00000100:00100000:2.0:1788873014.975831:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327902464 00000100:00100000:3.0:1788873014.975993:0:66979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:3.0:1788873014.976002:0:66979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327902848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788873014.976097:0:23717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327903104 00000100:00100000:2.0:1788873014.976101:0:23717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327903104 00000100:00100000:2.0:1788873014.976122:0:23717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4098 00000100:00100000:2.0:1788873014.976128:0:23717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3645:x1875765327902464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788873014.976153:0:23717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:1.0:1788873014.976267:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98a8c9ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327903616:0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.976306:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873014.976338:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f2e885a0-f180-4b85-9f87-6a01e20afd1a:3647:1875765327902720:0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.976354:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327903232:0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.976374:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1875765327902592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788873014.976417:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4099 00000100:00100000:1.0:1788873014.976424:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3647:x1875765327903104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.976461:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3647:x1875765327903104:12345-0@lo:400:kworker.0 Request processed in 37us (5950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873014.976468:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4099 00000100:00100000:1.0:1788873014.976510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788873014.976539:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327903488 00000100:00100000:1.0:1788873014.976543:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327903488 00000100:00100000:1.0:1788873014.976578:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4100 00000100:00100000:1.0:1788873014.976584:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c9ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327903488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.976619:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c9ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875765327903488:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873014.976625:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4100 00000100:00100000:1.0:1788873014.976661:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1875765327903488:0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.976717:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1875765327903104:0@lo:400:kworker.0 00000100:00080000:1.0:1788873014.976747:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788873014.976751:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873014.976755:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788873014.976765:0:83669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765327903616 00000100:00100000:1.0:1788873014.976769:0:83669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765327903616 00000100:00100000:1.0:1788873014.976788:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:1.0:1788873014.976794:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327903872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.976833:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875765327903872:12345-0@lo:400:kworker.0 Request processed in 38us (5986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873014.976839:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:1.0:1788873014.980284:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573 00000100:00100000:1.0:1788873014.980309:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327902976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.980393:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875765327902976:12345-0@lo:400:kworker.0 Request processed in 97us (9484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873014.980399:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573 00000100:00100000:1.0:1788873014.980417:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:1.0:1788873014.980422:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327903360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.980445:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875765327903360:12345-0@lo:400:kworker.0 Request processed in 24us (9637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873014.980450:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00100000:1.0:1788873014.980460:0:83669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:1.0:1788873014.980465:0:83669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327903616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.980500:0:83669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765327903616:12345-0@lo:400:kworker.0 Request processed in 35us (4193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788873014.980520:0:83669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00100000:1.0:1788873014.980585:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1875765327902976:0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.980596:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875765327903360:0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.980610:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1875765327903872:0@lo:400:kworker.0 00000100:00100000:1.0:1788873014.980662:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c9ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765327903616:0@lo:400:kworker.0 00000100:00100000:0.0:1788873014.980827:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765327903744:12345-0@lo:400:kworker.0 Request processed in 5219us (11134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873014.980834:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00100000:1.0:1788873014.981835:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a9df457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765327903744:0@lo:400:kworker.0 00000100:00100000:3.0:1788873014.982000:0:66979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875765327902848:12345-0@lo:400:kworker.0 Request processed in 5998us (11228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873014.982175:0:66979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:0.0:1788873014.982316:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1875765327902848:0@lo:400:kworker.0 00000100:00100000:2.0:1788873014.982868:0:23717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875765327902464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6737us (13878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873014.982878:0:23717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4098 00000100:00100000:0.0:1788873014.987748:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98a8c5a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1875765327902464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788873015.052377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788873015.052438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788873015.052475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788873015.052524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873015.052584:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311299072 00000100:00100000:3.0:1788873015.052593:0:26188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311299200 00000100:00100000:2.0:1788873015.052595:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311299072 00000100:00100000:3.0:1788873015.052596:0:26188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311299200 00000100:00100000:2.0:1788873015.052665:0:68674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311298944 00000100:00100000:2.0:1788873015.052669:0:68674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311298944 00000100:00100000:0.0:1788873015.052669:0:94375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311298816 00000100:00100000:0.0:1788873015.052672:0:94375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311298816 00000100:00100000:3.0:1788873015.052839:0:26188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2807 00000100:00100000:3.0:1788873015.052850:0:26188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2406:x1875765311299200:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788873015.052931:0:26188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0804304d-5904-48ad-87f2-bcbc7642a62a+7:2406:x1875765311299200:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 82us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873015.052940:0:26188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2807 00000100:00100000:3.0:1788873015.052990:0:66190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1576 00000100:00100000:3.0:1788873015.052999:0:66190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2406:x1875765311299072:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:3.0:1788873015.053046:0:66190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2406:x1875765311299072:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 48us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873015.053053:0:66190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1576 00000100:00100000:2.0:1788873015.053196:0:68674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 1577 00000100:00100000:2.0:1788873015.053203:0:68674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9f0984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2406:x1875765311298944:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:2.0:1788873015.053236:0:68674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9f0984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0804304d-5904-48ad-87f2-bcbc7642a62a+51:2406:x1875765311298944:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 34us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788873015.053242:0:68674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 1577 00000100:00100000:0.0:1788873015.053290:0:94375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 226 00000100:00100000:0.0:1788873015.053505:0:94375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c6c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311298816:12345-192.168.204.39@tcp:400:kworker.0 00000100:00100000:0.0:1788873015.053535:0:94375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c6c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c67645b7-2296-4087-92b1-886500c47477+10:2406:x1875765311298816:12345-192.168.204.39@tcp:400:kworker.0 Request processed in 239us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788873015.057846:0:94375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 226 00000100:00080000:1.0:1788873015.059892:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788873015.059904:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788873015.059907:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788873015.612217:0:14981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788873015.620733:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873015.621775:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311299328 00000100:00100000:2.0:1788873015.621787:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311299328 00000100:00100000:2.0:1788873015.621848:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 2808 00000100:00100000:2.0:1788873015.621860:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a8c4d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2403:x1875765311299328:12345-192.168.204.39@tcp:8:ptlrpcd_rcv.0 00010000:02000400:2.0:1788873015.621894:0:8438:0:(ldlm_lib.c:976:target_handle_reconnect()) lustre-OST0000: Client 0804304d-5904-48ad-87f2-bcbc7642a62a (at 192.168.204.39@tcp) reconnected, waiting for 3 clients in recovery for 1:24 00010000:00080000:2.0:1788873015.639702:0:8438:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp recovering/t4294969478 exp ffff98a8c394c000 cur 3952 last 1788873015 00002000:00100000:3.0:1788873015.641710:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0804304d-5904-48ad-87f2-bcbc7642a62a/ffff98a8c394c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788873015.641741:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli 192.168.204.39@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1788873015.641773:0:8438:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a4800 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1788873015.641783:0:8438:0:(import.c:65:import_set_state_nolock()) ffff98a9e99a4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788873015.641872:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a8c4d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2403:x1875765311299328:12345-192.168.204.39@tcp:8:ptlrpcd_rcv.0 Request processed in 20014us (21147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788873015.641882:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 2808 00000100:00100000:2.0:1788873015.653283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873015.653343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873015.653375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873015.653395:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873015.653417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873015.653482:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:2.0:1788873015.665104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:3.0:1788873015.665528:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311299456 00000100:00100000:3.0:1788873015.665574:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311299456 00000100:00100000:3.0:1788873015.665714:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311299584 00000100:00100000:3.0:1788873015.665718:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311299584 00000100:00100000:3.0:1788873015.665928:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311299712 00000100:00100000:3.0:1788873015.665933:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311299712 00000100:00100000:3.0:1788873015.665968:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311299840 00000100:00100000:3.0:1788873015.665972:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311299840 00000100:00100000:3.0:1788873015.665988:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311299968 00000100:00100000:3.0:1788873015.665992:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311299968 00000100:00100000:3.0:1788873015.666007:0:26189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311300096 00000100:00100000:3.0:1788873015.666010:0:26189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311300096 00000100:00100000:3.0:1788873015.666031:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6102 00000100:00100000:3.0:1788873015.666041:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2403:x1875765311299456:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788873015.666061:0:26189:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9df436680 x1875765311299456/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873015.666856:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2403:x1875765311299456:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 41us (12807us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873015.666867:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6102 00000100:00100000:3.0:1788873015.666884:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6103 00000100:00100000:3.0:1788873015.666894:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2403:x1875765311299584:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788873015.666908:0:26189:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9df434380 x1875765311299584/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788873015.666919:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2403:x1875765311299584:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 30us (13577us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788873015.666925:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6103 00000100:00100000:3.0:1788873015.666933:0:26189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6104 00000100:00100000:3.0:1788873015.666939:0:26189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9df437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2403:x1875765311299712:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1788873015.667346:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6105 00000100:00100000:0.0:1788873015.667358:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2403:x1875765311299840:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788873015.667369:0:26199:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9ff53f480 x1875765311299840/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873015.667379:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+10:2403:x1875765311299840:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 26us (13984us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788873015.667385:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6105 00000100:00100000:0.0:1788873015.667392:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311300224 00000100:00100000:0.0:1788873015.667398:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311300224 00000100:00100000:0.0:1788873015.667429:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6106 00000100:00100000:0.0:1788873015.667439:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2403:x1875765311299968:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788873015.667448:0:26199:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9ff53c380 x1875765311299968/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873015.667458:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+11:2403:x1875765311299968:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 24us (14042us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788873015.667470:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6106 00000100:00100000:2.0:1788873015.667472:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.39@tcp (source: 12345-192.168.204.39@tcp) 00000100:00100000:0.0:1788873015.667489:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765311300352 00000100:00100000:0.0:1788873015.667493:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765311300352 00000100:00100000:0.0:1788873015.667517:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6107 00000100:00100000:0.0:1788873015.667523:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+12:2403:x1875765311300096:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788873015.667532:0:26199:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9ff53f800 x1875765311300096/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873015.667545:0:26186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6108 00000100:00100000:0.0:1788873015.667546:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+12:2403:x1875765311300096:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 20us (14061us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788873015.667583:0:26186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ff53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+12:2403:x1875765311300224:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788873015.667594:0:26186:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9ff53f100 x1875765311300224/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788873015.667604:0:26186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ff53f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0804304d-5904-48ad-87f2-bcbc7642a62a+12:2403:x1875765311300224:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 26us (2511us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788873015.667623:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6107 00000100:00100000:2.0:1788873015.667631:0:26186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6108 00000100:00100000:0.0:1788873015.667638:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.39@tcp, seq: 6109 00000100:00100000:0.0:1788873015.667648:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98a9ef9e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+12:2403:x1875765311300352:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788873015.667657:0:26199:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9ef9e2300 x1875765311300352/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788873015.667667:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9ef9e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:0804304d-5904-48ad-87f2-bcbc7642a62a+12:2403:x1875765311300352:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 22us (205us total) trans 0 rc 0/-999 00010000:00080000:2.0:1788873015.667671:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00000100:00100000:0.0:1788873015.667674:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6109 00010000:00080000:2.0:1788873015.667683:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9df436680 x1875765311299456/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873015.667692:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788873015.667705:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873015.667707:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873015.667712:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9df434380 x1875765311299584/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873015.667719:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788873015.667724:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873015.667725:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873015.667729:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9ff53f480 x1875765311299840/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873015.667922:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788873015.667929:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873015.667930:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873015.667935:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9ff53c380 x1875765311299968/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873015.667941:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788873015.667944:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873015.667945:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873015.667949:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9ff53f800 x1875765311300096/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873015.667955:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788873015.667958:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873015.667960:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873015.667963:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9ff53f100 x1875765311300224/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873015.667968:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788873015.667973:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788873015.667974:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873015.667977:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9ef9e2300 x1875765311300352/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873015.667982:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788873015.667986:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788873015.668278:0:26189:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff98a9df437480 x1875765311299712/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788873015.668690:0:96965:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788873015.668710:0:96965:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.204.39@tcp: req@ffff98a9df437480 x1875765311299712/t0(0) o101->0804304d-5904-48ad-87f2-bcbc7642a62a@192.168.204.39@tcp:186/0 lens 328/0 e 0 to 0 dl 1788873026 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788873015.668717:0:96965:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788873015.668720:0:96965:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788873015.668827:0:26189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98a9df437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0804304d-5904-48ad-87f2-bcbc7642a62a+5:2403:x1875765311299712:12345-192.168.204.39@tcp:101:ldlm_lock_repla.0 Request processed in 1887us (15450us total) trans 0 rc -19/-999 00000100:00100000:3.0:1788873015.668845:0:26189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.39@tcp, seq: 6104 Debug log: 72141 lines, 72141 kept, 0 dropped, 0 bad.